00000100:00100000:3.0:1763343026.906339:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993223680 00000100:00100000:3.0:1763343026.906355:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993223680 00000100:00100000:3.0:1763343026.911027:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993223936 00000100:00100000:3.0:1763343026.911040:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993223936 00000100:00100000:3.0:1763343026.911680:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8444 00000100:00100000:3.0:1763343026.911694:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+210:56735:x1848997993223936:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:3.0:1763343026.911776:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763343026.911811:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1ed8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19c:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7ae6 expref: 210 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343026.911839:0:6523:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae1f10 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x19c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7aed expref: 209 pid: 6523 timeout: 1320 lvb_type: 0 00010000:00010000:3.0:1763343026.911854:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae1ebc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7ad8 expref: 209 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343026.911867:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19c:0x0].0x0 (ffff9a34047db700) 00010000:00010000:3.0:1763343026.911872:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae1f3a lrc: 3/0,1 mode: --/CW res: [0x200000405:0x19c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.911881:0:6523:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae1f3a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x19c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.911889:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae1f3a lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x19c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.911913:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343026.911950:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae1f41 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343026.911959:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae1f41 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343026.911972:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae1f41 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343026.911985:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae1f48 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343026.911992:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae1f48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343026.911998:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae1f48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343026.912125:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae1f4f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343026.912135:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae1f3a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x19c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.912143:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae1f4f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x19c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343026.912157:0:6523:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae1f3a lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x19c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.912166:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae1f4f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x19c:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:3.0:1763343026.921553:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993224064 00000100:00100000:3.0:1763343026.921572:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993224064 00010000:00010000:3.0:1763343026.921681:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae1f3a lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x19c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7b09 expref: 208 pid: 6525 timeout: 1320 lvb_type: 0 00000100:00100000:3.0:1763343026.921729:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2774 00000100:00100000:3.0:1763343026.921741:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+208:2429:x1848997993224064:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343026.921762:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343026.921769:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae1f3a lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x19c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7b09 expref: 208 pid: 6525 timeout: 1320 lvb_type: 0 00010000:00010000:3.0:1763343026.921783:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae1f3a lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x19c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7b09 expref: 208 pid: 6525 timeout: 1320 lvb_type: 0 00010000:00010000:3.0:1763343026.921810:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae1f3a lrc: 0/0,0 mode: --/CW res: [0x200000405:0x19c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7b09 expref: 208 pid: 6525 timeout: 1320 lvb_type: 0 00010000:00010000:3.0:1763343026.921831:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19c:0x0].0x0 (ffff9a34047db700) 00010000:00010000:3.0:1763343026.921837:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae1f4f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x19c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343026.921848:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae1f4f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343026.921856:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae1f4f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x19c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343026.921897:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343026.921974:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+207:2429:x1848997993224064:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 233us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343026.921982:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2774 00000100:00100000:3.0:1763343026.923388:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993224192 00000100:00100000:3.0:1763343026.923397:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993224192 00000100:00100000:3.0:1763343026.923454:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8445 00000100:00100000:3.0:1763343026.923463:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+209:56734:x1848997993224192:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343026.923491:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343026.923518:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1f5d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7b10 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343026.923605:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae1f64 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.923617:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae1f64 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.923657:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae1f64 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343026.923701:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x19c:0x0]: returning size 5 00000004:00200000:3.0:1763343026.923706:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343026.923727:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae1f64 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.923755:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1f5d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x19c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7b10 expref: 210 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343026.923773:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae1f64 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19c:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7b10 expref: 209 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343026.923782:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19c:0x0].0x0 (ffff9a3404616700) 00010000:00010000:3.0:1763343026.923785:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763343026.923788:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343026.923842:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+209:56734:x1848997993224192:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 379us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343026.923848:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8445 00000100:00100000:3.0:1763343026.940719:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993224704 00000100:00100000:3.0:1763343026.940731:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993224704 00002000:00100000:3.0:1763343026.940793:0:24024:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x24b:0x0] (0->4) req@ffff9a3537968000 x1848997993224704/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:522/0 lens 496/0 e 0 to 0 dl 1763343037 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343026.940805:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537968000 with x1848997993224704 ext(0->4) 00010000:00010000:3.0:1763343026.940813:0:24024:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae1f1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7af4 expref: 18 pid: 27833 timeout: 1320 lvb_type: 0 00010000:00010000:3.0:1763343026.940828:0:24024:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae1f1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7af4 expref: 18 pid: 27833 timeout: 1320 lvb_type: 0 00002000:00010000:3.0:1763343026.940836:0:24024:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a3537968000 00000100:00100000:3.0:1763343026.940871:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 92 00000100:00100000:3.0:1763343026.940881:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993224704:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:3.0:1763343026.945585:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993224704:12345-192.168.204.21@tcp:4:bash.0 Request processed in 4700us (5128us total) trans 21474838583 rc 0/0 00000100:00100000:3.0:1763343026.945603:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 92 00002000:00100000:3.0:1763343026.945642:0:24024:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x24b:0x0] (0->4) req@ffff9a3537968000 x1848997993224704/t21474838583(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:522/0 lens 496/448 e 0 to 0 dl 1763343037 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343026.945655:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537968000 with x1848997993224704 ext(0->4) 00010000:00010000:3.0:1763343026.945668:0:24024:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae1f1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7af4 expref: 20 pid: 27833 timeout: 1320 lvb_type: 0 00010000:00010000:3.0:1763343026.945697:0:24024:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae1f1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7af4 expref: 20 pid: 27833 timeout: 1320 lvb_type: 0 00002000:00010000:3.0:1763343026.945707:0:24024:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a3537968000 00000100:00100000:3.0:1763343026.946582:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993224832 00000100:00100000:3.0:1763343026.946594:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993224832 00000100:00100000:3.0:1763343026.946670:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8447 00000100:00100000:3.0:1763343026.946680:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+211:56736:x1848997993224832:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343026.946707:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343026.946735:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1f87 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7b1e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343026.946818:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae1f8e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.946834:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae1f8e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.946846:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae1f8e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.946856:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1f95 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.946863:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1f95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.946869:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1f95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.946918:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae1f8e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.946925:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae1f8e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.946931:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae1f8e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.946941:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae1f8e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.946947:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343026.946952:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae1f8e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.946959:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae1f8e lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.946973:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616f00) 00010000:00010000:3.0:1763343026.946976:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343026.946981:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae1f8e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.946988:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae1f8e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.947003:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1f95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.947008:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1f95 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.947013:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1f95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.947018:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343026.947021:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1f95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.947026:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1f95 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.947036:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404616c00) 00010000:00010000:3.0:1763343026.947038:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343026.947040:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1f95 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.947046:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1f95 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343026.949299:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1f87 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7b1e expref: 212 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343026.949317:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616f00) 00010000:00010000:3.0:1763343026.949320:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343026.949325:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1f87 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7b1e expref: 212 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343026.949344:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93c00, rc 0) 00000100:00100000:3.0:1763343026.950841:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993224960 00000100:00100000:3.0:1763343026.950854:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993224960 00010000:00010000:3.0:1763343026.950903:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae1f1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7af4 expref: 20 pid: 27833 timeout: 1320 lvb_type: 0 00000100:00100000:3.0:1763343026.950942:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2775 00000100:00100000:3.0:1763343026.950953:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2432:x1848997993224960:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343026.950971:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1763343026.950995:0:27834:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x24b:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:3.0:1763343026.950999:0:27834:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x24b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763343026.951005:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae1f1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7af4 expref: 20 pid: 27833 timeout: 1320 lvb_type: 0 00010000:00010000:3.0:1763343026.951021:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae1f1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7af4 expref: 20 pid: 27833 timeout: 1320 lvb_type: 0 00010000:00010000:3.0:1763343026.951048:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae1f1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7af4 expref: 20 pid: 27833 timeout: 1320 lvb_type: 0 00010000:00010000:3.0:1763343026.951066:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343026.951068:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343026.951085:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3501480a00/0x607405d401ae1f80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343026.951275:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501480a00/0x607405d401ae1f80 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343026.951370:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343026.952370:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2432:x1848997993224960:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1415us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343026.952382:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2775 00000100:00100000:3.0:1763343026.963585:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010161024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343026.963694:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343026.963744:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343026.963750:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010160896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343026.963770:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343026.963809:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010161024 00000100:00100000:3.0:1763343026.963818:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010161024 00000100:00100000:3.0:1763343026.963870:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010160896 00000100:00100000:3.0:1763343026.963874:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010160896 00000100:00100000:3.0:1763343026.963899:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5825 00000100:00100000:3.0:1763343026.963908:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:3658:x1848998010161024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343026.964124:0:28996:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343026.964129:0:28996:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x24e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343026.964131:0:28996:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x24e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343026.964133:0:28996:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x24e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343026.964136:0:28996:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x24e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343026.964182:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:3658:x1848998010161024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 274us (488us total) trans 17179871285 rc 0/0 00000100:00100000:3.0:1763343026.964191:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5825 00000100:00100000:3.0:1763343026.964214:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5826 00000100:00100000:3.0:1763343026.964222:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:3658:x1848998010160896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343026.964277:0:28996:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x24d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343026.964280:0:28996:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x24d:0x0] updating lvb mtime from disk: 1763343026 -> 1763343026 00002000:00010000:3.0:1763343026.964282:0:28996:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x24d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343026.964284:0:28996:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x24d:0x0] updating lvb ctime from disk: 1763343026 -> 1763343026 00002000:00010000:3.0:1763343026.964287:0:28996:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x24d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343026.964309:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:3658:x1848998010160896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (537us total) trans 17179871286 rc 0/0 00000100:00100000:3.0:1763343026.964315:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5826 00000004:00080000:3.0:1763343026.964369:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b93480/2, rc 0, transno 17179871286 00000100:00100000:3.0:1763343026.964375:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010160896:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343026.964385:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b91880/2, rc 0, transno 17179871285 00000100:00100000:3.0:1763343026.964388:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010161024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343026.969109:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010161280 00000100:00100000:3.0:1763343026.969132:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010161280 00000100:00100000:3.0:1763343026.969202:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010161152 00000100:00100000:3.0:1763343026.969205:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010161152 00000100:00100000:3.0:1763343026.969319:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5827 00000100:00100000:3.0:1763343026.969325:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3660:x1848998010161280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343026.969913:0:27833:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343026.969916:0:27833:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x24c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343026.969919:0:27833:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x24c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343026.969921:0:27833:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x24c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343026.969923:0:27833:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x24c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343026.969963:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3660:x1848998010161280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 639us (5138us total) trans 21474838584 rc 0/0 00000100:00100000:3.0:1763343026.969969:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5827 00000100:00100000:3.0:1763343026.969984:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5828 00000100:00100000:3.0:1763343026.969990:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3660:x1848998010161152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343026.970063:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3660:x1848998010161152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (5185us total) trans 21474838585 rc 0/0 00000100:00100000:3.0:1763343026.970070:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5828 00000100:00100000:3.0:1763343026.978153:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8453 00000100:00100000:3.0:1763343026.978163:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+206:56736:x1848997993225856:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343026.978171:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343026.978195:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae1fcd lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7b41 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343026.978277:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1fdb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978294:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1fdb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978307:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1fdb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978322:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1fe9 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978327:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978332:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978373:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1fdb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978379:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1fdb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978386:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1fdb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978393:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1fdb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978398:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343026.978402:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1fdb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978410:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1fdb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978423:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a35167a9100) 00010000:00010000:3.0:1763343026.978426:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343026.978432:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1fdb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978438:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae1fdb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978447:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978453:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978459:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978462:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343026.978465:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978470:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978476:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404616f00) 00010000:00010000:3.0:1763343026.978478:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343026.978481:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1fe9 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978486:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae1fe9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343026.978507:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae1fcd lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7b41 expref: 208 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343026.978517:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a35167a9100) 00010000:00010000:3.0:1763343026.978519:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343026.978522:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae1fcd lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7b41 expref: 208 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343026.978532:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343026.978556:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+206:56736:x1848997993225856:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 395us (646us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343026.978561:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8453 00000100:00100000:3.0:1763343026.998151:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.005132:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993226624 00000100:00100000:3.0:1763343027.005156:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993226624 00010000:00010000:3.0:1763343027.006993:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7e00/0x607405d401ae2021 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343027.007008:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7e00/0x607405d401ae2021 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343027.007042:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x19d:0x0]: returning size 0 00000100:00100000:3.0:1763343027.070057:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993228416 00000100:00100000:3.0:1763343027.070081:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993228416 00000100:00100000:3.0:1763343027.070514:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993228544 00000100:00100000:3.0:1763343027.070519:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993228544 00000100:00100000:3.0:1763343027.070561:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 5835 00000100:00100000:3.0:1763343027.070573:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+33:55941:x1848997993228416:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343027.070597:0:27833:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343027.070653:0:27833:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae207c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7b79 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343027.070682:0:27833:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x24f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343027.070705:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.070709:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.070721:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae207c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7b79 expref: 34 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.070740:0:27833:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae207c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7b79 expref: 34 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.070755:0:27833:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343027.070784:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:55941:x1848997993228416:12345-192.168.204.21@tcp:101:bash.0 Request processed in 212us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343027.070792:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 5835 00000100:00100000:3.0:1763343027.078803:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1453 00000100:00100000:3.0:1763343027.078822:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2430:x1848997993228928:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343027.079103:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x24f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343027.079108:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x24f:0x0] updating lvb mtime from disk: 0 -> 1763343026 00002000:00010000:3.0:1763343027.079111:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x24f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343027.079115:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x24f:0x0] updating lvb ctime from disk: 0 -> 1763343026 00002000:00010000:3.0:1763343027.079119:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x24f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343027.079448:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+35:2430:x1848997993228928:12345-192.168.204.21@tcp:10:bash.0 Request processed in 631us (1158us total) trans 17179871289 rc 0/0 00000100:00100000:3.0:1763343027.079457:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1453 00002000:00010000:3.0:1763343027.079462:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/591 (0->18446744073709551615) 00002000:00100000:3.0:1763343027.079465:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340a659f80 with x1848997993228928 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343027.079471:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340a659f80. 00000100:00100000:3.0:1763343027.099306:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.105889:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.106457:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343027.107893:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343027.107900:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae20d7 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.107906:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343027.107909:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae20d7 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.107916:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae20d7 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.107924:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19d:0x0].0x0 (ffff9a34047db800) 00010000:00010000:3.0:1763343027.107927:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343027.107930:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae20d7 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.107935:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae20d7 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.107948:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.107950:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.107953:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343027.127401:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.143139:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.151778:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993230848 00000100:00100000:3.0:1763343027.151792:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993230848 00000100:00100000:3.0:1763343027.151858:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8468 00000100:00100000:3.0:1763343027.151868:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+212:56738:x1848997993230848:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343027.151895:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343027.151923:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae211d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7baa expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.152023:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2124 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152040:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2124 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152053:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2124 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152065:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae212b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152083:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae212b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152090:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae212b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152141:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2124 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152149:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2124 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152155:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2124 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152162:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2124 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152169:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343027.152174:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2124 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152187:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2124 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152201:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34047dbf00) 00010000:00010000:3.0:1763343027.152205:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343027.152210:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2124 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152216:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2124 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152228:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae212b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152234:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae212b lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152239:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae212b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152244:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343027.152246:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae212b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152252:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae212b lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152260:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34047db700) 00010000:00010000:3.0:1763343027.152262:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343027.152265:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae212b lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152271:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae212b lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.152305:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae211d lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7baa expref: 213 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.152316:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34047dbf00) 00010000:00010000:3.0:1763343027.152318:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343027.152322:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae211d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7baa expref: 213 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.152331:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93a00, rc 0) 00000100:00100000:3.0:1763343027.152397:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+212:56738:x1848997993230848:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 530us (973us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343027.152404:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8468 00000100:00100000:3.0:1763343027.163143:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993230976 00000100:00100000:3.0:1763343027.163156:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993230976 00000100:00100000:3.0:1763343027.164774:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 5838 00000100:00100000:3.0:1763343027.164800:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:56734:x1848997993230976:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343027.164825:0:27833:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343027.164856:0:27833:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae2132 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7bb1 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343027.164888:0:27833:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x24e:0x0] initial LVB size: 4096, mtime: 0x691a7ab3, atime: 0x0, ctime: 0x691a7ab3, blocks: 0x8 00010000:00010000:3.0:1763343027.164917:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.164920:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.164929:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae2132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bb1 expref: 14 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.164946:0:27833:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae2132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bb1 expref: 14 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.164963:0:27833:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93a00, rc 0) 00000100:00100000:3.0:1763343027.165043:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:56734:x1848997993230976:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 255us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343027.165051:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 5838 00000100:00100000:3.0:1763343027.168727:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993231360 00000100:00100000:3.0:1763343027.168732:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993231360 00000100:00100000:3.0:1763343027.177742:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.179855:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993231744 00000100:00100000:3.0:1763343027.179871:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993231744 00000100:00100000:3.0:1763343027.179946:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8470 00000100:00100000:3.0:1763343027.179959:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+214:56738:x1848997993231744:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343027.179997:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343027.180027:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2163 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7bc6 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.180211:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae216a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.180234:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae2155 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bb8 expref: 215 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.180246:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae216a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.180309:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae2155 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bb8 expref: 215 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.180322:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae2155 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bb8 expref: 215 pid: 6523 timeout: 1320 lvb_type: 0 00000100:00100000:3.0:1763343027.180340:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010162304:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343027.186439:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010162304:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343027.186461:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae216a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343027.191172:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993232384 00000100:00100000:3.0:1763343027.191177:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993232384 00000100:00100000:3.0:1763343027.202435:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.212233:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993233536 00000100:00100000:3.0:1763343027.212242:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993233536 00000100:00100000:3.0:1763343027.212297:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 5842 00000100:00100000:3.0:1763343027.212307:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993233536:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:3.0:1763343027.212481:0:8408:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x24b:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343027.212485:0:8408:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x24b:0x0] updating lvb mtime from disk: 1763343026 -> 1763343026 00002000:00010000:3.0:1763343027.212488:0:8408:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x24b:0x0] updating lvb atime from disk: 1763343026 -> 1763343026 00002000:00010000:3.0:1763343027.212490:0:8408:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x24b:0x0] updating lvb ctime from disk: 1763343026 -> 1763343027 00002000:00010000:3.0:1763343027.212493:0:8408:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x24b:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343027.212534:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993233536:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 228us (439us total) trans 21474838590 rc 0/0 00000100:00100000:3.0:1763343027.212542:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 5842 00000100:00100000:3.0:1763343027.214674:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993233664 00000100:00100000:3.0:1763343027.214684:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993233664 00000100:00100000:3.0:1763343027.214743:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8473 00000100:00100000:3.0:1763343027.214753:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+220:55941:x1848997993233664:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343027.214783:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343027.214809:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae21a9 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7bdb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.214851:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae21b0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.214868:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae21b0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.214881:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae21b0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.215023:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae21a9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bdb expref: 222 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.215043:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae21b0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x19f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bdb expref: 221 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.215053:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19f:0x0].0x0 (ffff9a3403bde100) 00010000:00010000:3.0:1763343027.215057:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343027.215061:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:3.0:1763343027.215282:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+221:55941:x1848997993233664:12345-192.168.204.21@tcp:101:bash.0 Request processed in 530us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343027.215290:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8473 00000100:00100000:3.0:1763343027.221594:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993233920 00000100:00100000:3.0:1763343027.221603:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993233920 00000100:00100000:3.0:1763343027.224560:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993234304 00000100:00100000:3.0:1763343027.224571:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993234304 00000100:00100000:3.0:1763343027.224677:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8475 00000100:00100000:3.0:1763343027.224689:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:55941:x1848997993234304:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343027.224713:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343027.224737:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae21c5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7be2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.224810:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae21c5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7be2 expref: 225 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.224831:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae21c5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7be2 expref: 225 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.224856:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19f:0x0].0x0 (ffff9a3403bde100) 00010000:00010000:3.0:1763343027.224860:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343027.224865:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343027.224935:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:55941:x1848997993234304:12345-192.168.204.21@tcp:101:bash.0 Request processed in 248us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343027.224942:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8475 00000100:00100000:3.0:1763343027.227815:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.230915:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343027.239372:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343027.239384:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae21e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.239394:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343027.239400:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae21e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.239414:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae21e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.239435:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae21e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.239451:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae21e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.239469:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.239471:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.239475:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343027.239487:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010164096:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343027.239525:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010164352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343027.239562:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010163968:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343027.239590:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343027.242098:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010164480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343027.242664:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343027.242696:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a4df80/2, rc 0, transno 21474838595 00000100:00100000:3.0:1763343027.242702:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010163456:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343027.242712:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a4e300/2, rc 0, transno 21474838594 00000100:00100000:3.0:1763343027.242716:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010163328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343027.242743:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343027.242769:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010164608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343027.242796:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343027.242931:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010164480 00000100:00100000:3.0:1763343027.242936:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010164480 00000100:00100000:3.0:1763343027.242958:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010164096 00000100:00100000:3.0:1763343027.242961:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010164096 00000100:00100000:3.0:1763343027.242980:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010164608 00000100:00100000:3.0:1763343027.242983:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010164608 00000100:00100000:3.0:1763343027.243000:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5851 00000100:00100000:3.0:1763343027.243006:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3659:x1848998010164480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343027.243141:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3659:x1848998010164480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 133us (476us total) trans 17179871294 rc 0/0 00000100:00100000:3.0:1763343027.243151:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5851 00000100:00100000:3.0:1763343027.243168:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5853 00000100:00100000:3.0:1763343027.243177:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3660:x1848998010164608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343027.243270:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3660:x1848998010164608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (472us total) trans 17179871295 rc 0/0 00000100:00100000:3.0:1763343027.243277:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5853 00000004:00080000:3.0:1763343027.243307:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406552300/2, rc 0, transno 17179871295 00000100:00100000:3.0:1763343027.243313:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010164608:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343027.243333:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c3bdc00/2, rc 0, transno 17179871294 00000100:00100000:3.0:1763343027.243337:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010164480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343027.248999:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993234944 00000100:00100000:3.0:1763343027.249011:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993234944 00010000:00010000:3.0:1763343027.249062:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae2083 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7b80 expref: 23 pid: 8408 timeout: 1320 lvb_type: 0 00000100:00100000:3.0:1763343027.249154:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2782 00000100:00100000:3.0:1763343027.249166:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2429:x1848997993234944:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343027.249192:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343027.249199:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae2083 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7b80 expref: 23 pid: 8408 timeout: 1320 lvb_type: 0 00010000:00010000:3.0:1763343027.249219:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae2083 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7b80 expref: 23 pid: 8408 timeout: 1320 lvb_type: 0 00010000:00010000:3.0:1763343027.249254:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.249256:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.249263:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7e00/0x607405d401ae21da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.249275:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7e00/0x607405d401ae21da lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.249300:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343027.249364:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2429:x1848997993234944:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 200us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343027.249372:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2782 00010000:00010000:3.0:1763343027.254775:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343027.254790:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7e00/0x607405d401ae21da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.254803:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343027.254808:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7e00/0x607405d401ae21da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.254820:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7e00/0x607405d401ae21da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.254845:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7e00/0x607405d401ae21da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.254855:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7e00/0x607405d401ae21da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.254880:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.254882:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.254884:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.258284:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343027.258293:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae220b lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x19c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343027.258301:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343027.258305:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae220b lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x19c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343027.258313:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae220b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x19c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343027.258327:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19c:0x0].0x0 (ffff9a3404616700) 00010000:00010000:3.0:1763343027.258330:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343027.258335:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae220b lrc: 1/0,0 mode: --/PW res: [0x200000405:0x19c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343027.258340:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae220b lrc: 0/0,0 mode: --/PW res: [0x200000405:0x19c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343027.258352:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.258354:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.258356:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343027.264128:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993235840 00000100:00100000:3.0:1763343027.264141:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993235840 00002000:00010000:3.0:1763343027.264196:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/593 (0->18446744073709551615) 00002000:00100000:3.0:1763343027.264207:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062caa00 with x1848997993235840 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343027.264226:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34062caa00. 00000100:00100000:3.0:1763343027.264285:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1459 00000100:00100000:3.0:1763343027.264301:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2431:x1848997993235840:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343027.264551:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x251:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343027.264559:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x251:0x0] updating lvb mtime from disk: 0 -> 1763343027 00002000:00010000:3.0:1763343027.264566:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x251:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343027.264572:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x251:0x0] updating lvb ctime from disk: 0 -> 1763343027 00002000:00010000:3.0:1763343027.264578:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x251:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343027.265756:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2431:x1848997993235840:12345-192.168.204.21@tcp:10:bash.0 Request processed in 1451us (1750us total) trans 17179871299 rc 0/0 00000100:00100000:3.0:1763343027.265770:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1459 00002000:00010000:3.0:1763343027.265775:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/593 (0->18446744073709551615) 00002000:00100000:3.0:1763343027.265779:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062caa00 with x1848997993235840 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343027.265787:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34062caa00. 00000100:00100000:3.0:1763343027.274687:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993236352 00000100:00100000:3.0:1763343027.274693:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993236352 00000100:00100000:3.0:1763343027.274736:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2869 00000100:00100000:3.0:1763343027.274746:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350922b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+208:55941:x1848997993236352:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:3.0:1763343027.275115:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350922b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+210:55941:x1848997993236352:12345-192.168.204.21@tcp:35:bash.0 Request processed in 369us (516us total) trans 8589939230 rc 0/0 00000100:00100000:3.0:1763343027.275127:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2869 00000100:00100000:3.0:1763343027.283378:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.288102:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.292024:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.295654:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.298807:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.315188:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.321237:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993239168 00000100:00100000:3.0:1763343027.321242:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993239168 00000100:00100000:3.0:1763343027.321294:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2873 00000100:00100000:3.0:1763343027.321306:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+216:56734:x1848997993239168:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343027.321726:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+217:56734:x1848997993239168:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 420us (765us total) trans 8589939236 rc 0/0 00000100:00100000:3.0:1763343027.321734:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2873 00010000:00010000:3.0:1763343027.323532:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343027.323542:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae22cf lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343027.323549:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343027.323553:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae22cf lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343027.323559:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae22cf lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343027.323570:0:13198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x19f:0x0].0x0 (ffff9a3403bde100) 00010000:00010000:3.0:1763343027.323572:0:13198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343027.323576:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae22cf lrc: 1/0,0 mode: --/PW res: [0x200000405:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343027.323582:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae22cf lrc: 0/0,0 mode: --/PW res: [0x200000405:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343027.323593:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.323595:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.323598:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343027.355417:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.376269:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.405534:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.416553:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993241472 00000100:00100000:3.0:1763343027.416560:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993241472 00000100:00100000:3.0:1763343027.416602:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2874 00000100:00100000:3.0:1763343027.416614:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3509229450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:56743:x1848997993241472:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343027.416823:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3509229450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:56743:x1848997993241472:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 210us (578us total) trans 8589939240 rc 0/0 00000100:00100000:3.0:1763343027.416836:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2874 00000100:00100000:3.0:1763343027.428296:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.436441:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.443387:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.465326:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993244160 00000100:00100000:3.0:1763343027.465342:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993244160 00000100:00100000:3.0:1763343027.465421:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2879 00000100:00100000:3.0:1763343027.465432:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56743:x1848997993244160:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:3.0:1763343027.465586:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56743:x1848997993244160:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 154us (5080us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343027.465594:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2879 00000100:00100000:3.0:1763343027.475765:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993244416 00000100:00100000:3.0:1763343027.475775:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993244416 00000100:00100000:3.0:1763343027.480110:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.484202:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010165888:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343027.484263:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343027.484309:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010166400:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343027.484334:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343027.484349:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010166912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343027.484366:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343027.484402:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010166912 00000100:00100000:3.0:1763343027.484404:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010166912 00000100:00100000:3.0:1763343027.484426:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5861 00000100:00100000:3.0:1763343027.484432:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3658:x1848998010166400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343027.484448:0:27833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:593 count 1 00010000:00010000:3.0:1763343027.484470:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae242d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.484488:0:27833:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae2204 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bfe expref: 16 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.484497:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343027.484499:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343027.484504:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae242d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.484528:0:27833:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae2204 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bfe expref: 16 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.484542:0:27833:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae2204 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bfe expref: 16 pid: 27833 timeout: 1321 lvb_type: 0 00000100:00100000:3.0:1763343027.484554:0:27833:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27833:1848998010167424:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343027.486648:0:27833:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c180 going to sleep for 11 seconds 00000100:00100000:3.0:1763343027.486710:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343027.486745:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010166272:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343027.486772:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343027.486787:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a351fc76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010166784:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343027.486804:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343027.486835:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010166144 00000100:00100000:3.0:1763343027.486839:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010166144 00000100:00100000:3.0:1763343027.486863:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010165760 00000100:00100000:3.0:1763343027.486866:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010165760 00000100:00100000:3.0:1763343027.486880:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010166272 00000100:00100000:3.0:1763343027.486882:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010166272 00000100:00100000:3.0:1763343027.486890:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010166784 00000100:00100000:3.0:1763343027.486892:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010166784 00000100:00100000:3.0:1763343027.486902:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5864 00000100:00100000:3.0:1763343027.486908:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3660:x1848998010166144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343027.486924:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:588 count 1 00010000:00010000:3.0:1763343027.486939:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae2442 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.486952:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae2139 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bbf expref: 24 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.486958:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343027.486960:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343027.486963:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae2442 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.486986:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae2139 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bbf expref: 24 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.487000:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae2139 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bbf expref: 24 pid: 8408 timeout: 1321 lvb_type: 0 00000100:00100000:3.0:1763343027.487009:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010167680:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343027.487058:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c600 going to sleep for 11 seconds 00000100:00100000:3.0:1763343027.487085:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5865 00000100:00100000:3.0:1763343027.487096:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3657:x1848998010165760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343027.487110:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:587 count 1 00010000:00010000:3.0:1763343027.487121:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae2449 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.489156:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae217f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bcd expref: 24 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.489164:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343027.489165:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343027.489168:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae2449 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.489194:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae217f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bcd expref: 24 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.489203:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae217f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bcd expref: 24 pid: 8408 timeout: 1321 lvb_type: 0 00000100:00100000:3.0:1763343027.489215:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1848998010167936:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343027.489259:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c480 going to sleep for 11 seconds 00000100:00100000:3.0:1763343027.496279:0:27833:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27833:1848998010167424:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343027.496304:0:27833:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae242d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343027.498696:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010167680:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343027.498712:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae2442 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.499127:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae243b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.499135:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae243b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.499144:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae243b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.499152:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae243b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.499168:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343027.499488:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3659:x1848998010166016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13433us (13496us total) trans 17179871303 rc 0/0 00000100:00100000:3.0:1763343027.499497:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5863 00010000:00010000:3.0:1763343027.499517:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343027.499524:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae243b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.499531:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343027.499536:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae243b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.499545:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae243b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.499557:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae243b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.499565:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae243b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.499580:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.499581:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.499583:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343027.499645:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad2a00/2, rc 0, transno 17179871303 00000100:00100000:3.0:1763343027.499652:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010166016:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763343027.499678:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae217f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7bcd expref: 23 pid: 8408 timeout: 1321 lvb_type: 0 00000100:00100000:3.0:1763343027.499688:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1848998010167936:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343027.499699:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae2449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.499711:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae2449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.499717:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae2449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.499724:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae2449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.499731:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae2449 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.499744:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343027.499914:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3657:x1848998010165760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12822us (13203us total) trans 21474838602 rc 0/0 00000100:00100000:3.0:1763343027.499921:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5865 00000100:00100000:3.0:1763343027.499934:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993245824 00000100:00100000:3.0:1763343027.499938:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993245824 00000100:00100000:3.0:1763343027.499960:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 5872 00000100:00100000:3.0:1763343027.499965:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:55941:x1848997993245824:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343027.499978:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343027.499992:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae2488 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7cbb expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343027.500011:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x253:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343027.500023:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.500025:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.500031:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae2488 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7cbb expref: 17 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.500043:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae2488 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7cbb expref: 17 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.500055:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:3.0:1763343027.500093:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993245824:12345-192.168.204.21@tcp:101:bash.0 Request processed in 127us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343027.500099:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 5872 00010000:00010000:3.0:1763343027.501826:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343027.501833:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665de00/0x607405d401ae2434 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.501841:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665de00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343027.501844:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665de00/0x607405d401ae2434 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.501852:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665de00/0x607405d401ae2434 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.501866:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665de00/0x607405d401ae2434 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.501872:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665de00/0x607405d401ae2434 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.501893:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.501895:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.501897:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343027.501917:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a353876d880/2, rc 0, transno 21474838603 00000100:00100000:3.0:1763343027.501921:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010166144:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763343027.503053:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad0380/2, rc 0, transno 17179871305 00000100:00100000:3.0:1763343027.503059:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010165888:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343027.519011:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993246464 00000100:00100000:3.0:1763343027.519025:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993246464 00002000:00010000:3.0:1763343027.519072:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/595 (0->18446744073709551615) 00002000:00100000:3.0:1763343027.519077:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3403ad4a80 with x1848997993246464 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343027.519089:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3403ad4a80. 00000100:00100000:3.0:1763343027.519114:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993246592 00000100:00100000:3.0:1763343027.519117:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993246592 00002000:00010000:3.0:1763343027.519129:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/593 (0->18446744073709551615) 00002000:00100000:3.0:1763343027.519131:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3403ad4e00 with x1848997993246592 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343027.519137:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3403ad4e00. 00000100:00100000:3.0:1763343027.519157:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1460 00000100:00100000:3.0:1763343027.519165:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2431:x1848997993246464:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343027.519329:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x253:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343027.519332:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x253:0x0] updating lvb mtime from disk: 1763343027 -> 1763343027 00002000:00010000:3.0:1763343027.519335:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x253:0x0] updating lvb atime from disk: 1763343027 -> 0 00002000:00010000:3.0:1763343027.519337:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x253:0x0] updating lvb ctime from disk: 1763343027 -> 1763343027 00002000:00010000:3.0:1763343027.519339:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x253:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343027.519396:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2431:x1848997993246464:12345-192.168.204.21@tcp:10:bash.0 Request processed in 230us (520us total) trans 17179871306 rc 0/0 00000100:00100000:3.0:1763343027.519404:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1460 00002000:00010000:3.0:1763343027.519408:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/595 (0->18446744073709551615) 00002000:00100000:3.0:1763343027.519410:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3403ad4a80 with x1848997993246464 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343027.519415:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3403ad4a80. 00000100:00100000:3.0:1763343027.519431:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1461 00000100:00100000:3.0:1763343027.519438:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2431:x1848997993246592:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343027.519526:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x251:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343027.519529:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x251:0x0] updating lvb mtime from disk: 0 -> 1763343027 00002000:00010000:3.0:1763343027.519531:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x251:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343027.519534:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x251:0x0] updating lvb ctime from disk: 0 -> 1763343027 00002000:00010000:3.0:1763343027.519536:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x251:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343027.519559:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2431:x1848997993246592:12345-192.168.204.21@tcp:10:bash.0 Request processed in 121us (628us total) trans 21474838605 rc 0/0 00000100:00100000:3.0:1763343027.519565:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1461 00002000:00010000:3.0:1763343027.519568:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/593 (0->18446744073709551615) 00002000:00100000:3.0:1763343027.519571:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3403ad4e00 with x1848997993246592 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343027.519575:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3403ad4e00. 00000100:00100000:3.0:1763343027.523651:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993246848 00000100:00100000:3.0:1763343027.523662:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993246848 00000100:00100000:3.0:1763343027.524263:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2881 00000100:00100000:3.0:1763343027.524275:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+210:55941:x1848997993246848:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:3.0:1763343027.525349:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+211:55941:x1848997993246848:12345-192.168.204.21@tcp:35:bash.0 Request processed in 1070us (1804us total) trans 8589939254 rc 0/0 00000100:00100000:3.0:1763343027.525364:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2881 00010000:00010000:3.0:1763343027.552325:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343027.552332:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae24b2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343027.552339:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405987a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343027.552342:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae24b2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343027.552348:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae24b2 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343027.552358:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a1:0x0].0x0 (ffff9a3538bf7200) 00010000:00010000:3.0:1763343027.552360:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343027.552364:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae24b2 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343027.552369:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae24b2 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343027.552384:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.552386:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.552388:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343027.584768:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8510 00000100:00100000:3.0:1763343027.584778:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+212:56748:x1848997993248128:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343027.584786:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343027.584793:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae251b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7cf3 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.584842:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2522 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584851:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2522 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584858:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2522 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584866:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2529 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584872:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2529 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584877:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2529 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584910:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2522 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584916:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2522 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584921:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2522 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584926:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2522 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584931:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343027.584935:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2522 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584941:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2522 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584953:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:3.0:1763343027.584956:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343027.584959:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2522 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584964:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2522 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584972:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2529 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584977:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2529 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584981:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2529 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584985:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343027.584987:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2529 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584992:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2529 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.584998:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3538bf7c00) 00010000:00010000:3.0:1763343027.585000:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343027.585002:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2529 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.585008:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2529 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343027.585027:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae251b lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7cf3 expref: 213 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.585036:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:3.0:1763343027.585038:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343027.585041:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae251b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7cf3 expref: 213 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.585048:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343027.585082:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+212:56748:x1848997993248128:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 307us (1140us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343027.585089:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8510 00000100:00100000:3.0:1763343027.613280:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.624803:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993249792 00000100:00100000:3.0:1763343027.624813:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993249792 00000100:00100000:3.0:1763343027.624865:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2883 00000100:00100000:3.0:1763343027.624874:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+215:56747:x1848997993249792:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343027.625181:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+216:56747:x1848997993249792:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 307us (894us total) trans 8589939260 rc 0/0 00000100:00100000:3.0:1763343027.625189:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2883 00000100:00100000:3.0:1763343027.638926:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.639024:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.645465:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.645512:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.654094:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.654144:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.664359:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993251968 00000100:00100000:3.0:1763343027.664365:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993251968 00000100:00100000:3.0:1763343027.664405:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8519 00000100:00100000:3.0:1763343027.664411:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:55941:x1848997993251968:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343027.664422:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343027.664443:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae25fb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7d39 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.664487:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae25fb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7d39 expref: 227 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.664502:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae25fb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7d39 expref: 227 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.664520:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a2:0x0].0x0 (ffff9a34039e5200) 00010000:00010000:3.0:1763343027.664523:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343027.664527:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343027.664569:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:55941:x1848997993251968:12345-192.168.204.21@tcp:101:bash.0 Request processed in 157us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343027.664575:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8519 00000100:00100000:3.0:1763343027.680871:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010168576:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343027.680935:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343027.680968:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343027.680973:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010168704:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343027.680991:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343027.681028:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010168576 00000100:00100000:3.0:1763343027.681035:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010168576 00000100:00100000:3.0:1763343027.681079:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010168704 00000100:00100000:3.0:1763343027.681081:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010168704 00000100:00100000:3.0:1763343027.681100:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5877 00000100:00100000:3.0:1763343027.681107:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3659:x1848998010168576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343027.681131:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:594 count 1 00010000:00010000:3.0:1763343027.681156:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2610 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x252:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.681180:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665da00/0x607405d401ae23bd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7c83 expref: 24 pid: 27833 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343027.681189:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.681191:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.681195:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2610 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.681221:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340665da00/0x607405d401ae23bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7c83 expref: 24 pid: 27833 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343027.681239:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340665da00/0x607405d401ae23bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7c83 expref: 24 pid: 27833 timeout: 1321 lvb_type: 1 00000100:00100000:3.0:1763343027.681258:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010169344:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343027.681314:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343027.681332:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5878 00000100:00100000:3.0:1763343027.681340:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3659:x1848998010168704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343027.681351:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:596 count 1 00010000:00010000:3.0:1763343027.681364:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae2617 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.681381:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae23c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7c8a expref: 16 pid: 27833 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343027.681387:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.681389:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.681392:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae2617 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.681407:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae23c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7c8a expref: 16 pid: 27833 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343027.681415:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae23c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7c8a expref: 16 pid: 27833 timeout: 1321 lvb_type: 1 00000100:00100000:3.0:1763343027.681425:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010169472:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343027.681443:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c300 going to sleep for 11 seconds 00000100:00100000:3.0:1763343027.681459:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010169088:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343027.681478:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343027.681491:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343027.681495:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010169216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343027.681509:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343027.681525:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010169088 00000100:00100000:3.0:1763343027.681528:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010169088 00000100:00100000:3.0:1763343027.681544:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010169216 00000100:00100000:3.0:1763343027.681546:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010169216 00000100:00100000:3.0:1763343027.681559:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5879 00000100:00100000:3.0:1763343027.681564:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3659:x1848998010169088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343027.681729:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3659:x1848998010169088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (249us total) trans 21474838606 rc 0/0 00000100:00100000:3.0:1763343027.681740:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5879 00000100:00100000:3.0:1763343027.681756:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5880 00000100:00100000:3.0:1763343027.681761:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3659:x1848998010169216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343027.681803:0:28996:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x254:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343027.681807:0:28996:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x254:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343027.681809:0:28996:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x254:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343027.681812:0:28996:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x254:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343027.681814:0:28996:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x254:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343027.681834:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3659:x1848998010169216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (324us total) trans 21474838607 rc 0/0 00000100:00100000:3.0:1763343027.681840:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5880 00000004:00080000:3.0:1763343027.681873:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f38e00/2, rc 0, transno 21474838607 00000100:00100000:3.0:1763343027.681878:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010169216:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343027.681885:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f38380/2, rc 0, transno 21474838606 00000100:00100000:3.0:1763343027.681888:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010169088:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343027.683188:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5882 00000100:00100000:3.0:1763343027.683201:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3657:x1848998010168832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343027.683353:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3657:x1848998010168832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (1111us total) trans 17179871307 rc 0/0 00000100:00100000:3.0:1763343027.683363:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5882 00000004:00080000:3.0:1763343027.683410:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b1c00/2, rc 0, transno 17179871307 00000100:00100000:3.0:1763343027.683420:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010168832:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343027.683497:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b3480/2, rc 0, transno 17179871308 00000100:00100000:3.0:1763343027.683503:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010168960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343027.687381:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010169344:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343027.687396:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2610 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343027.691763:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993252480 00000100:00100000:3.0:1763343027.691769:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993252480 00010000:00010000:3.0:1763343027.691793:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae23c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7c8a expref: 17 pid: 27833 timeout: 1321 lvb_type: 1 00000100:00100000:3.0:1763343027.691822:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2798 00000100:00100000:3.0:1763343027.691834:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35084c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993252480:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343027.691846:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343027.691852:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae23c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x254:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7c8a expref: 17 pid: 27833 timeout: 1321 lvb_type: 1 00010000:00010000:3.0:1763343027.691869:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae23c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x254:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7c8a expref: 18 pid: 27833 timeout: 1321 lvb_type: 1 00010000:00010000:3.0:1763343027.691893:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae23c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x254:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7c8a expref: 18 pid: 27833 timeout: 1321 lvb_type: 1 00010000:00010000:3.0:1763343027.691914:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.691916:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.691922:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae2617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.691940:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae2617 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x254:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.691971:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343027.692026:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35084c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993252480:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 195us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343027.692035:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2798 00000100:00100000:3.0:1763343027.692073:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993252608 00000100:00100000:3.0:1763343027.692078:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993252608 00000100:00100000:3.0:1763343027.692109:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 5885 00000100:00100000:3.0:1763343027.692122:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:55941:x1848997993252608:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343027.692136:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343027.692152:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93c00/0x607405d401ae264f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7d47 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343027.692174:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x253:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343027.692190:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.692192:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.692201:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93c00/0x607405d401ae264f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7d47 expref: 28 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.692215:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93c00/0x607405d401ae264f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7d47 expref: 28 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.692230:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93c00, rc 0) 00000100:00100000:3.0:1763343027.693269:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:55941:x1848997993252608:12345-192.168.204.21@tcp:101:bash.0 Request processed in 143us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343027.693280:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 5885 00010000:00010000:3.0:1763343027.695819:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343027.696200:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2610 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.696217:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343027.696223:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2610 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.696246:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2610 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.696283:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2610 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.696305:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2610 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.696339:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.696343:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.696349:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343027.712139:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.738021:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.758369:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.783894:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.802322:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993256192 00000100:00100000:3.0:1763343027.802333:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993256192 00000100:00100000:3.0:1763343027.802395:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8531 00000100:00100000:3.0:1763343027.802405:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+216:56753:x1848997993256192:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343027.802430:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343027.802456:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2721 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7d94 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.802568:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2728 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.802583:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae2713 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7d8d expref: 217 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.802591:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2728 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.802663:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae2713 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7d8d expref: 217 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.802677:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae2713 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7d8d expref: 217 pid: 6523 timeout: 1321 lvb_type: 0 00000100:00100000:3.0:1763343027.802692:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010169984:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343027.802775:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343027.807873:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010169984:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343027.807903:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2728 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:3.0:1763343027.820203:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993256576 00000100:00100000:3.0:1763343027.820217:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993256576 00000100:00100000:3.0:1763343027.820286:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8532 00000100:00100000:3.0:1763343027.820297:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+216:56755:x1848997993256576:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343027.820319:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343027.820344:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2736 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7d9b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.820427:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae273d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820442:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae273d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820455:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae273d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820466:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2744 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820474:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2744 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820480:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2744 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820598:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae274b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820606:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae274b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820614:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae274b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820741:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae273d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820748:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae273d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820755:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae273d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820762:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae273d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820767:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343027.820772:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae273d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820779:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae273d lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820791:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616300) 00010000:00010000:3.0:1763343027.820794:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343027.820799:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae273d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820805:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae273d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820818:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2744 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820824:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2744 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820829:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2744 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820836:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343027.820839:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2744 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820845:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2744 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820852:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e5900) 00010000:00010000:3.0:1763343027.820855:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343027.820858:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2744 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820863:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2744 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.820899:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2736 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7d9b expref: 219 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.820915:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae274b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7d9b expref: 218 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.820922:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a3:0x0].0x0 (ffff9a3404616400) 00010000:00010000:3.0:1763343027.820925:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343027.820927:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92c00, rc 0) 00000100:00100000:3.0:1763343027.820980:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+218:56755:x1848997993256576:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 685us (1274us total) trans 8589939278 rc 0/0 00000100:00100000:3.0:1763343027.820988:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8532 00000100:00100000:3.0:1763343027.829101:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993256832 00000100:00100000:3.0:1763343027.829117:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993256832 00000100:00100000:3.0:1763343027.829196:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2891 00000100:00100000:3.0:1763343027.829207:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+218:56753:x1848997993256832:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343027.830251:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+219:56753:x1848997993256832:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1046us (5205us total) trans 8589939279 rc 0/0 00000100:00100000:3.0:1763343027.830259:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2891 00000100:00100000:3.0:1763343027.834095:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993257216 00000100:00100000:3.0:1763343027.834105:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993257216 00000100:00100000:3.0:1763343027.834165:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2892 00000100:00100000:3.0:1763343027.834176:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350922b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+219:56753:x1848997993257216:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343027.834411:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350922b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+220:56753:x1848997993257216:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 235us (614us total) trans 8589939280 rc 0/0 00000100:00100000:3.0:1763343027.834419:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2892 00000100:00100000:3.0:1763343027.844989:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993257856 00000100:00100000:3.0:1763343027.844999:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993257856 00000100:00100000:3.0:1763343027.845069:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8534 00000100:00100000:3.0:1763343027.845080:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+222:55941:x1848997993257856:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343027.845100:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343027.845121:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2775 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7db0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.845157:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae277c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.845172:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae277c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.845182:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae277c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343027.845316:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2775 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7db0 expref: 224 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.845335:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae277c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7db0 expref: 223 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.845344:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a3:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:3.0:1763343027.845348:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343027.845352:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343027.845421:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+223:55941:x1848997993257856:12345-192.168.204.21@tcp:101:bash.0 Request processed in 343us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343027.845429:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8534 00000100:00100000:3.0:1763343027.851241:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993258368 00000100:00100000:3.0:1763343027.851251:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993258368 00000100:00100000:3.0:1763343027.851427:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8536 00000100:00100000:3.0:1763343027.851439:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:55941:x1848997993258368:12345-192.168.204.21@tcp:36:bash.0 00000100:00100000:3.0:1763343027.855823:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.861557:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.863888:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010170496 00000100:00100000:3.0:1763343027.863893:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010170496 00000100:00100000:3.0:1763343027.863922:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010170368 00000100:00100000:3.0:1763343027.863925:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010170368 00000100:00100000:3.0:1763343027.863942:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5889 00000100:00100000:3.0:1763343027.863948:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3657:x1848998010170240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343027.863958:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:598 count 1 00010000:00010000:3.0:1763343027.863969:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92800/0x607405d401ae27f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.863985:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405987600/0x607405d401ae25a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7d16 expref: 17 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343027.863993:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.863996:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.864000:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92800/0x607405d401ae27f3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.864025:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3405987600/0x607405d401ae25a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7d16 expref: 17 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343027.864037:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3405987600/0x607405d401ae25a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7d16 expref: 17 pid: 28994 timeout: 1321 lvb_type: 1 00000100:00100000:3.0:1763343027.864051:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010170752:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343027.864339:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c600 going to sleep for 11 seconds 00000100:00100000:3.0:1763343027.864352:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3508279c00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343027.873783:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340683aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010170624:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343027.873799:0:28648:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6400/0x607405d401ae27fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.874804:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343027.874812:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92800/0x607405d401ae27f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.874821:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343027.874826:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92800/0x607405d401ae27f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.874841:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92800/0x607405d401ae27f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.874856:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92800/0x607405d401ae27f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.874864:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92800/0x607405d401ae27f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.874880:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.874882:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.874883:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343027.878833:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993260288 00000100:00100000:3.0:1763343027.878843:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993260288 00000100:00100000:3.0:1763343027.878894:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 5896 00000100:00100000:3.0:1763343027.878904:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993260288:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343027.878922:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343027.878940:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae280f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7dda expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.878969:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c600/0x607405d401ae2759 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7da2 expref: 18 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343027.878977:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.878979:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343027.878984:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae280f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7dda expref: 18 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.879022:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665c600/0x607405d401ae2759 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7da2 expref: 18 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343027.879033:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c600/0x607405d401ae2759 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7da2 expref: 18 pid: 27835 timeout: 1321 lvb_type: 1 00000100:00100000:3.0:1763343027.879047:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010171648:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343027.879134:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c480 going to sleep for 11 seconds 00000100:00100000:3.0:1763343027.880829:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993259776 00000100:00100000:3.0:1763343027.880835:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993259776 00010000:00010000:3.0:1763343027.880857:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93c00/0x607405d401ae264f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x253:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7d47 expref: 25 pid: 8408 timeout: 1321 lvb_type: 0 00010000:00010000:3.0:1763343027.891964:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c600/0x607405d401ae2759 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7da2 expref: 18 pid: 27835 timeout: 1321 lvb_type: 1 00000100:00100000:3.0:1763343027.891977:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010171648:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343027.892000:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae280f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7dda expref: 17 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343027.892009:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343027.892032:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993260288:12345-192.168.204.21@tcp:101:bash.0 Request processed in 13131us (13293us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343027.892040:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 5896 00000100:00100000:3.0:1763343027.896510:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.914374:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.927149:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.927196:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.931046:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.932070:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.937291:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343027.939520:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343027.939527:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae2863 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x40010480000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.940330:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343027.940335:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae2863 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.940342:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae2863 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.940353:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a3:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:3.0:1763343027.940356:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343027.940360:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae2863 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.940365:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae2863 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343027.940380:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.940382:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343027.940384:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343027.951497:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.956849:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.963898:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.970358:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343027.982463:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.003540:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.008520:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.011127:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.014431:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.016385:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.020580:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.025909:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993265152 00000100:00100000:3.0:1763343028.025923:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993265152 00000100:00100000:3.0:1763343028.025989:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2901 00000100:00100000:3.0:1763343028.026000:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+220:56760:x1848997993265152:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343028.026284:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+221:56760:x1848997993265152:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 284us (512us total) trans 8589939299 rc 0/0 00000100:00100000:3.0:1763343028.026291:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2901 00000100:00100000:3.0:1763343028.031924:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.040452:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.045079:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.048336:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.048382:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.057554:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010173184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.057592:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.057616:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343028.057648:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010173056:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.057671:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.057696:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010172928:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.057719:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.057733:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343028.057738:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010172800:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.057756:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343028.059511:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a353876c000/2, rc 0, transno 21474838617 00000100:00100000:3.0:1763343028.059518:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010173056:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343028.059527:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a353876c700/2, rc 0, transno 21474838616 00000100:00100000:3.0:1763343028.059531:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010173184:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343028.059551:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a353876f800/2, rc 0, transno 21474838618 00000100:00100000:3.0:1763343028.059554:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010172928:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.063440:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.063534:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.063554:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.063582:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993267200 00000100:00100000:3.0:1763343028.063590:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993267200 00010000:00010000:3.0:1763343028.063676:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae280f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7dda expref: 17 pid: 8408 timeout: 1321 lvb_type: 0 00000100:00100000:3.0:1763343028.063709:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993267328 00000100:00100000:3.0:1763343028.063713:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993267328 00010000:00010000:3.0:1763343028.063727:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6400/0x607405d401ae2816 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7de1 expref: 26 pid: 8408 timeout: 1321 lvb_type: 0 00000100:00100000:3.0:1763343028.063745:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2810 00000100:00100000:3.0:1763343028.063752:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993267200:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343028.063766:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343028.063771:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae280f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7dda expref: 17 pid: 8408 timeout: 1321 lvb_type: 0 00010000:00010000:3.0:1763343028.063783:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae280f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7dda expref: 17 pid: 8408 timeout: 1321 lvb_type: 0 00010000:00010000:3.0:1763343028.063812:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.063814:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.063819:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d170600/0x607405d401ae29a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.063828:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d170600/0x607405d401ae29a5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.063849:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343028.063900:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993267200:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 146us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.063907:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2810 00000100:00100000:3.0:1763343028.063924:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2811 00000100:00100000:3.0:1763343028.063930:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2431:x1848997993267328:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343028.063937:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343028.063941:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6400/0x607405d401ae2816 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7de1 expref: 26 pid: 8408 timeout: 1321 lvb_type: 0 00010000:00010000:3.0:1763343028.063951:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6400/0x607405d401ae2816 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7de1 expref: 26 pid: 8408 timeout: 1321 lvb_type: 0 00010000:00010000:3.0:1763343028.063963:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.063965:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.063969:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665de00/0x607405d401ae29b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.063975:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665de00/0x607405d401ae29b3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.063986:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343028.064006:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2431:x1848997993267328:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 76us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.064012:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2811 00000004:00080000:3.0:1763343028.067365:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062f1500/2, rc 0, transno 21474838619 00000100:00100000:3.0:1763343028.067374:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010172800:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763343028.067389:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d3b80/2, rc 0, transno 17179871320 00000100:00100000:3.0:1763343028.067394:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010172160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343028.067459:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.075793:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.099434:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343028.115846:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae29cf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e66 expref: 218 pid: 10042 timeout: 1321 lvb_type: 0 00000100:00100000:3.0:1763343028.115864:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d130e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010173696:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343028.115888:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae2a07 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1a4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.115898:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae2a07 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1a4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.115903:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae2a07 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1a4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343028.115928:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1a4:0x0]: returning size 5 00010000:00010000:3.0:1763343028.116093:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7e00/0x607405d401ae2a00 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e82 expref: 219 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.116111:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae2a07 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1a4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e82 expref: 218 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.116119:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a4:0x0].0x0 (ffff9a3538bf7d00) 00010000:00010000:3.0:1763343028.116122:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1763343028.116126:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6400, rc 0) 00000100:00100000:3.0:1763343028.116172:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+218:56761:x1848997993269120:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6265us (6437us total) trans 8589939311 rc 0/0 00000100:00100000:3.0:1763343028.116180:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8562 00000100:00100000:3.0:1763343028.120235:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993269632 00000100:00100000:3.0:1763343028.120247:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993269632 00000100:00100000:3.0:1763343028.120309:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8563 00000100:00100000:3.0:1763343028.120318:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+218:56761:x1848997993269632:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343028.120342:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.120363:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2a15 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7e89 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.120462:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2a1c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.120478:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae2a07 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1a4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e82 expref: 219 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.120486:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2a1c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1a4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.120522:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae2a07 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1a4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e82 expref: 219 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.120535:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae2a07 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1a4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e82 expref: 219 pid: 6525 timeout: 1321 lvb_type: 0 00000100:00100000:3.0:1763343028.120548:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010173824:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343028.120670:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343028.126551:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010173824:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343028.126579:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2a1c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.128219:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2a1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.128232:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2a1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343028.128296:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1a4:0x0]: returning size 5 00000004:00200000:3.0:1763343028.128301:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343028.128324:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2a1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.128362:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2a15 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e89 expref: 217 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.128390:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2a1c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e89 expref: 216 pid: 6525 timeout: 1321 lvb_type: 0 00010000:00010000:3.0:1763343028.128404:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2a1c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e89 expref: 216 pid: 6525 timeout: 1321 lvb_type: 0 00010000:00010000:3.0:1763343028.128412:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93c00, rc 0) 00000100:00100000:3.0:1763343028.128471:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+216:56761:x1848997993269632:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8149us (8475us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.128480:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8563 00000100:00100000:3.0:1763343028.134566:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993270400 00000100:00100000:3.0:1763343028.134577:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993270400 00000100:00100000:3.0:1763343028.134735:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8565 00000100:00100000:3.0:1763343028.134810:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+217:56761:x1848997993270400:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343028.134828:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.134849:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2a38 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7e90 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.134947:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2a38 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e90 expref: 217 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.134961:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2a38 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e90 expref: 217 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.134979:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a4:0x0].0x0 (ffff9a3538bf7d00) 00010000:00010000:3.0:1763343028.134983:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343028.134986:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343028.135048:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+217:56761:x1848997993270400:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 304us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.135068:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8565 00000100:00100000:3.0:1763343028.151648:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.158890:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993270912 00000100:00100000:3.0:1763343028.158902:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993270912 00002000:00100000:3.0:1763343028.158956:0:28426:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x257:0x0] (0->4) req@ffff9a340d133b80 x1848997993270912/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:524/0 lens 496/0 e 0 to 0 dl 1763343039 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343028.158967:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d133b80 with x1848997993270912 ext(0->4) 00010000:00010000:3.0:1763343028.158976:0:28426:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6000/0x607405d401ae29dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e6d expref: 27 pid: 28994 timeout: 1321 lvb_type: 0 00010000:00010000:3.0:1763343028.158991:0:28426:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6000/0x607405d401ae29dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e6d expref: 27 pid: 28994 timeout: 1321 lvb_type: 0 00002000:00010000:3.0:1763343028.158998:0:28426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a340d133b80 00000100:00100000:3.0:1763343028.159117:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 93 00000100:00100000:3.0:1763343028.159129:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2429:x1848997993270912:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:3.0:1763343028.160878:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2429:x1848997993270912:12345-192.168.204.21@tcp:4:bash.0 Request processed in 1749us (3212us total) trans 21474838621 rc 0/0 00000100:00100000:3.0:1763343028.160888:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 93 00002000:00100000:3.0:1763343028.160897:0:28426:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x257:0x0] (0->4) req@ffff9a340d133b80 x1848997993270912/t21474838621(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:524/0 lens 496/448 e 0 to 0 dl 1763343039 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343028.160906:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d133b80 with x1848997993270912 ext(0->4) 00010000:00010000:3.0:1763343028.160915:0:28426:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6000/0x607405d401ae29dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e6d expref: 29 pid: 28994 timeout: 1321 lvb_type: 0 00010000:00010000:3.0:1763343028.160933:0:28426:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6000/0x607405d401ae29dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e6d expref: 29 pid: 28994 timeout: 1321 lvb_type: 0 00002000:00010000:3.0:1763343028.160940:0:28426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a340d133b80 00000100:00100000:3.0:1763343028.167747:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.172276:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.172303:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993271552 00000100:00100000:3.0:1763343028.172311:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993271552 00000100:00100000:3.0:1763343028.172349:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8569 00000100:00100000:3.0:1763343028.174564:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+220:56763:x1848997993271552:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343028.174592:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.174643:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2a77 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7ea5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.174726:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2a7e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174739:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2a7e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174750:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2a7e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174760:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2a85 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174766:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2a85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174771:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2a85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174805:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2a7e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174812:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2a7e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174817:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2a7e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174824:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2a7e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174830:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.174834:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2a7e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174842:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2a7e lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174857:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616300) 00010000:00010000:3.0:1763343028.174860:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.174864:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2a7e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174871:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2a7e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174883:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2a85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174889:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2a85 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174895:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2a85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174900:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.174903:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2a85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174909:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2a85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174915:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e5600) 00010000:00010000:3.0:1763343028.174918:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.174920:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2a85 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174925:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2a85 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.174951:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2a77 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7ea5 expref: 221 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.174961:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616300) 00010000:00010000:3.0:1763343028.174964:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.174967:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2a77 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7ea5 expref: 221 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.174979:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92c00, rc 0) 00000100:00100000:3.0:1763343028.179605:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010174208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343028.179692:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.179738:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343028.179748:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010174080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343028.179806:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.200386:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.253777:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993273984 00000100:00100000:3.0:1763343028.253790:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993273984 00000100:00100000:3.0:1763343028.253858:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8578 00000100:00100000:3.0:1763343028.253871:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+217:55941:x1848997993273984:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:3.0:1763343028.253938:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343028.253977:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae2b18 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7edd expref: 217 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.254006:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a5:0x0].0x0 (ffff9a3538bf7c00) 00010000:00010000:3.0:1763343028.254013:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343028.254284:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2b34 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.254299:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2b34 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.254308:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2b34 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000001:00080000:3.0:1763343028.254359:0:10042:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939321 00000004:00010000:3.0:1763343028.254380:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eedb7681 reply state 00000000564c7217 transno 8589939322 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2b34 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.254392:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2b34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.254399:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a5:0x0].0x0 (ffff9a3538bf7c00) 00010000:00010000:3.0:1763343028.254402:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343028.254405:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343028.254520:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+219:55941:x1848997993273984:12345-192.168.204.21@tcp:36:bash.0 Request processed in 649us (1621us total) trans 8589939322 rc 0/0 00000100:00100000:3.0:1763343028.254532:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8578 00000020:00080000:3.0:1763343028.254540:0:10042:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343028.262552:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993274368 00000100:00100000:3.0:1763343028.262563:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993274368 00000100:00100000:3.0:1763343028.262656:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8580 00000100:00100000:3.0:1763343028.262666:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+220:55941:x1848997993274368:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343028.262688:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.262691:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343028.262725:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae2b3b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7eeb expref: 220 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.262751:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a5:0x0].0x0 (ffff9a3538bf7c00) 00010000:00010000:3.0:1763343028.262757:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343028.262776:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2b42 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7ef2 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.262832:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2b49 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.262845:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2b49 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1a5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.262854:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2b49 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1a5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000040:00080000:3.0:1763343028.263087:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1222, 88 off104360 00000004:00080000:3.0:1763343028.263095:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1221930473843ns, next at 1221774509059ns, rc = 0 00000040:00080000:3.0:1763343028.263124:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1221, 88 off104360 00000004:00080000:3.0:1763343028.263129:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1221930508213ns, next at 1221774542872ns, rc = 0 00000040:00080000:3.0:1763343028.263159:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1222, 88 off104448 00000004:00080000:3.0:1763343028.263163:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1221930542652ns, next at 1221774542872ns, rc = 0 00000040:00080000:3.0:1763343028.263174:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1223, 88 off104448 00000004:00080000:3.0:1763343028.263178:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1221930557545ns, next at 1221774509059ns, rc = 0 00000100:00100000:3.0:1763343028.269735:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010175104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.269781:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.269814:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343028.269822:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010174976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.269847:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.269878:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010175104 00000100:00100000:3.0:1763343028.269884:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010175104 00000100:00100000:3.0:1763343028.269918:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010174976 00000100:00100000:3.0:1763343028.269921:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010174976 00000100:00100000:3.0:1763343028.269944:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5917 00000100:00100000:3.0:1763343028.269954:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:3660:x1848998010175104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.270080:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3660:x1848998010175104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 127us (298us total) trans 21474838624 rc 0/0 00000100:00100000:3.0:1763343028.270087:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5917 00000100:00100000:3.0:1763343028.270099:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5918 00000100:00100000:3.0:1763343028.270105:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:3660:x1848998010174976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.270188:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3660:x1848998010174976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (340us total) trans 21474838625 rc 0/0 00000100:00100000:3.0:1763343028.270195:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5918 00000004:00080000:3.0:1763343028.270244:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a05500/2, rc 0, transno 21474838625 00000100:00100000:3.0:1763343028.270250:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010174976:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343028.270261:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a05c00/2, rc 0, transno 21474838624 00000100:00100000:3.0:1763343028.272074:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010175104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.283292:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993274880 00000100:00100000:3.0:1763343028.283298:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993274880 00000100:00100000:3.0:1763343028.283706:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 5922 00000100:00100000:3.0:1763343028.283715:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:55941:x1848997993274752:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343028.283724:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.283744:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2b57 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7f00 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343028.283766:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x259:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343028.283782:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.283784:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.283792:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2b57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f00 expref: 29 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.283808:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2b57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f00 expref: 29 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.283821:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92a00, rc 0) 00000100:00100000:3.0:1763343028.283841:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:55941:x1848997993274752:12345-192.168.204.21@tcp:101:bash.0 Request processed in 128us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.283847:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 5922 00000100:00100000:3.0:1763343028.288174:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993275008 00000100:00100000:3.0:1763343028.288185:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993275008 00002000:00010000:3.0:1763343028.288224:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/603 (0->18446744073709551615) 00002000:00100000:3.0:1763343028.288229:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d131c00 with x1848997993275008 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343028.288286:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340d131c00. 00000100:00100000:3.0:1763343028.288324:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1468 00000100:00100000:3.0:1763343028.288333:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993275008:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343028.288886:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x25b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343028.288888:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x25b:0x0] updating lvb mtime from disk: 0 -> 1763343028 00002000:00010000:3.0:1763343028.288891:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x25b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343028.288892:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x25b:0x0] updating lvb ctime from disk: 0 -> 1763343028 00002000:00010000:3.0:1763343028.288894:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x25b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343028.288914:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d131c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993275008:12345-192.168.204.21@tcp:10:bash.0 Request processed in 583us (1388us total) trans 17179871326 rc 0/0 00000100:00100000:3.0:1763343028.288920:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1468 00002000:00010000:3.0:1763343028.288923:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/603 (0->18446744073709551615) 00002000:00100000:3.0:1763343028.288925:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d131c00 with x1848997993275008 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343028.288929:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340d131c00. 00000100:00100000:3.0:1763343028.302219:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993275904 00000100:00100000:3.0:1763343028.302228:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993275904 00000100:00100000:3.0:1763343028.302296:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8582 00000100:00100000:3.0:1763343028.302306:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+213:56764:x1848997993275904:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:3.0:1763343028.302327:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.302349:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2b7a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7f0e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.302414:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2b81 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302426:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2b81 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302439:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2b81 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302450:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2b88 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302456:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2b88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302463:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2b88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302533:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae2b8f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302542:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae2b8f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302548:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae2b8f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343028.302582:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1a5:0x0]: returning size 5 00000004:00200000:3.0:1763343028.302586:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343028.302604:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae2b8f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302615:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae2b8f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302660:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2b81 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302667:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2b81 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302672:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2b81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302683:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2b81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302689:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.302693:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2b81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302700:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2b81 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302710:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bd400) 00010000:00010000:3.0:1763343028.302714:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.302718:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2b81 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302725:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2b81 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302736:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2b88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302742:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2b88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302746:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2b88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302750:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.302753:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2b88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302758:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2b88 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302770:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bd000) 00010000:00010000:3.0:1763343028.302772:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.302775:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2b88 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302781:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2b88 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.302808:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2b7a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f0e expref: 215 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.302823:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae2b8f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f0e expref: 214 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.302830:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a5:0x0].0x0 (ffff9a3538bf7c00) 00010000:00010000:3.0:1763343028.302833:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343028.302836:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:3.0:1763343028.302891:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+214:56764:x1848997993275904:12345-192.168.204.21@tcp:101:rm.0 Request processed in 587us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.302899:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8582 00000100:00100000:3.0:1763343028.324955:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.325046:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.333303:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.345079:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1473 00000100:00100000:3.0:1763343028.345090:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993277312:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:3.0:1763343028.345205:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x258:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343028.345209:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x258:0x0] updating lvb mtime from disk: 0 -> 1763343028 00002000:00010000:3.0:1763343028.345211:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x258:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343028.345213:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x258:0x0] updating lvb ctime from disk: 0 -> 1763343028 00002000:00010000:3.0:1763343028.345216:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x258:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343028.345275:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2430:x1848997993277312:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 187us (974us total) trans 21474838627 rc 0/0 00000100:00100000:3.0:1763343028.345282:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1473 00002000:00010000:3.0:1763343028.345286:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/600 (0->18446744073709551615) 00002000:00100000:3.0:1763343028.345288:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406649500 with x1848997993277312 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343028.345293:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406649500. 00000100:00100000:3.0:1763343028.348851:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993277440 00000100:00100000:3.0:1763343028.348862:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993277440 00000100:00100000:3.0:1763343028.348922:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8588 00000100:00100000:3.0:1763343028.348932:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+215:56765:x1848997993277440:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343028.348956:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.348978:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae2bff lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7f38 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.349060:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2c06 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349075:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2c06 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349086:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2c06 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349097:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2c0d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349104:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2c0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349111:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2c0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349148:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2c06 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349154:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2c06 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349160:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2c06 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349167:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2c06 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349173:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.349177:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2c06 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349184:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2c06 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349197:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:3.0:1763343028.349200:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.349205:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2c06 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349211:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2c06 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349222:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2c0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349228:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2c0d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349234:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2c0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349238:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.349241:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2c0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349246:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2c0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349252:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e5300) 00010000:00010000:3.0:1763343028.349255:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.349258:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2c0d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349263:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2c0d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.349288:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae2bff lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f38 expref: 216 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.349297:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:3.0:1763343028.349300:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.349303:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae2bff lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f38 expref: 216 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.349312:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92e00, rc 0) 00000100:00100000:3.0:1763343028.349362:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+215:56765:x1848997993277440:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 432us (788us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343028.349368:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8588 00000100:00100000:3.0:1763343028.352336:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993277952 00000100:00100000:3.0:1763343028.352346:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993277952 00000100:00100000:3.0:1763343028.352395:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8589 00000100:00100000:3.0:1763343028.352403:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+215:56761:x1848997993277952:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:3.0:1763343028.352484:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2c14 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.352501:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2c14 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.352511:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2c14 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00010000:3.0:1763343028.352617:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000632f2f49 reply state 000000000a5f955b transno 8589939327 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2c14 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.352746:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae2c14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1a4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.352754:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a4:0x0].0x0 (ffff9a3538bf7d00) 00010000:00010000:3.0:1763343028.352757:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343028.352760:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343028.352854:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+217:56761:x1848997993277952:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 451us (609us total) trans 8589939327 rc 0/0 00000100:00100000:3.0:1763343028.352861:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8589 00000100:00100000:3.0:1763343028.356940:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993277696 00000100:00100000:3.0:1763343028.356956:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993277696 00000100:00100000:3.0:1763343028.357037:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8590 00000100:00100000:3.0:1763343028.357058:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+217:56765:x1848997993277696:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343028.357086:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.357090:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343028.357120:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170a00/0x607405d401ae2bf8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f31 expref: 217 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.357146:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:3.0:1763343028.357157:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343028.357176:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae2c1b lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7f3f expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.357277:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c22 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.357289:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c22 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.357298:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c22 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.357308:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae2c29 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.357314:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae2c29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.357319:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae2c29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.358014:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae2c30 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.358029:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae2c30 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.358039:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae2c30 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343028.358066:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1a7:0x0]: returning size 0 00010000:00010000:3.0:1763343028.358094:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c22 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.358101:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c22 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.358107:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c22 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.358113:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c22 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.358119:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.358124:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c22 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.358130:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c22 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.358140:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bd400) 00010000:00010000:3.0:1763343028.358143:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.358147:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c22 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.358153:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c22 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:3.0:1763343028.358163:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a0196c4d reply state 000000000ff1a1aa transno 8589939328 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae2c29 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.358173:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae2c29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.358184:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e5300) 00010000:00010000:3.0:1763343028.358197:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343028.358200:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343028.358230:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae2c1b lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f3f expref: 219 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.358248:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae2c30 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f3f expref: 218 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.358255:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a7:0x0].0x0 (ffff9a34037bd000) 00010000:00010000:3.0:1763343028.358258:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343028.358260:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92e00, rc 0) 00000100:00100000:3.0:1763343028.358474:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+219:56765:x1848997993277696:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1427us (5030us total) trans 8589939328 rc 0/0 00000100:00100000:3.0:1763343028.358485:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8590 00000100:00100000:3.0:1763343028.363547:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993278464 00000100:00100000:3.0:1763343028.363556:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993278464 00000100:00100000:3.0:1763343028.363608:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8591 00000100:00100000:3.0:1763343028.363617:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+219:56765:x1848997993278464:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343028.363682:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.363702:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae2c45 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7f4d expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.363823:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2c4c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.363838:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae2c30 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f3f expref: 220 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.363852:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2c4c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.363885:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae2c30 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f3f expref: 220 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.363896:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae2c30 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f3f expref: 220 pid: 10042 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343028.363910:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010175360:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343028.363992:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343028.370910:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010175360:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343028.370939:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae2c4c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:3.0:1763343028.383239:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993278976 00000100:00100000:3.0:1763343028.383250:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993278976 00000100:00100000:3.0:1763343028.383306:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993279232 00000100:00100000:3.0:1763343028.383309:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993279232 00000100:00100000:3.0:1763343028.383322:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2910 00000100:00100000:3.0:1763343028.383329:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+220:56765:x1848997993278976:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343028.383609:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+221:56765:x1848997993278976:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 278us (528us total) trans 8589939330 rc 0/0 00000100:00100000:3.0:1763343028.383617:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2910 00000100:00100000:3.0:1763343028.383701:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2911 00000100:00100000:3.0:1763343028.383707:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+220:56761:x1848997993279232:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:3.0:1763343028.383735:0:14879:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1a4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170c00/0x607405d401ae2a46 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1a4:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e97 expref: 220 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.383779:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c5a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343028.383790:0:14879:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae2a9a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7eb3 expref: 220 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.383800:0:14879:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c5a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343028.383828:0:14879:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae2a9a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7eb3 expref: 220 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.383841:0:14879:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae2a9a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7eb3 expref: 220 pid: 6525 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343028.383855:0:14879:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a06a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010175616:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343028.383909:0:14879:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343028.387129:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.388898:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.388930:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993279616 00000100:00100000:3.0:1763343028.388936:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993279616 00010000:00010000:3.0:1763343028.388966:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae2a9a lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7eb3 expref: 222 pid: 6525 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343028.388993:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2820 00000100:00100000:3.0:1763343028.389001:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+222:2429:x1848997993279616:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343028.389014:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343028.389019:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae2a9a lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7eb3 expref: 222 pid: 6525 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.389030:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae2a9a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7eb3 expref: 222 pid: 6525 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.389063:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a4:0x0].0x0 (ffff9a3538bf7d00) 00010000:00010000:3.0:1763343028.389069:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c5a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343028.389079:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c5a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343028.389086:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae2c5a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1a4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343028.389104:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343028.389132:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+222:2429:x1848997993279616:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 132us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.389138:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2820 00000100:00100000:3.0:1763343028.393290:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.396532:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010176128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343028.398934:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5929 00000100:00100000:3.0:1763343028.398944:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3657:x1848998010175872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343028.398957:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:604 count 1 00002000:00010000:3.0:1763343028.398978:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x25c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343028.398983:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae2c92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.398991:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.398992:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.398996:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae2c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.399009:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae2c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.399018:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae2c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.399026:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae2c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.399043:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343028.401000:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010175872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2051us (4182us total) trans 17179871329 rc 0/0 00000100:00100000:3.0:1763343028.401012:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5929 00010000:00010000:3.0:1763343028.401074:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343028.401082:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae2c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.401092:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343028.401097:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae2c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.401107:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae2c92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.401130:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae2c92 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.401137:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae2c92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.401155:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343028.401158:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665d400/0x607405d401ae2c99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.401164:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343028.401167:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665d400/0x607405d401ae2c99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.401173:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665d400/0x607405d401ae2c99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.401183:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665d400/0x607405d401ae2c99 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.401189:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d400/0x607405d401ae2c99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.401202:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343028.401203:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343028.401205:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343028.404197:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993280000 00000100:00100000:3.0:1763343028.404205:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993280000 00000100:00100000:3.0:1763343028.404241:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8593 00000100:00100000:3.0:1763343028.404249:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+209:55941:x1848997993280000:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343028.404267:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.404287:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2ca0 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7f5b expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.404319:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2ca7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.404333:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.404344:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.404456:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2ca0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f5b expref: 211 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.404472:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f5b expref: 210 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.404480:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a7:0x0].0x0 (ffff9a34010be800) 00010000:00010000:3.0:1763343028.404483:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343028.404487:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92c00, rc 0) 00000100:00100000:3.0:1763343028.405098:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+210:55941:x1848997993280000:12345-192.168.204.21@tcp:101:bash.0 Request processed in 846us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.405108:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8593 00000100:00100000:3.0:1763343028.408183:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993280256 00000100:00100000:3.0:1763343028.408189:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993280256 00010000:00010000:3.0:1763343028.408216:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2b57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f00 expref: 33 pid: 8408 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343028.408249:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2821 00000100:00100000:3.0:1763343028.408258:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+33:2430:x1848997993280256:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343028.408270:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343028.408276:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2b57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f00 expref: 33 pid: 8408 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.408288:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2b57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f00 expref: 33 pid: 8408 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.408312:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2b57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f00 expref: 33 pid: 8408 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.408333:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.408336:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.408341:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a35379c0c00/0x607405d401ae2c8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.408353:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a35379c0c00/0x607405d401ae2c8b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.408381:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343028.409317:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2430:x1848997993280256:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1057us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.409326:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2821 00000100:00100000:3.0:1763343028.416083:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993281024 00000100:00100000:3.0:1763343028.416090:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993281024 00000100:00100000:3.0:1763343028.416134:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8596 00000100:00100000:3.0:1763343028.416142:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+214:55941:x1848997993281024:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343028.416156:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.416169:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2cc3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac7f69 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.416209:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2cc3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f69 expref: 215 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.416222:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2cc3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f69 expref: 215 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.416238:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a7:0x0].0x0 (ffff9a34010be800) 00010000:00010000:3.0:1763343028.416240:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343028.416244:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92800, rc 0) 00000100:00100000:3.0:1763343028.416268:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+215:55941:x1848997993281024:12345-192.168.204.21@tcp:101:bash.0 Request processed in 127us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.416275:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8596 00000100:00100000:3.0:1763343028.421468:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343028.422911:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ced lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.422922:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ced lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.422931:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ced lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343028.422941:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1a7:0x0]: returning size 2 00010000:00010000:3.0:1763343028.423001:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ced lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423008:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ced lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423014:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ced lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423019:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.423023:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ced lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423030:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ced lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423041:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a7:0x0].0x0 (ffff9a34010be800) 00010000:00010000:3.0:1763343028.423054:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1763343028.423060:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ced lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423066:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ced lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423083:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c600/0x607405d401ae2cdf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423089:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c600/0x607405d401ae2cdf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423094:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c600/0x607405d401ae2cdf lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423100:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c600/0x607405d401ae2cdf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423109:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.423112:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c600/0x607405d401ae2cdf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423118:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c600/0x607405d401ae2cdf lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423125:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e5400) 00010000:00010000:3.0:1763343028.423127:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.423130:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c600/0x607405d401ae2cdf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423134:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c600/0x607405d401ae2cdf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423142:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae2ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423146:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae2ce6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423151:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae2ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423157:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.423159:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae2ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423164:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae2ce6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423169:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e5800) 00010000:00010000:3.0:1763343028.423172:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.423174:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae2ce6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423179:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae2ce6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.423220:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae2cd8 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f70 expref: 219 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.423230:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e5400) 00010000:00010000:3.0:1763343028.423233:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343028.423236:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae2cd8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f70 expref: 219 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.423248:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c400, rc 0) 00000100:00100000:3.0:1763343028.423335:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+218:56761:x1848997993281280:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1177us (1868us total) trans 8589939338 rc 301/301 00000100:00100000:3.0:1763343028.423342:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8598 00000100:00100000:3.0:1763343028.428451:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.429467:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5938 00000100:00100000:3.0:1763343028.429475:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3659:x1848998010177408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343028.429583:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3659:x1848998010177408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (619us total) trans 17179871333 rc 0/0 00000100:00100000:3.0:1763343028.429589:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5938 00000100:00100000:3.0:1763343028.429706:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010177920:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.429731:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.429750:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343028.429754:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010177792:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.429774:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.429796:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010177920 00000100:00100000:3.0:1763343028.429800:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010177920 00000100:00100000:3.0:1763343028.429821:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010177792 00000100:00100000:3.0:1763343028.429823:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010177792 00000100:00100000:3.0:1763343028.429834:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5939 00000100:00100000:3.0:1763343028.429839:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+65:3658:x1848998010177920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343028.429858:0:27833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:600 count 1 00010000:00010000:3.0:1763343028.429871:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae2d09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.429883:0:27833:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae2bea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f2a expref: 31 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.429889:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343028.429891:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343028.429893:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae2d09 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.429912:0:27833:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae2bea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f2a expref: 31 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.429921:0:27833:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae2bea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f2a expref: 31 pid: 8408 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343028.429931:0:27833:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27833:1848998010178304:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343028.429962:0:27833:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c240 going to sleep for 11 seconds 00000100:00100000:3.0:1763343028.429977:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5941 00000100:00100000:3.0:1763343028.429983:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+66:3658:x1848998010177792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343028.429995:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:599 count 1 00010000:00010000:3.0:1763343028.430004:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae2d10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.430015:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae2c3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f46 expref: 31 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.430023:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343028.430024:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343028.430027:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae2d10 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.430043:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae2c3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f46 expref: 31 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.430064:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae2c3e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f46 expref: 31 pid: 28995 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343028.430074:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406839180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1848998010178432:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343028.430096:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343028.436743:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.436884:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.436915:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.436933:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993282048 00000100:00100000:3.0:1763343028.436937:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993282048 00010000:00010000:3.0:1763343028.436957:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae2bea lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x258:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f2a expref: 32 pid: 8408 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343028.437170:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2824 00000100:00100000:3.0:1763343028.437178:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993281920:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343028.437187:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343028.437191:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae29e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e74 expref: 14 pid: 28994 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.437200:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae29e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e74 expref: 14 pid: 28994 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.437212:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae29e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7e74 expref: 14 pid: 28994 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.437221:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.437223:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.437225:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae2d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.437232:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae2d02 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.437248:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343028.437604:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993281920:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 87us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.437611:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2824 00010000:00010000:3.0:1763343028.437659:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae2d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.437672:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae2d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.437680:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae2d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.437686:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae2d02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.437699:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343028.437793:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3658:x1848998010177024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8750us (8904us total) trans 17179871336 rc 0/0 00000100:00100000:3.0:1763343028.437800:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5936 00010000:00010000:3.0:1763343028.437816:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343028.437859:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406839180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1848998010178432:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343028.437872:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae2d10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343028.437926:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.437941:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993282304 00000100:00100000:3.0:1763343028.437945:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993282304 00010000:00010000:3.0:1763343028.437962:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae2c3e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f46 expref: 31 pid: 28995 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343028.437981:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2826 00000100:00100000:3.0:1763343028.437987:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350921c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993282304:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343028.438183:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343028.438188:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae2c3e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f46 expref: 31 pid: 28995 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.438198:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae2c3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f46 expref: 31 pid: 28995 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.438209:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae2c3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f46 expref: 31 pid: 28995 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.438219:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.438220:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.438223:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae2d10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.438231:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae2d10 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.438255:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343028.438284:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350921c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2430:x1848997993282304:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 297us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.438291:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2826 00000100:00100000:3.0:1763343028.438357:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.438421:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000004:00080000:3.0:1763343028.438615:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a05f80/2, rc 0, transno 21474838636 00000100:00100000:3.0:1763343028.438641:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010177792:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.441259:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.441830:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.446283:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.446348:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.471858:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8602 00000100:00100000:3.0:1763343028.471872:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+215:56766:x1848997993284480:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:3.0:1763343028.471923:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763343028.471948:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae2cd1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f77 expref: 216 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.471967:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae2d1e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f7e expref: 215 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.471980:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2ca7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f5b expref: 214 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.471991:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a7:0x0].0x0 (ffff9a34010be800) 00010000:00010000:3.0:1763343028.471999:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343028.472018:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2d6b lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.472034:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2d6b lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.472055:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2d6b lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.472069:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2d79 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.472075:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2d79 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.472082:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2d79 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.472169:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2d80 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.472181:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2d80 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1a7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.472190:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae2d80 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1a7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:3.0:1763343028.478483:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.490509:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.496927:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2918 00000100:00100000:3.0:1763343028.496938:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+216:56761:x1848997993285120:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:3.0:1763343028.497231:0:14879:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1a7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763343028.497302:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1231, 64 off105120 00000040:00080000:3.0:1763343028.497327:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1232, 64 off105120 00000040:00080000:3.0:1763343028.497337:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1233, 64 off105184 00000040:00080000:3.0:1763343028.497346:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1232, 64 off105184 00010000:00010000:3.0:1763343028.497405:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2d95 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1a7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343028.497422:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2d95 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343028.497433:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2d95 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343028.497440:0:14879:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2d95 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1a7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343028.497447:0:14879:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2d95 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1a7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343028.497453:0:14879:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae2d95 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1a7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343028.497481:0:14879:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343028.497706:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+217:56761:x1848997993285120:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 767us (2294us total) trans 8589939345 rc 0/0 00000100:00100000:3.0:1763343028.497714:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2918 00000100:00100000:3.0:1763343028.499905:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.522231:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.537362:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993285888 00000100:00100000:3.0:1763343028.537374:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993285888 00000100:00100000:3.0:1763343028.546688:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.557123:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.574871:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993287424 00000100:00100000:3.0:1763343028.574882:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993287424 00000100:00100000:3.0:1763343028.574929:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2920 00000100:00100000:3.0:1763343028.574937:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+223:56767:x1848997993287424:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343028.575161:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:56767:x1848997993287424:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 224us (1001us total) trans 8589939350 rc 0/0 00000100:00100000:3.0:1763343028.575169:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2920 00000100:00100000:3.0:1763343028.595435:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993288448 00000100:00100000:3.0:1763343028.595446:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993288448 00000100:00100000:3.0:1763343028.595499:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8615 00000100:00100000:3.0:1763343028.595509:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56769:x1848997993288448:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343028.595535:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.595556:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae2e98 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8003 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343028.606492:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993288960 00000100:00100000:3.0:1763343028.606502:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993288960 00010000:00010000:3.0:1763343028.606540:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae2e8a lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1a9:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7ffc expref: 232 pid: 6525 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343028.606616:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2829 00000100:00100000:3.0:1763343028.606647:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:2430:x1848997993288960:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343028.606663:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343028.606669:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae2e8a lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1a9:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7ffc expref: 232 pid: 6525 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.606682:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae2e8a lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1a9:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7ffc expref: 232 pid: 6525 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.606704:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae2e8a lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1a9:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7ffc expref: 232 pid: 6525 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.606718:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a9:0x0].0x0 (ffff9a34039e4500) 00010000:00010000:3.0:1763343028.606723:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae2e9f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.606732:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae2e9f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.606739:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae2e9f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1a9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.606747:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae2eb4 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.606773:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343028.606825:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:2430:x1848997993288960:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 180us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.606832:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2829 00000100:00100000:3.0:1763343028.613918:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993289216 00000100:00100000:3.0:1763343028.613927:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993289216 00010000:00010000:3.0:1763343028.613957:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae2e9f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8003 expref: 231 pid: 10042 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.630383:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2d79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.630394:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2d79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.630400:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2d79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.630406:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.630410:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2d79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.630417:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2d79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.630431:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bd500) 00010000:00010000:3.0:1763343028.630433:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.630438:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2d79 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.630445:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2d79 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.630465:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae2e0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.630471:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae2e0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.630476:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae2e0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.630481:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d171000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.630483:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae2e0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.630489:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae2e0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.630496:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bd500) 00010000:00010000:3.0:1763343028.630498:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.630501:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae2e0c lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.631117:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae2e0c lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.631146:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae2eb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.631153:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae2eb4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.631161:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae2eb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.631166:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d170600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.631169:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae2eb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.631175:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae2eb4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.631184:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a9:0x0].0x0 (ffff9a34039e4500) 00010000:00010000:3.0:1763343028.631186:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.631189:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae2eb4 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.631194:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae2eb4 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1a9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343028.631213:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010179328:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.632360:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010179072 00000100:00100000:3.0:1763343028.632369:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010179072 00000100:00100000:3.0:1763343028.633160:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010179456 00000100:00100000:3.0:1763343028.633164:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010179456 00000100:00100000:3.0:1763343028.633180:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010179712 00000100:00100000:3.0:1763343028.633182:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010179712 00000100:00100000:3.0:1763343028.633196:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5947 00000100:00100000:3.0:1763343028.633202:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+66:3657:x1848998010179200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343028.633223:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:603 count 1 00010000:00010000:3.0:1763343028.633244:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ef3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.633264:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae2d25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f8c expref: 31 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.633271:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343028.633273:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343028.633276:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ef3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.633298:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae2d25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f8c expref: 31 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.633309:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae2d25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7f8c expref: 31 pid: 8407 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343028.633320:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340a658e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010180096:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343028.633382:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343028.633397:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.633424:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010179840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.633446:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.633472:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010179328 00000100:00100000:3.0:1763343028.633476:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010179328 00000100:00100000:3.0:1763343028.633494:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010179840 00000100:00100000:3.0:1763343028.633497:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010179840 00000100:00100000:3.0:1763343028.633507:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5949 00000100:00100000:3.0:1763343028.633512:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3660:x1848998010179584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343028.634984:0:8408:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x25f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343028.634988:0:8408:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x25f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343028.634991:0:8408:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x25f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343028.634992:0:8408:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x25f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343028.634994:0:8408:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x25f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343028.638917:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3660:x1848998010179584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5400us (7903us total) trans 17179871340 rc 0/0 00000100:00100000:3.0:1763343028.638930:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5949 00000004:00080000:3.0:1763343028.639008:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b1180/2, rc 0, transno 21474838638 00000100:00100000:3.0:1763343028.639014:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010179840:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343028.639026:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b2680/2, rc 0, transno 21474838639 00000100:00100000:3.0:1763343028.639030:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010179328:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.644068:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340a658e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010180096:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343028.644084:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ef3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.647680:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.647698:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.647709:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.647716:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae2ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.647751:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343028.648201:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+70:3657:x1848998010179200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14995us (17809us total) trans 21474838641 rc 0/0 00000100:00100000:3.0:1763343028.648211:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5947 00000100:00100000:3.0:1763343028.648565:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993290368 00000100:00100000:3.0:1763343028.648569:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993290368 00000100:00100000:3.0:1763343028.648773:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 5955 00000100:00100000:3.0:1763343028.648780:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:55941:x1848997993290368:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343028.648790:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.648806:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae2f0f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8026 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.648826:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d171600/0x607405d401ae2e59 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7fee expref: 15 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343028.648834:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.648836:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.648840:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae2f0f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8026 expref: 15 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.648944:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d171600/0x607405d401ae2e59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7fee expref: 15 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343028.648960:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d171600/0x607405d401ae2e59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac7fee expref: 15 pid: 28994 timeout: 1322 lvb_type: 1 00000100:00100000:3.0:1763343028.648978:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340a658e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010180352:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343028.649021:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c600 going to sleep for 11 seconds 00000100:00100000:3.0:1763343028.657466:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.670535:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.695575:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993292800 00000100:00100000:3.0:1763343028.695585:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993292800 00000100:00100000:3.0:1763343028.695970:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8624 00000100:00100000:3.0:1763343028.695982:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+217:56770:x1848997993292800:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343028.696008:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.696012:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343028.696028:0:10042:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae2f47 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1a9:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac803b expref: 217 pid: 6525 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.696064:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a9:0x0].0x0 (ffff9a3503a3ab00) 00010000:00010000:3.0:1763343028.696070:0:10042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae2f63 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.696081:0:10042:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae2f63 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1a9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.696088:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae2f63 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1a9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343028.696110:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343028.696125:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae2f6a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8042 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.696228:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2f71 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.696239:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2f71 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.696246:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2f71 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343028.696258:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1a9:0x0]: returning size 5 00010000:00010000:3.0:1763343028.696370:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae2f6a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8042 expref: 220 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.696387:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2f71 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1a9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8042 expref: 219 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.696394:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a9:0x0].0x0 (ffff9a3503a3ab00) 00010000:00010000:3.0:1763343028.696397:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343028.696400:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343028.696455:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+219:56770:x1848997993292800:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 475us (962us total) trans 8589939364 rc 0/0 00000100:00100000:3.0:1763343028.696462:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8624 00000100:00100000:3.0:1763343028.727485:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993293184 00000100:00100000:3.0:1763343028.727496:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993293184 00002000:00100000:3.0:1763343028.727549:0:28425:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x25f:0x0] (0->4) req@ffff9a3538754000 x1848997993293184/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:524/0 lens 496/0 e 0 to 0 dl 1763343039 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343028.727559:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538754000 with x1848997993293184 ext(0->4) 00010000:00010000:3.0:1763343028.727568:0:28425:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae2f0f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8026 expref: 16 pid: 28995 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.727583:0:28425:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae2f0f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8026 expref: 16 pid: 28995 timeout: 1322 lvb_type: 0 00002000:00010000:3.0:1763343028.727591:0:28425:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a3538754000 00000100:00100000:3.0:1763343028.727649:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 94 00000100:00100000:3.0:1763343028.727658:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993293184:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:3.0:1763343028.728368:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993293184:12345-192.168.204.21@tcp:4:bash.0 Request processed in 707us (1127us total) trans 17179871343 rc 0/0 00000100:00100000:3.0:1763343028.728378:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 94 00002000:00100000:3.0:1763343028.728386:0:28425:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x25f:0x0] (0->4) req@ffff9a3538754000 x1848997993293184/t17179871343(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:524/0 lens 496/448 e 0 to 0 dl 1763343039 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343028.728396:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538754000 with x1848997993293184 ext(0->4) 00010000:00010000:3.0:1763343028.728403:0:28425:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae2f0f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8026 expref: 18 pid: 28995 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.728417:0:28425:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae2f0f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8026 expref: 18 pid: 28995 timeout: 1322 lvb_type: 0 00002000:00010000:3.0:1763343028.728425:0:28425:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a3538754000 00000100:00100000:3.0:1763343028.735986:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.746081:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993293824 00000100:00100000:3.0:1763343028.746092:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993293824 00000004:00080000:3.0:1763343028.760474:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34097a3100/2, rc 0, transno 17179871345 00000100:00100000:3.0:1763343028.760483:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010181248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343028.760934:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993294080 00000100:00100000:3.0:1763343028.760939:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993294080 00000100:00100000:3.0:1763343028.760981:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8630 00000100:00100000:3.0:1763343028.760989:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+211:56772:x1848997993294080:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343028.761002:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.761019:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae2fcc lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8065 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.761081:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2fd3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761094:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2fd3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761104:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2fd3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761116:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2fda lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761123:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2fda lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761129:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2fda lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761165:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2fd3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761171:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2fd3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761177:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2fd3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761183:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2fd3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761192:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.761196:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2fd3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761203:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2fd3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761213:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:3.0:1763343028.761216:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.761220:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2fd3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761226:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae2fd3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761236:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2fda lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761240:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2fda lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761245:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2fda lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761249:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.761252:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2fda lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761257:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2fda lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761262:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bd500) 00010000:00010000:3.0:1763343028.761264:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.761267:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2fda lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761271:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae2fda lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.761297:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae2fcc lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8065 expref: 212 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.761305:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:3.0:1763343028.761307:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.761310:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae2fcc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8065 expref: 212 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.761317:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93000, rc 0) 00000100:00100000:3.0:1763343028.769511:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993294464 00000100:00100000:3.0:1763343028.769521:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993294464 00000100:00100000:3.0:1763343028.769567:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8632 00000100:00100000:3.0:1763343028.769578:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+212:56772:x1848997993294464:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343028.769597:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.769601:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343028.770437:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae2fc5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac805e expref: 212 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.770457:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:3.0:1763343028.770467:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343028.779834:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343028.784170:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae3020 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.784179:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae3020 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343028.784203:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1aa:0x0]: returning size 0 00000004:00080000:3.0:1763343028.784377:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x25f:0x0], index 0: 0 00000004:00080000:3.0:1763343028.784386:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x261:0x0], index 1: 0 00000004:00080000:3.0:1763343028.784391:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x262:0x0], index 1: 0 00000004:00080000:3.0:1763343028.784394:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x260:0x0], index 0: 0 00010000:00010000:3.0:1763343028.784494:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae3020 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.784501:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae3020 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.784508:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae3020 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.784513:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35379c0600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.784517:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae3020 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.784524:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae3020 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.784532:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1aa:0x0].0x0 (ffff9a34010bed00) 00010000:00010000:3.0:1763343028.784534:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343028.784537:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae3020 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.784542:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae3020 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1aa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.784598:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae3019 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8081 expref: 216 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.784612:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1aa:0x0].0x0 (ffff9a34010bed00) 00010000:00010000:3.0:1763343028.784615:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343028.784953:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae3019 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8081 expref: 216 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.784973:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35379c1800, rc 0) 00000100:00100000:3.0:1763343028.785441:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+215:56772:x1848997993294848:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6474us (6669us total) trans 8589939368 rc 301/301 00000100:00100000:3.0:1763343028.785450:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8634 00000100:00100000:3.0:1763343028.811529:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993295872 00000100:00100000:3.0:1763343028.811540:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993295872 00000100:00100000:3.0:1763343028.811607:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8635 00000100:00100000:3.0:1763343028.811656:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+217:55941:x1848997993295872:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343028.811683:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.811709:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae3035 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac808f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.811842:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae303c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.811856:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae303c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.811867:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae303c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.811877:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae3043 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.811889:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae3043 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.811895:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae3043 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.811954:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae304a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.811963:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae304a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.811970:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae304a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343028.811980:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1aa:0x0]: returning size 0 00010000:00010000:3.0:1763343028.812084:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae303c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.812092:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae303c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.812098:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae303c lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.812106:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae303c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.812112:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.812116:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae303c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.812123:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae303c lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.812139:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bd500) 00010000:00010000:3.0:1763343028.812143:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.812148:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae303c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.812154:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae303c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.812167:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae3043 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.812173:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae3043 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.812178:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae3043 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.812184:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.812186:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae3043 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.812192:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae3043 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.812198:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34010be200) 00010000:00010000:3.0:1763343028.812201:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.812204:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae3043 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.812210:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae3043 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343028.812245:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae3035 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac808f expref: 220 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.812262:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae304a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1aa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac808f expref: 219 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.812269:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1aa:0x0].0x0 (ffff9a34037bdd00) 00010000:00010000:3.0:1763343028.812272:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343028.812274:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93a00, rc 0) 00000100:00100000:3.0:1763343028.814522:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+219:55941:x1848997993295872:12345-192.168.204.21@tcp:101:bash.0 Request processed in 2893us (3122us total) trans 8589939371 rc 0/0 00000100:00100000:3.0:1763343028.814536:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8635 00000100:00100000:3.0:1763343028.845866:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343028.845891:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010181504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343028.846025:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.846070:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010181888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.846112:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.846148:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010181504 00000100:00100000:3.0:1763343028.846154:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010181504 00000100:00100000:3.0:1763343028.846564:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010181888 00000100:00100000:3.0:1763343028.846572:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010181888 00000100:00100000:3.0:1763343028.846605:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5965 00000100:00100000:3.0:1763343028.846642:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:3657:x1848998010181760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.846823:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+74:3657:x1848998010181760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 208us (750us total) trans 21474838645 rc 0/0 00000100:00100000:3.0:1763343028.846836:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5965 00000100:00100000:3.0:1763343028.846859:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5966 00000100:00100000:3.0:1763343028.846871:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:3659:x1848998010181888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.846947:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+74:3659:x1848998010181888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (835us total) trans 21474838646 rc 0/0 00000100:00100000:3.0:1763343028.846953:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5966 00000004:00080000:3.0:1763343028.846992:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406839180/2, rc 0, transno 21474838645 00000100:00100000:3.0:1763343028.846997:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010181760:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343028.847013:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406839c00/2, rc 0, transno 21474838646 00000100:00100000:3.0:1763343028.847016:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010181888:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343028.847024:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d5180/2, rc 0, transno 17179871346 00000100:00100000:3.0:1763343028.847027:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010181504:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343028.848472:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d4380/2, rc 0, transno 17179871347 00000100:00100000:3.0:1763343028.848478:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010181632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343028.867850:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993297280 00000100:00100000:3.0:1763343028.867861:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993297280 00002000:00010000:3.0:1763343028.867901:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/607 (0->18446744073709551615) 00002000:00100000:3.0:1763343028.867907:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34097a3b80 with x1848997993297280 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343028.867921:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34097a3b80. 00000100:00100000:3.0:1763343028.867965:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1478 00000100:00100000:3.0:1763343028.867981:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2431:x1848997993297280:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343028.868177:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x25f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343028.868181:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x25f:0x0] updating lvb mtime from disk: 0 -> 1763343028 00002000:00010000:3.0:1763343028.868184:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x25f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343028.868189:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x25f:0x0] updating lvb ctime from disk: 0 -> 1763343028 00002000:00010000:3.0:1763343028.868194:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x25f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343028.868258:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+35:2431:x1848997993297280:12345-192.168.204.21@tcp:10:bash.0 Request processed in 281us (584us total) trans 21474838647 rc 0/0 00000100:00100000:3.0:1763343028.868267:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1478 00002000:00010000:3.0:1763343028.868271:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/607 (0->18446744073709551615) 00002000:00100000:3.0:1763343028.868274:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34097a3b80 with x1848997993297280 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343028.868282:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34097a3b80. 00000100:00100000:3.0:1763343028.890840:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.908729:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.915691:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.919409:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.919451:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343028.926838:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993299456 00000100:00100000:3.0:1763343028.926844:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993299456 00000100:00100000:3.0:1763343028.926882:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8645 00000100:00100000:3.0:1763343028.926891:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+217:56774:x1848997993299456:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343028.926903:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.926924:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae310e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac80dc expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.926985:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3115 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.926999:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3115 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.927010:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3115 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.927020:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae311c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.927043:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae311c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.927051:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae311c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928172:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3115 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928181:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3115 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928188:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3115 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928195:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3115 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928313:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.928317:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3115 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928325:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3115 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928339:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bd500) 00010000:00010000:3.0:1763343028.928342:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.928347:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3115 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928354:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3115 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928367:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae311c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928373:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae311c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928379:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae311c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928383:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343028.928385:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae311c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928390:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae311c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928396:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bf800) 00010000:00010000:3.0:1763343028.928398:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.928401:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae311c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928406:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae311c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.928436:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae310e lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac80dc expref: 218 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.928446:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bd500) 00010000:00010000:3.0:1763343028.928449:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343028.928452:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae310e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac80dc expref: 218 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.928465:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93000, rc 0) 00000100:00100000:3.0:1763343028.928634:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+217:56774:x1848997993299456:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1728us (2490us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343028.928645:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8645 00000100:00100000:3.0:1763343028.936504:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993299712 00000100:00100000:3.0:1763343028.936516:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993299712 00000100:00100000:3.0:1763343028.936605:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993299840 00000100:00100000:3.0:1763343028.936609:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993299840 00000100:00100000:3.0:1763343028.937332:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8647 00000100:00100000:3.0:1763343028.937340:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+219:56774:x1848997993299840:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343028.937349:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343028.937364:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae312a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac80e3 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.937406:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3131 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.937415:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3131 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.937425:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3131 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343028.937453:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343028.937457:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343028.937482:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae312a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac80e3 expref: 221 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.937513:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3131 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac80e3 expref: 220 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.937521:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bd500) 00010000:00010000:3.0:1763343028.937523:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343028.937526:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:3.0:1763343028.937551:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+220:56774:x1848997993299840:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 212us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.937558:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8647 00000100:00100000:3.0:1763343028.941010:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993299968 00000100:00100000:3.0:1763343028.941024:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993299968 00000100:00100000:3.0:1763343028.941092:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 5973 00000100:00100000:3.0:1763343028.941101:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2431:x1848997993299968:12345-192.168.204.21@tcp:2:lfs.0 00000100:00100000:3.0:1763343028.949911:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993300608 00000100:00100000:3.0:1763343028.949916:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993300608 00000100:00100000:3.0:1763343028.949966:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2930 00000100:00100000:3.0:1763343028.949976:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+221:56770:x1848997993300608:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:3.0:1763343028.950122:0:6527:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1a9:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae2f71 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1a9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8042 expref: 221 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.950257:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae314d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343028.950272:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae2fe1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac806c expref: 221 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.950281:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae314d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343028.950318:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae2fe1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac806c expref: 221 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.950331:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae2fe1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac806c expref: 221 pid: 6525 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343028.950352:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d13a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010182016:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343028.950456:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c480 going to sleep for 11 seconds 00000100:00100000:3.0:1763343028.954349:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d13a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010182016:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343028.954381:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae314d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1a9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00000100:00100000:3.0:1763343028.958604:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993300992 00000100:00100000:3.0:1763343028.958616:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993300992 00000100:00100000:3.0:1763343028.962402:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010182656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.962464:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.962505:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343028.962511:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d13a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010182272:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.962533:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.962559:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d139880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010182400:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.962581:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.962742:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343028.962749:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010182528:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343028.962784:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343028.962813:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010182272 00000100:00100000:3.0:1763343028.962816:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010182272 00000100:00100000:3.0:1763343028.963384:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5976 00000100:00100000:3.0:1763343028.963393:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010182400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343028.963410:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:608 count 1 00002000:00010000:3.0:1763343028.964275:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x260:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343028.964281:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92800/0x607405d401ae318c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.964291:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.964292:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.964297:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92800/0x607405d401ae318c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.964309:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92800/0x607405d401ae318c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.964318:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92800/0x607405d401ae318c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.964324:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92800/0x607405d401ae318c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.964340:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343028.964512:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010182400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1121us (1930us total) trans 21474838652 rc 0/0 00000100:00100000:3.0:1763343028.964518:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5976 00000100:00100000:3.0:1763343028.965944:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010182912 00000100:00100000:3.0:1763343028.965960:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010182912 00000100:00100000:3.0:1763343028.966010:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5978 00000100:00100000:3.0:1763343028.966019:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3660:x1848998010183296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343028.966164:0:8408:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x260:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343028.966167:0:8408:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x260:0x0] updating lvb mtime from disk: 1763343028 -> 1763343028 00002000:00010000:3.0:1763343028.966170:0:8408:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x260:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343028.966172:0:8408:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x260:0x0] updating lvb ctime from disk: 1763343028 -> 1763343028 00002000:00010000:3.0:1763343028.966175:0:8408:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x260:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343028.966226:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3660:x1848998010183296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 208us (1696us total) trans 17179871351 rc 0/0 00000100:00100000:3.0:1763343028.968950:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5978 00000100:00100000:3.0:1763343028.968972:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5980 00000100:00100000:3.0:1763343028.968979:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3658:x1848998010183168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343028.969124:0:8408:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x25f:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343028.969127:0:8408:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x25f:0x0] updating lvb mtime from disk: 1763343028 -> 1763343028 00002000:00010000:3.0:1763343028.969129:0:8408:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x25f:0x0] updating lvb atime from disk: 1763343028 -> 1763343028 00002000:00010000:3.0:1763343028.969132:0:8408:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x25f:0x0] updating lvb ctime from disk: 1763343028 -> 1763343028 00002000:00010000:3.0:1763343028.969134:0:8408:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x25f:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343028.969171:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3658:x1848998010183168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (325us total) trans 17179871352 rc 0/0 00000100:00100000:3.0:1763343028.969178:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5980 00000100:00100000:3.0:1763343028.969199:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993301120 00000100:00100000:3.0:1763343028.969203:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993301120 00010000:00010000:3.0:1763343028.969223:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405986400/0x607405d401ae3169 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac80f1 expref: 213 pid: 10042 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343028.969244:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2837 00000100:00100000:3.0:1763343028.969251:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+213:2430:x1848997993301120:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343028.969262:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343028.969268:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405986400/0x607405d401ae3169 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac80f1 expref: 213 pid: 10042 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.969279:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405986400/0x607405d401ae3169 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac80f1 expref: 213 pid: 10042 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.969301:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405986400/0x607405d401ae3169 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac80f1 expref: 213 pid: 10042 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.969316:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ac:0x0].0x0 (ffff9a3503a3a700) 00010000:00010000:3.0:1763343028.969321:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae317e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.969329:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae317e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.969336:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae317e lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343028.969351:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343028.969383:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+212:2430:x1848997993301120:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 133us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.969390:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2837 00000004:00080000:3.0:1763343028.969413:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062f3b80/2, rc 0, transno 17179871353 00000100:00100000:3.0:1763343028.969417:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010183040:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763343028.969424:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062f2300/2, rc 0, transno 17179871352 00000100:00100000:3.0:1763343028.969427:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010183168:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343028.972378:0:32355:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 54 in progress, 1 in flight, 18 done 00000004:00080000:3.0:1763343028.972573:0:32355:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 4 in progress, 1 in flight, 50 done 00000100:00100000:3.0:1763343028.975900:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010183424:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343028.975918:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae3193 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343028.977329:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2839 00000100:00100000:3.0:1763343028.977338:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350921d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993301760:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343028.977348:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343028.977352:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae3089 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac80b2 expref: 22 pid: 28996 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.977361:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae3089 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac80b2 expref: 22 pid: 28996 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.977374:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae3089 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac80b2 expref: 22 pid: 28996 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343028.977384:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.977385:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343028.977388:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae3193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.977397:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae3193 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.977412:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343028.977430:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350921d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993301760:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 95us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343028.977436:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2839 00010000:00010000:3.0:1763343028.977474:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae3193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.977486:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae3193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.977493:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae3193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.977499:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae3193 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343028.977513:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343028.978433:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3660:x1848998010182912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10713us (14528us total) trans 17179871354 rc 0/0 00000100:00100000:3.0:1763343028.978440:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5979 00010000:00010000:3.0:1763343028.978459:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343028.978480:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062f3800/2, rc 0, transno 17179871354 00000100:00100000:3.0:1763343028.978485:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010182912:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343028.983232:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993302016 00000100:00100000:3.0:1763343028.983243:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993302016 00000100:00100000:3.0:1763343029.004186:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343029.011985:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae31f5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ac:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.011994:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae31f5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ac:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343029.012061:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ac:0x0]: returning size 0 00000004:00200000:3.0:1763343029.012066:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343029.012087:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae31f5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ac:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.012117:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae31ee lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8114 expref: 220 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.012133:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae31f5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ac:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8114 expref: 219 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.012140:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ac:0x0].0x0 (ffff9a34010bef00) 00010000:00010000:3.0:1763343029.012142:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763343029.012145:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:3.0:1763343029.012186:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+219:56770:x1848997993302912:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 7297us (7914us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.012193:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8654 00000100:00100000:3.0:1763343029.015907:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993303424 00000100:00100000:3.0:1763343029.015920:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993303424 00000100:00100000:3.0:1763343029.015978:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8656 00000100:00100000:3.0:1763343029.015987:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+219:55941:x1848997993303424:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:3.0:1763343029.016242:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae320a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.016260:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae31f5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1ac:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8114 expref: 220 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.016270:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae320a lrc: 4/0,1 mode: --/PW res: [0x200000405:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.016302:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae31f5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ac:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8114 expref: 220 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.016321:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae31f5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ac:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8114 expref: 220 pid: 10041 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343029.016336:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010183680:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343029.016545:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343029.018849:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010183680:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343029.018875:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae320a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343029.021646:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993303808 00000100:00100000:3.0:1763343029.021651:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993303808 00000100:00100000:3.0:1763343029.021696:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 5982 00000100:00100000:3.0:1763343029.021702:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993303808:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343029.021715:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343029.021732:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae3218 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8129 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343029.021751:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x263:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343029.021766:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.021768:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.021776:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae3218 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8129 expref: 22 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343029.021790:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae3218 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8129 expref: 22 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343029.021807:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343029.021830:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993303808:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 129us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.021836:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 5982 00000100:00100000:3.0:1763343029.025295:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.037607:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010184192:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.037703:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.037740:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010184704:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.037767:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.037802:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1763343029.037810:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010183936:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.037837:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.038006:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010184576:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.038032:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.038147:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010184320:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.038176:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.038199:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010184832:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.038331:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.038355:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1763343029.038362:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010184064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.038385:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.038540:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010184448:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.038572:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.038762:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010184448 00000100:00100000:3.0:1763343029.038770:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010184448 00000100:00100000:3.0:1763343029.038800:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5986 00000100:00100000:3.0:1763343029.038808:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3658:x1848998010184576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.038925:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3658:x1848998010184576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (890us total) trans 21474838654 rc 0/0 00000100:00100000:3.0:1763343029.038933:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5986 00000100:00100000:3.0:1763343029.038953:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5988 00000100:00100000:3.0:1763343029.038960:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3659:x1848998010184832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.039057:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3659:x1848998010184832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (826us total) trans 21474838655 rc 0/0 00000100:00100000:3.0:1763343029.039062:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5988 00000100:00100000:3.0:1763343029.039075:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5989 00000100:00100000:3.0:1763343029.039081:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3659:x1848998010184064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343029.039092:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:605 count 1 00010000:00010000:3.0:1763343029.039102:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae3249 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.039115:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3404b77600/0x607405d401ae2f16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac802d expref: 11 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.039123:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343029.039125:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343029.039127:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae3249 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.039147:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3404b77600/0x607405d401ae2f16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac802d expref: 11 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.039157:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3404b77600/0x607405d401ae2f16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac802d expref: 11 pid: 28995 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343029.039168:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340a658a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010185216:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343029.039199:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343029.039216:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5990 00000100:00100000:3.0:1763343029.039223:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3659:x1848998010184448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343029.040546:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x263:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343029.040550:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x263:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343029.040552:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x263:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343029.040554:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x263:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343029.040556:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x263:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343029.040613:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a65b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3659:x1848998010184448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1390us (2043us total) trans 17179871356 rc 0/0 00000100:00100000:3.0:1763343029.040635:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5990 00000004:00080000:3.0:1763343029.040908:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7f100/2, rc 0, transno 21474838654 00000100:00100000:3.0:1763343029.040914:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010184576:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343029.041375:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c3bdc00/2, rc 0, transno 17179871355 00000100:00100000:3.0:1763343029.041382:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010184704:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.045712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.045805:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.045913:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010184960:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343029.045944:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae3234 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343029.048330:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993305088 00000100:00100000:3.0:1763343029.048336:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993305088 00010000:00010000:3.0:1763343029.048357:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405986c00/0x607405d401ae30f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac80d5 expref: 25 pid: 8408 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343029.048743:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2844 00000100:00100000:3.0:1763343029.048754:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993305088:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343029.048763:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343029.048771:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3405986c00/0x607405d401ae30f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac80d5 expref: 24 pid: 8408 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343029.048787:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3405986c00/0x607405d401ae30f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac80d5 expref: 24 pid: 8408 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343029.048805:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405986c00/0x607405d401ae30f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac80d5 expref: 24 pid: 8408 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343029.048819:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.048823:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.048826:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405987000/0x607405d401ae323b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.048839:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405987000/0x607405d401ae323b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.048873:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343029.048904:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993305088:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 151us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.048912:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2844 00000100:00100000:3.0:1763343029.048966:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340a658a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010185216:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343029.048985:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae3249 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.049002:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae3234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.049009:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae3234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.049022:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae3234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.049029:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae3234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.049066:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343029.050897:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3658:x1848998010183936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10798us (11522us total) trans 17179871357 rc 0/0 00000100:00100000:3.0:1763343029.050905:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5984 00000100:00100000:3.0:1763343029.053988:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993305472 00000100:00100000:3.0:1763343029.053995:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993305472 00010000:00010000:3.0:1763343029.054022:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3404b77600/0x607405d401ae2f16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac802d expref: 11 pid: 28995 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343029.054064:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993305600 00000100:00100000:3.0:1763343029.054067:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993305600 00010000:00010000:3.0:1763343029.054083:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae3218 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8129 expref: 21 pid: 28995 timeout: 1322 lvb_type: 1 00000100:00100000:3.0:1763343029.054101:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2846 00000100:00100000:3.0:1763343029.054108:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350921d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2429:x1848997993305472:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343029.054121:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343029.054126:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3404b77600/0x607405d401ae2f16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac802d expref: 11 pid: 28995 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343029.054907:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3404b77600/0x607405d401ae2f16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac802d expref: 11 pid: 28995 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343029.054928:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3404b77600/0x607405d401ae2f16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac802d expref: 11 pid: 28995 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343029.054940:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.054942:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.054946:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae3249 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.054955:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae3249 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.054986:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343029.055044:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350921d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+10:2429:x1848997993305472:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 925us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.055057:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2846 00000100:00100000:3.0:1763343029.061968:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993306112 00000100:00100000:3.0:1763343029.061979:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993306112 00000100:00100000:3.0:1763343029.062052:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2936 00000100:00100000:3.0:1763343029.062066:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+217:56770:x1848997993306112:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:3.0:1763343029.062241:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+217:56770:x1848997993306112:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 179us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.062250:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2936 00000100:00100000:3.0:1763343029.082468:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993306624 00000100:00100000:3.0:1763343029.082479:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993306624 00000100:00100000:3.0:1763343029.082550:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8661 00000100:00100000:3.0:1763343029.082561:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+217:56775:x1848997993306624:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343029.082582:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343029.082606:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae3281 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8153 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.082726:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae3288 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343029.082741:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae3288 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1ac:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343029.082752:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae3288 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1ac:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343029.082762:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ac:0x0]: returning size 2 00010000:00010000:3.0:1763343029.082859:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae3281 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ac:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8153 expref: 220 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.082877:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae3288 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ac:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8153 expref: 219 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.082885:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ac:0x0].0x0 (ffff9a34010bef00) 00010000:00010000:3.0:1763343029.082888:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1763343029.082892:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92e00, rc 0) 00000100:00100000:3.0:1763343029.082948:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+219:56775:x1848997993306624:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 389us (571us total) trans 8589939393 rc 0/0 00000100:00100000:3.0:1763343029.082956:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8661 00000100:00100000:3.0:1763343029.096358:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.097223:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2848 00000100:00100000:3.0:1763343029.099194:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.100880:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993307520 00000100:00100000:3.0:1763343029.100888:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993307520 00000100:00100000:3.0:1763343029.100930:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8664 00000100:00100000:3.0:1763343029.100939:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:56775:x1848997993307520:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343029.100957:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343029.100972:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae32c7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8168 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.101062:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae32ce lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ac:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343029.101074:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae32ce lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ac:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343029.101082:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae32ce lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ac:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343029.103139:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.113289:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993307776 00000100:00100000:3.0:1763343029.113301:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993307776 00000100:00100000:3.0:1763343029.113562:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 404 00000100:00100000:3.0:1763343029.113571:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:2432:x1848997993307776:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343029.113584:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343029.113609:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae32ce lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ac:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8168 expref: 225 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.113654:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ac:0x0].0x0 (ffff9a34010bef00) 00010000:00010000:3.0:1763343029.113661:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343029.113715:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:2432:x1848997993307776:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 143us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.113737:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 404 00000100:00100000:3.0:1763343029.133777:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993308928 00000100:00100000:3.0:1763343029.133789:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993308928 00000100:00100000:3.0:1763343029.141862:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993309184 00000100:00100000:3.0:1763343029.141877:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993309184 00010000:00010000:3.0:1763343029.141927:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae3250 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8145 expref: 24 pid: 10294 timeout: 1322 lvb_type: 0 00000100:00100000:3.0:1763343029.141973:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2850 00000100:00100000:3.0:1763343029.141987:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993309184:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343029.142005:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1763343029.142026:0:13199:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x263:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:3.0:1763343029.142044:0:13199:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x263:0x0] updating lvb mtime from disk: 1763343028 -> 1763343029 00002000:00010000:3.0:1763343029.142052:0:13199:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x263:0x0] updating lvb ctime from disk: 1763343028 -> 1763343029 00002000:00010000:3.0:1763343029.142056:0:13199:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x263:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763343029.142068:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae3250 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8145 expref: 24 pid: 10294 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343029.142094:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae3250 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8145 expref: 24 pid: 10294 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343029.142127:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae3250 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8145 expref: 24 pid: 10294 timeout: 1322 lvb_type: 0 00010000:00010000:3.0:1763343029.142145:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.142149:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.142156:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae3306 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.142174:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae3306 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.142202:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343029.142259:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993309184:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 275us (3365us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.142266:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2850 00000100:00100000:3.0:1763343029.146714:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.154932:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343029.154952:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010186112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.155012:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.155073:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343029.155083:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340a658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010186240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.155108:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.155136:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010186112 00000100:00100000:3.0:1763343029.155143:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010186112 00000100:00100000:3.0:1763343029.155183:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010186240 00000100:00100000:3.0:1763343029.155187:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010186240 00000100:00100000:3.0:1763343029.155215:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5994 00000100:00100000:3.0:1763343029.155224:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3659:x1848998010186112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.155387:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a65b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3659:x1848998010186112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 163us (373us total) trans 17179871361 rc 0/0 00000100:00100000:3.0:1763343029.155395:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5994 00000100:00100000:3.0:1763343029.156016:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010186368 00000100:00100000:3.0:1763343029.156022:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010186368 00000100:00100000:3.0:1763343029.160704:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.166475:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.166524:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.174122:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.174593:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.185390:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.198816:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.202280:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.215810:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.222443:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6000 00000100:00100000:3.0:1763343029.222453:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3657:x1848998010186880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.222540:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3657:x1848998010186880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (522us total) trans 17179871364 rc 0/0 00000100:00100000:3.0:1763343029.224465:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6000 00000004:00080000:3.0:1763343029.225081:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a351fc76d80/2, rc 0, transno 17179871363 00000100:00100000:3.0:1763343029.225087:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a351fc76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010186752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.226976:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.231077:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993312640 00000100:00100000:3.0:1763343029.231087:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993312640 00000100:00100000:3.0:1763343029.232306:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6004 00000100:00100000:3.0:1763343029.232324:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:55941:x1848997993312640:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343029.232343:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343029.232369:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae3409 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac81df expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343029.232395:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x265:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343029.232432:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.232435:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.232445:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae3409 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac81df expref: 24 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.232462:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae3409 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac81df expref: 24 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.232476:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343029.232556:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:55941:x1848997993312640:12345-192.168.204.21@tcp:101:bash.0 Request processed in 239us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.232568:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6004 00000100:00100000:3.0:1763343029.243312:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993312768 00000100:00100000:3.0:1763343029.243323:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993312768 00000100:00100000:3.0:1763343029.243392:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6005 00000100:00100000:3.0:1763343029.243403:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2432:x1848997993312768:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:3.0:1763343029.247091:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2432:x1848997993312768:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 3686us (4585us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.247102:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6005 00000100:00100000:3.0:1763343029.250103:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993313280 00000100:00100000:3.0:1763343029.250114:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993313280 00000100:00100000:3.0:1763343029.250410:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2941 00000100:00100000:3.0:1763343029.250421:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+216:55941:x1848997993313280:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:3.0:1763343029.253964:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993313408 00000100:00100000:3.0:1763343029.253973:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993313408 00000100:00100000:3.0:1763343029.254014:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6006 00000100:00100000:3.0:1763343029.254023:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2431:x1848997993313408:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:3.0:1763343029.254131:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2431:x1848997993313408:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 108us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.254138:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6006 00000100:00100000:3.0:1763343029.267555:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993313664 00000100:00100000:3.0:1763343029.267567:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993313664 00000100:00100000:3.0:1763343029.267672:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1488 00000100:00100000:3.0:1763343029.267682:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2430:x1848997993313664:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:3.0:1763343029.267718:0:28425:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae342c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.267733:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.267735:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.267740:0:28425:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae342c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.267754:0:28425:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae342c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.267854:0:28425:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae342c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.267863:0:28425:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae342c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.267870:0:28425:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae342c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.267876:0:28425:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343029.267880:0:28425:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae342c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.267887:0:28425:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae342c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.267901:0:28425:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae342c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.267908:0:28425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae342c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343029.267962:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2430:x1848997993313664:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 282us (838us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763343029.267969:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1488 00010000:00010000:3.0:1763343029.281326:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343029.281349:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae3456 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1ad:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.281363:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403a5fe00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343029.281367:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae3456 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1ad:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.281374:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae3456 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1ad:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.281390:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ad:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:3.0:1763343029.281393:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343029.281397:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae3456 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1ad:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.281403:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae3456 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1ad:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.281424:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343029.281426:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343029.281427:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343029.315581:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.333357:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.338934:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.338981:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.340358:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993315968 00000100:00100000:3.0:1763343029.340364:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993315968 00002000:00010000:3.0:1763343029.340387:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/612 (0->18446744073709551615) 00002000:00100000:3.0:1763343029.340391:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3535ad1c00 with x1848997993315968 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343029.340399:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3535ad1c00. 00000100:00100000:3.0:1763343029.340426:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1491 00000100:00100000:3.0:1763343029.340434:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2430:x1848997993315968:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:3.0:1763343029.340550:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x264:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343029.340553:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x264:0x0] updating lvb mtime from disk: 0 -> 1763343029 00002000:00010000:3.0:1763343029.340555:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x264:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343029.340557:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x264:0x0] updating lvb ctime from disk: 0 -> 1763343029 00002000:00010000:3.0:1763343029.340559:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x264:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343029.340583:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2430:x1848997993315968:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 150us (393us total) trans 17179871366 rc 0/0 00000100:00100000:3.0:1763343029.340589:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1491 00002000:00010000:3.0:1763343029.340592:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/612 (0->18446744073709551615) 00002000:00100000:3.0:1763343029.340594:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3535ad1c00 with x1848997993315968 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343029.340598:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3535ad1c00. 00000100:00100000:3.0:1763343029.347831:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993316096 00000100:00100000:3.0:1763343029.347836:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993316096 00010000:00010000:3.0:1763343029.347861:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae34d4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8217 expref: 225 pid: 10041 timeout: 1323 lvb_type: 0 00000100:00100000:3.0:1763343029.347893:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2852 00000100:00100000:3.0:1763343029.347898:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350921f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:2431:x1848997993316096:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343029.347917:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343029.347923:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae34d4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8217 expref: 225 pid: 10041 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343029.347934:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae34d4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8217 expref: 225 pid: 10041 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343029.347959:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae34d4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8217 expref: 225 pid: 10041 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343029.347977:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1af:0x0].0x0 (ffff9a3541141c00) 00010000:00010000:3.0:1763343029.347982:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae34f0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.347992:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae34f0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.347997:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae34f0 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.348253:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343029.348358:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350921f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:2431:x1848997993316096:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 457us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.348366:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2852 00000100:00100000:3.0:1763343029.359831:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993316864 00000100:00100000:3.0:1763343029.359836:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993316864 00010000:00010000:3.0:1763343029.359862:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d400/0x607405d401ae33a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac81b5 expref: 28 pid: 28648 timeout: 1323 lvb_type: 1 00000100:00100000:3.0:1763343029.359901:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2853 00000100:00100000:3.0:1763343029.359909:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2429:x1848997993316864:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343029.359922:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343029.359942:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665d400/0x607405d401ae33a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac81b5 expref: 28 pid: 28648 timeout: 1323 lvb_type: 1 00010000:00010000:3.0:1763343029.359955:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665d400/0x607405d401ae33a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac81b5 expref: 28 pid: 28648 timeout: 1323 lvb_type: 1 00010000:00010000:3.0:1763343029.359984:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d400/0x607405d401ae33a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac81b5 expref: 28 pid: 28648 timeout: 1323 lvb_type: 1 00010000:00010000:3.0:1763343029.359999:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.360001:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.360009:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae3505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac822c expref: 27 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.360019:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae3505 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac822c expref: 27 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.360071:0:13199:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae3505 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac822c expref: 27 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343029.360089:0:13199:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406838380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13199:1848998010187520:192.168.204.21@tcp:105: 00000100:00100000:3.0:1763343029.360184:0:13199:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343029.367474:0:13199:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406838380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13199:1848998010187520:192.168.204.21@tcp:105: 00010000:00010000:3.0:1763343029.367498:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343029.367568:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2429:x1848997993316864:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 7658us (8300us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.367579:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2853 00000100:00100000:3.0:1763343029.371104:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.382892:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.382958:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.387896:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993318016 00000100:00100000:3.0:1763343029.387906:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993318016 00010000:00010000:3.0:1763343029.387943:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae3384 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac81a0 expref: 230 pid: 10041 timeout: 1323 lvb_type: 0 00000100:00100000:3.0:1763343029.387987:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2854 00000100:00100000:3.0:1763343029.387997:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:2429:x1848997993318016:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343029.388012:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343029.388018:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae3384 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac81a0 expref: 230 pid: 10041 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343029.388040:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae3384 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac81a0 expref: 230 pid: 10041 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343029.388065:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ac:0x0].0x0 (ffff9a34010bef00) 00010000:00010000:3.0:1763343029.388071:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae3536 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343029.388081:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae3536 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343029.388091:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae3536 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1ac:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343029.388113:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343029.388181:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:2429:x1848997993318016:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 180us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.388195:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2854 00000100:00100000:3.0:1763343029.397063:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.399037:0:10294:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10294:1848998010188928:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343029.399062:0:10294:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae3560 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343029.399887:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.399930:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.401702:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343029.404898:0:10294:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae3560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.404907:0:10294:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae3560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.404916:0:10294:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae3560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.404926:0:10294:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae3560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.404946:0:10294:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343029.405192:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3659:x1848998010188416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8961us (9135us total) trans 21474838669 rc 0/0 00000100:00100000:3.0:1763343029.405200:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6018 00010000:00010000:3.0:1763343029.405222:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343029.405229:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae3560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.405238:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405986400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343029.405242:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae3560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.405256:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae3560 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.405269:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae3560 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.405276:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae3560 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.405293:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343029.405296:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665d400/0x607405d401ae354b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.405303:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343029.405306:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665d400/0x607405d401ae354b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.405313:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665d400/0x607405d401ae354b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.405323:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665d400/0x607405d401ae354b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.405329:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d400/0x607405d401ae354b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.405345:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343029.405347:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343029.405349:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343029.405383:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d6d80/2, rc 0, transno 21474838669 00000100:00100000:3.0:1763343029.405389:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010188416:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763343029.407970:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3403ad4000/2, rc 0, transno 17179871371 00000100:00100000:3.0:1763343029.408015:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010187776:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.413932:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010189056:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.413996:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.414064:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010189184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.414094:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.414132:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343029.414139:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010189312:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.414171:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.414230:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010189440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.414257:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.414304:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010189056 00000100:00100000:3.0:1763343029.414313:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010189056 00000100:00100000:3.0:1763343029.414358:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010189312 00000100:00100000:3.0:1763343029.414363:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010189312 00000100:00100000:3.0:1763343029.414397:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6019 00000100:00100000:3.0:1763343029.414410:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3660:x1848998010189056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.416282:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3660:x1848998010189056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1874us (2283us total) trans 21474838670 rc 0/0 00000100:00100000:3.0:1763343029.416293:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6019 00000004:00080000:3.0:1763343029.416348:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad3480/2, rc 0, transno 17179871373 00000100:00100000:3.0:1763343029.416355:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010189440:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343029.416390:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b0a80/2, rc 0, transno 21474838670 00000100:00100000:3.0:1763343029.416395:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010189056:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343029.416420:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad2a00/2, rc 0, transno 17179871372 00000100:00100000:3.0:1763343029.416423:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010189312:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343029.418430:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b3b80/2, rc 0, transno 21474838671 00000100:00100000:3.0:1763343029.418458:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010189184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.422969:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.423017:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.430502:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.431600:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.435228:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.439293:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.440262:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.441709:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1493 00000100:00100000:3.0:1763343029.441719:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2432:x1848997993320448:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343029.441807:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x265:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343029.441811:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x265:0x0] updating lvb mtime from disk: 0 -> 1763343029 00002000:00010000:3.0:1763343029.441813:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x265:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343029.441816:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x265:0x0] updating lvb ctime from disk: 0 -> 1763343029 00002000:00010000:3.0:1763343029.441818:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x265:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343029.442205:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2432:x1848997993320448:12345-192.168.204.21@tcp:10:bash.0 Request processed in 486us (1943us total) trans 21474838672 rc 0/0 00000100:00100000:3.0:1763343029.442215:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1493 00002000:00010000:3.0:1763343029.442219:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/613 (0->18446744073709551615) 00002000:00100000:3.0:1763343029.442222:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d138a80 with x1848997993320448 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343029.442227:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340d138a80. 00000100:00100000:3.0:1763343029.451178:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.453016:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993320960 00000100:00100000:3.0:1763343029.453024:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993320960 00000100:00100000:3.0:1763343029.453078:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8700 00000100:00100000:3.0:1763343029.453087:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+220:56780:x1848997993320960:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343029.453105:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343029.453127:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae35bb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac826b expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.453223:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae35c2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.453238:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae35c2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1af:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.453249:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae35c2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1af:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343029.453259:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1af:0x0]: returning size 5 00010000:00010000:3.0:1763343029.453353:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae35bb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1af:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac826b expref: 223 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.453370:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae35c2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1af:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac826b expref: 222 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.453384:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1af:0x0].0x0 (ffff9a3538bf7c00) 00010000:00010000:3.0:1763343029.453388:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1763343029.453392:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92800, rc 0) 00000100:00100000:3.0:1763343029.453446:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+222:56780:x1848997993320960:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 359us (644us total) trans 8589939426 rc 0/0 00000100:00100000:3.0:1763343029.453453:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8700 00000100:00100000:3.0:1763343029.460548:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.471285:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.471309:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993321856 00000100:00100000:3.0:1763343029.471313:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993321856 00000100:00100000:3.0:1763343029.471343:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8703 00000100:00100000:3.0:1763343029.471353:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+222:56780:x1848997993321856:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343029.471377:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343029.471400:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae35fa lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8279 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.471494:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3601 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.471508:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c600/0x607405d401ae35f3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1af:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343029.471516:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3601 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1af:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.471532:0:10042:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c600/0x607405d401ae35f3 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1af:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343029.471541:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3601 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1af:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.476407:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3601 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.476419:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3601 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343029.476451:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1af:0x0]: returning size 5 00000004:00200000:3.0:1763343029.476456:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343029.476473:0:10042:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3601 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.476501:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae35fa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8279 expref: 224 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.476515:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3601 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8279 expref: 223 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.476521:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1af:0x0].0x0 (ffff9a3538bf7c00) 00010000:00010000:3.0:1763343029.476523:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343029.476526:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343029.476568:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+223:56780:x1848997993321856:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 5216us (5286us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.476575:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8703 00000100:00100000:3.0:1763343029.487798:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.516802:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993322880 00000100:00100000:3.0:1763343029.516812:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993322880 00000100:00100000:3.0:1763343029.516870:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8707 00000100:00100000:3.0:1763343029.516880:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:56782:x1848997993322880:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343029.516900:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343029.516925:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae364e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8295 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.516988:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae3655 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.517003:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae3655 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.517014:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae3655 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343029.517068:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343029.517073:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343029.517107:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae364e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8295 expref: 227 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.517123:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae3655 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8295 expref: 226 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.517132:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdb00) 00010000:00010000:3.0:1763343029.517135:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343029.517138:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343029.517197:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56782:x1848997993322880:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 318us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.517204:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8707 00000100:00100000:3.0:1763343029.520855:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.528354:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.528395:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993323136 00000100:00100000:3.0:1763343029.528407:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993323136 00000100:00100000:3.0:1763343029.528447:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8708 00000100:00100000:3.0:1763343029.528456:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56782:x1848997993323136:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343029.528473:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343029.528500:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae365c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac829c expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.528569:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3663 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528586:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3663 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528606:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3663 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528650:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae366a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528661:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae366a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528675:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae366a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528717:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3663 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528726:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3663 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528734:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3663 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528740:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3663 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528751:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343029.528756:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3663 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528764:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3663 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528776:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdb00) 00010000:00010000:3.0:1763343029.528783:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343029.528790:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3663 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528798:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3663 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528810:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae366a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528823:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae366a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528830:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae366a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528838:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343029.528842:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae366a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528849:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae366a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528869:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3541141a00) 00010000:00010000:3.0:1763343029.528875:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343029.528881:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae366a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528896:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae366a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.528926:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae365c lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac829c expref: 227 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.528943:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdb00) 00010000:00010000:3.0:1763343029.528949:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343029.528955:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae365c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac829c expref: 227 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.528971:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:3.0:1763343029.529018:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56782:x1848997993323136:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 560us (663us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343029.529040:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8708 00000100:00100000:3.0:1763343029.539385:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.539490:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000001:00080000:3.0:1763343029.541614:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939432 is committed 00000004:00080000:3.0:1763343029.541655:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 831 committed 00000004:00080000:3.0:1763343029.541667:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 832 committed 00000004:00080000:3.0:1763343029.541675:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 831 committed 00000004:00080000:3.0:1763343029.541678:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 830 committed 00000004:00080000:3.0:1763343029.541702:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 830 committed 00000004:00080000:3.0:1763343029.541708:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 829 committed 00000100:00100000:3.0:1763343029.541795:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a351fc74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010190208:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.541858:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.542216:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6028 00000100:00100000:3.0:1763343029.542229:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3660:x1848998010190464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.542381:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:3660:x1848998010190464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (465us total) trans 17179871376 rc 0/0 00000100:00100000:3.0:1763343029.542389:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6028 00000004:00080000:3.0:1763343029.542444:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b92300/2, rc 0, transno 17179871376 00000100:00100000:3.0:1763343029.542453:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010190464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.542495:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010190976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.545112:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.545155:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343029.545168:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010191104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.545205:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.545242:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.545279:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010191104 00000100:00100000:3.0:1763343029.545285:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010191104 00000100:00100000:3.0:1763343029.545319:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010190848 00000100:00100000:3.0:1763343029.545323:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010190848 00000100:00100000:3.0:1763343029.545350:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6032 00000100:00100000:3.0:1763343029.545360:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3659:x1848998010191104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343029.545437:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x265:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343029.545443:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x265:0x0] updating lvb mtime from disk: 1763343029 -> 1763343029 00002000:00010000:3.0:1763343029.545449:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x265:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343029.545455:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x265:0x0] updating lvb ctime from disk: 1763343029 -> 1763343029 00002000:00010000:3.0:1763343029.545467:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x265:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343029.545512:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3659:x1848998010191104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (309us total) trans 21474838674 rc 0/0 00000100:00100000:3.0:1763343029.545524:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6032 00000004:00080000:3.0:1763343029.545567:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a4f800/2, rc 0, transno 21474838674 00000100:00100000:3.0:1763343029.545577:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010191104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.551259:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.560408:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.560432:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993324672 00000100:00100000:3.0:1763343029.560438:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993324672 00010000:00010000:3.0:1763343029.560510:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae368d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac82a3 expref: 218 pid: 6525 timeout: 1323 lvb_type: 0 00000100:00100000:3.0:1763343029.560555:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2863 00000100:00100000:3.0:1763343029.560570:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+218:2430:x1848997993324672:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343029.560588:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343029.560598:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae368d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac82a3 expref: 218 pid: 6525 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343029.560615:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae368d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac82a3 expref: 218 pid: 6525 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343029.560654:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae368d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac82a3 expref: 218 pid: 6525 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343029.560668:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b1:0x0].0x0 (ffff9a3538bf7e00) 00010000:00010000:3.0:1763343029.560673:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae36be lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.560682:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae36be lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.560688:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae36be lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.560915:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343029.562150:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+217:2430:x1848997993324672:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1574us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.562161:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2863 00010000:00010000:3.0:1763343029.562196:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae36be lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.562204:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae36be lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343029.562226:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b1:0x0]: returning size 0 00000004:00080000:3.0:1763343029.562397:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x267:0x0], index 0: 0 00000004:00080000:3.0:1763343029.562403:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x269:0x0], index 1: 0 00000004:00080000:3.0:1763343029.562409:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x26a:0x0], index 1: 0 00000004:00080000:3.0:1763343029.562412:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x268:0x0], index 0: 0 00010000:00010000:3.0:1763343029.562618:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae36be lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.562642:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae36be lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.562648:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae36be lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.562654:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343029.562658:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae36be lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.562664:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae36be lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.562680:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b1:0x0].0x0 (ffff9a3538bf7e00) 00010000:00010000:3.0:1763343029.562683:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343029.562687:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae36be lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.562692:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae36be lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.563059:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae36b7 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac82b1 expref: 217 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.563070:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b1:0x0].0x0 (ffff9a3538bf7e00) 00010000:00010000:3.0:1763343029.563073:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343029.563077:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae36b7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac82b1 expref: 217 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.563090:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176e00, rc 0) 00000100:00100000:3.0:1763343029.563406:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+216:56782:x1848997993324544:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 11714us (12155us total) trans 8589939433 rc 301/301 00000100:00100000:3.0:1763343029.563413:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8711 00000100:00100000:3.0:1763343029.565907:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.566490:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.569885:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.578421:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.588541:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.598208:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.605139:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.620100:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.646458:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993327360 00000100:00100000:3.0:1763343029.646475:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993327360 00000100:00100000:3.0:1763343029.646568:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1496 00000100:00100000:3.0:1763343029.646579:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993327360:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:3.0:1763343029.646666:0:28425:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae3743 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x267:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.646682:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.646685:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.646690:0:28425:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae3743 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x267:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.646704:0:28425:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae3743 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x267:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343029.647158:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.663865:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.663988:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.664771:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8720 00000100:00100000:3.0:1763343029.664802:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+220:56783:x1848997993327872:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:3.0:1763343029.664834:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343029.665069:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3758 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac82f7 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.665176:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae375f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.665194:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae375f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.665219:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae375f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343029.676173:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343029.679471:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343029.679487:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae3789 lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.679499:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343029.679505:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae3789 lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.679515:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae3789 lrc: 5/0,0 mode: PW/PW res: [0x200000405:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.679537:0:13198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b1:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:3.0:1763343029.679541:0:13198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343029.679547:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae3789 lrc: 3/0,0 mode: --/PW res: [0x200000405:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.679561:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343029.679563:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343029.679564:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343029.702741:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.704409:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.711958:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.712005:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.716701:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.720196:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.720239:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.720300:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.727016:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993329792 00000100:00100000:3.0:1763343029.727036:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993329792 00000100:00100000:3.0:1763343029.729038:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8727 00000100:00100000:3.0:1763343029.729054:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+222:56784:x1848997993329792:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343029.729075:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343029.729079:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343029.729104:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae37cf lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8313 expref: 222 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.729124:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aabd00) 00010000:00010000:3.0:1763343029.729134:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343029.729149:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae37f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8328 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.730468:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3807 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.730481:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3807 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.730491:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3807 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.730500:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae380e lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.730506:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae380e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.730511:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae380e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.730897:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae3815 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.730906:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae3815 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.730913:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae3815 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343029.730935:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b3:0x0]: returning size 0 00010000:00010000:3.0:1763343029.730962:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3807 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.730968:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3807 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.730973:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3807 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.730980:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3807 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.730986:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343029.730990:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3807 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.730998:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3807 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.731009:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c3500) 00010000:00010000:3.0:1763343029.731012:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343029.731017:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3807 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.731036:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3807 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:3.0:1763343029.731047:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cf0c2972 reply state 00000000c4343538 transno 8589939443 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae380e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.731056:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae380e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343029.731061:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3541141700) 00010000:00010000:3.0:1763343029.731063:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343029.731066:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343029.731093:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae37f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8328 expref: 225 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.731109:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae3815 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8328 expref: 224 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.731116:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b3:0x0].0x0 (ffff9a34037c3b00) 00010000:00010000:3.0:1763343029.731119:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343029.731121:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343029.731184:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:56784:x1848997993329792:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2134us (5079us total) trans 8589939443 rc 0/0 00000100:00100000:3.0:1763343029.731192:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8727 00000100:00100000:3.0:1763343029.737346:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.745686:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993330816 00000100:00100000:3.0:1763343029.745704:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993330816 00010000:00010000:3.0:1763343029.748558:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae382a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343029.748580:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae382a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343029.748612:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b3:0x0]: returning size 0 00000100:00100000:3.0:1763343029.754855:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000004:00010000:3.0:1763343029.762514:0:6527:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000873df423 reply state 00000000743b5144 transno 8589939446 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae3831 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343029.762568:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae3831 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343029.780826:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1af:0x0].0x0 (ffff9a3538bf7c00) 00010000:00010000:3.0:1763343029.780840:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763343029.780848:0:6527:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343029.780863:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1af:0x0].0x0 (ffff9a3538bf7c00) 00010000:00010000:3.0:1763343029.780866:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343029.780877:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405986400/0x607405d401ae360f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1af:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8280 expref: 216 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.782922:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343029.782934:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665c600/0x607405d401ae384d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.782945:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343029.782949:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665c600/0x607405d401ae384d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.782959:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665c600/0x607405d401ae384d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.782991:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665c600/0x607405d401ae384d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.782999:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665c600/0x607405d401ae384d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.783046:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343029.783048:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343029.783051:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343029.783116:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.788358:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343029.789589:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343029.789603:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae3885 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1af:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343029.789614:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403a5fe00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343029.789651:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae3885 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1af:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343029.789662:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae3885 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1af:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343029.789683:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1af:0x0].0x0 (ffff9a3538bf7c00) 00010000:00010000:3.0:1763343029.789687:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343029.789693:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae3885 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1af:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343029.789699:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae3885 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1af:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343029.789725:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343029.789729:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343029.789731:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343029.797215:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.800224:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.807970:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.808032:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.815616:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010194048:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.817040:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.817089:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010194560:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.817118:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.817142:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1763343029.817149:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010194176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.817171:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.817188:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010194688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.817207:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343029.817797:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6055 00000100:00100000:3.0:1763343029.817806:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3657:x1848998010194304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343029.818011:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3657:x1848998010194304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 202us (2479us total) trans 17179871389 rc 0/0 00000100:00100000:3.0:1763343029.818028:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6055 00000100:00100000:3.0:1763343029.818056:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6056 00000100:00100000:3.0:1763343029.818064:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3659:x1848998010194048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343029.818076:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:616 count 1 00010000:00010000:3.0:1763343029.818091:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae38d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.818110:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae37dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac831a expref: 32 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.818126:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343029.818128:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343029.818136:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae38d9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.818198:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae37dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac831a expref: 32 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.818216:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae37dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac831a expref: 32 pid: 28995 timeout: 1323 lvb_type: 0 00000100:00100000:3.0:1763343029.818239:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010194944:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343029.818332:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c540 going to sleep for 11 seconds 00000004:00080000:3.0:1763343029.819160:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340664ad80/2, rc 0, transno 17179871390 00000100:00100000:3.0:1763343029.819173:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340664ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010194176:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343029.821740:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34097a4700/2, rc 0, transno 21474838687 00000100:00100000:3.0:1763343029.821747:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010194688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343029.835737:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2871 00000100:00100000:3.0:1763343029.835750:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2430:x1848997993333888:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343029.835765:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343029.835775:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340665d600/0x607405d401ae37d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac830c expref: 12 pid: 28995 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343029.835794:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340665d600/0x607405d401ae37d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac830c expref: 12 pid: 28995 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343029.835847:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d600/0x607405d401ae37d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x266:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac830c expref: 11 pid: 28995 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343029.835865:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.835868:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343029.835872:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae38e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.836073:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae38e7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.836106:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343029.836140:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+10:2430:x1848997993333888:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 392us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343029.836147:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2871 00010000:00010000:3.0:1763343029.836188:0:28993:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae38e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.836196:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae38e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.836205:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae38e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.836214:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae38e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.836233:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343029.838230:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3659:x1848998010194560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19426us (21108us total) trans 21474838689 rc 0/0 00000100:00100000:3.0:1763343029.838254:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6058 00010000:00010000:3.0:1763343029.839864:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343029.839872:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae38d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.839880:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343029.839884:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae38d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.839893:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae38d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.839911:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae38d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.841644:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae38d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.841677:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343029.841679:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343029.841682:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343029.845706:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.851847:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.854328:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993335040 00000100:00100000:3.0:1763343029.854343:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993335040 00000100:00100000:3.0:1763343029.854414:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2957 00000100:00100000:3.0:1763343029.854425:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+219:55941:x1848997993335040:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:3.0:1763343029.854786:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+220:55941:x1848997993335040:12345-192.168.204.21@tcp:35:bash.0 Request processed in 360us (522us total) trans 8589939455 rc 0/0 00000100:00100000:3.0:1763343029.854797:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2957 00000100:00100000:3.0:1763343029.873429:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993335680 00000100:00100000:3.0:1763343029.873433:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993335680 00000100:00100000:3.0:1763343029.873472:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8738 00000100:00100000:3.0:1763343029.873479:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+222:56785:x1848997993335680:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:3.0:1763343029.873507:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1763343029.873533:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae38c4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8352 expref: 222 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.873553:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae3918 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8375 expref: 221 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.873566:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae38cb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8359 expref: 220 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.873579:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae3893 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac834b expref: 219 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.873589:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b3:0x0].0x0 (ffff9a3403aabd00) 00010000:00010000:3.0:1763343029.873601:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343029.874236:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3926 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343029.874251:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3926 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343029.874261:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3926 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343029.874273:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae392d lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343029.874280:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae392d lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343029.874286:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae392d lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343029.874360:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3934 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343029.874368:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3934 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343029.874374:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3934 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00080000:3.0:1763343029.874603:0:6525:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1b3:0x0] is inserted into orphan list, open count = 1 00000100:00100000:3.0:1763343029.893811:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.899222:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.901114:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.909497:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.919367:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.924515:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.933939:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.945261:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.952909:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993338112 00000100:00100000:3.0:1763343029.952916:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993338112 00000100:00100000:3.0:1763343029.953126:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8748 00000100:00100000:3.0:1763343029.953137:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56786:x1848997993337856:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343029.953147:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343029.953159:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae39f1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac83b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.953236:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae39f8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343029.953261:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae39dc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac83ad expref: 230 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.954420:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae39f8 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343029.955654:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae39dc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac83ad expref: 231 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.955679:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae39dc lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac83ad expref: 231 pid: 10041 timeout: 1323 lvb_type: 0 00000100:00100000:3.0:1763343029.955699:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537969f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010195584:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343029.955830:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c780 going to sleep for 11 seconds 00000100:00100000:3.0:1763343029.959186:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537969f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010195584:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343029.959220:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae39f8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:3.0:1763343029.965472:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.965532:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.976009:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.976060:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.983369:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343029.998597:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993340800 00000100:00100000:3.0:1763343029.998612:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993340800 00000100:00100000:3.0:1763343029.998705:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8754 00000100:00100000:3.0:1763343029.998718:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:55941:x1848997993340800:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343029.998748:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343029.998753:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343029.998791:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae3a5a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac83de expref: 239 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.998817:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b5:0x0].0x0 (ffff9a3538bf7900) 00010000:00010000:3.0:1763343029.998823:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343029.998841:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae3a76 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac83ec expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343029.998900:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3a7d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.998916:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3a7d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343029.998927:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3a7d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000040:00080000:3.0:1763343029.999221:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1273, 88 off108456 00000004:00080000:3.0:1763343029.999230:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1223666608505ns, next at 1224084385298ns, rc = 0 00000040:00080000:3.0:1763343029.999274:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1274, 88 off108456 00000004:00080000:3.0:1763343029.999280:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1223666659006ns, next at 1224084358311ns, rc = 0 00000040:00080000:3.0:1763343029.999305:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1275, 88 off108544 00000004:00080000:3.0:1763343029.999310:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1223666688999ns, next at 1224084358311ns, rc = 0 00000040:00080000:3.0:1763343029.999320:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1274, 88 off108544 00000004:00080000:3.0:1763343029.999324:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1223666702880ns, next at 1224084385298ns, rc = 0 00000001:00080000:3.0:1763343030.003127:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939473 is committed 00000004:00080000:3.0:1763343030.003134:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 840 committed 00000004:00080000:3.0:1763343030.003150:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 839 committed 00000004:00080000:3.0:1763343030.003165:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 838 committed 00000004:00080000:3.0:1763343030.003167:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 839 committed 00010000:00010000:3.0:1763343030.004614:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3a7d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac83ec expref: 223 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.004767:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b5:0x0].0x0 (ffff9a3538bf7900) 00010000:00010000:3.0:1763343030.004772:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343030.004797:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae3a76 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac83ec expref: 223 pid: 10041 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763343030.004830:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3a7d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b5:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac83ec expref: 222 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.004869:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b5:0x0].0x0 (ffff9a3538bf7900) 00010000:00010000:3.0:1763343030.004887:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343030.004890:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343030.004976:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+221:55941:x1848997993340800:12345-192.168.204.21@tcp:101:bash.0 Request processed in 6258us (6635us total) trans 8589939473 rc 0/0 00000100:00100000:3.0:1763343030.004987:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8754 00000004:00080000:3.0:1763343030.006512:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d130e00/2, rc 0, transno 21474838692 00000100:00100000:3.0:1763343030.006520:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010195968:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763343030.006531:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3403ad7800/2, rc 0, transno 17179871396 00000100:00100000:3.0:1763343030.006534:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010196480:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343030.006543:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3403ad4380/2, rc 0, transno 17179871395 00000100:00100000:3.0:1763343030.006546:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010196352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.010056:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.010110:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.015821:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993341952 00000100:00100000:3.0:1763343030.015831:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993341952 00000100:00100000:3.0:1763343030.034795:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993342464 00000100:00100000:3.0:1763343030.034810:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993342464 00000100:00100000:3.0:1763343030.045956:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.054550:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993343232 00000100:00100000:3.0:1763343030.054566:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993343232 00000100:00100000:3.0:1763343030.054689:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8757 00000100:00100000:3.0:1763343030.054701:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:56790:x1848997993343232:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:3.0:1763343030.054780:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763343030.054816:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3a7d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac83ec expref: 224 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.054842:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae3ae6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8408 expref: 223 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.054864:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f600/0x607405d401ae3a68 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac83e5 expref: 222 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.054878:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b5:0x0].0x0 (ffff9a3538bf7900) 00010000:00010000:3.0:1763343030.054893:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343030.054924:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae3af4 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.054940:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae3af4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.054951:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae3af4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.054963:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae3afb lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.054969:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae3afb lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.054975:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae3afb lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.055088:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3b02 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.055097:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3b02 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.055104:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3b02 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.056477:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343030.056485:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ea00/0x607405d401ae3b09 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1b5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.056492:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340683ea00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343030.056495:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ea00/0x607405d401ae3b09 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1b5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.056502:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ea00/0x607405d401ae3b09 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1b5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.056511:0:13198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b5:0x0].0x0 (ffff9a34037c3d00) 00010000:00010000:3.0:1763343030.056513:0:13198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343030.056516:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ea00/0x607405d401ae3b09 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1b5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.056522:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ea00/0x607405d401ae3b09 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1b5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.056540:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343030.056542:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343030.056544:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343030.086753:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.096144:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.124676:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8765 00000100:00100000:3.0:1763343030.124691:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:56791:x1848997993344512:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343030.124722:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343030.124726:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343030.124763:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae3b80 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8432 expref: 224 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.124788:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:3.0:1763343030.124801:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343030.124822:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae3b9c lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8440 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343030.136765:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993345152 00000100:00100000:3.0:1763343030.136779:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993345152 00010000:00010000:3.0:1763343030.136835:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae3bb1 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8440 expref: 229 pid: 10041 timeout: 1323 lvb_type: 0 00000100:00100000:3.0:1763343030.136884:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2875 00000100:00100000:3.0:1763343030.136897:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:2430:x1848997993345152:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343030.136916:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343030.136924:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae3bb1 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8440 expref: 229 pid: 10041 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343030.136938:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae3bb1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8440 expref: 229 pid: 10041 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343030.136965:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b6:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:3.0:1763343030.136972:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae3bcd lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.136983:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae3bcd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.136991:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae3bcd lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.137025:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343030.138719:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:2430:x1848997993345152:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1704us (2409us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.138734:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2875 00000100:00100000:3.0:1763343030.142900:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2971 00000100:00100000:3.0:1763343030.142913:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56791:x1848997993345664:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343030.143038:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56791:x1848997993345664:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 128us (615us total) trans 8589939484 rc 0/0 00000100:00100000:3.0:1763343030.143047:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2971 00000100:00100000:3.0:1763343030.147884:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.162603:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.162715:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.162744:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.163527:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6078 00000100:00100000:3.0:1763343030.163540:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+35:2429:x1848997993346432:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343030.163550:0:10294:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343030.163568:0:10294:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3c13 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8463 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343030.163598:0:10294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x270:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343030.163613:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.163616:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.163665:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3c13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8463 expref: 36 pid: 10294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343030.163681:0:10294:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3c13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8463 expref: 36 pid: 10294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343030.163697:0:10294:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92e00, rc 0) 00000100:00100000:3.0:1763343030.163728:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+36:2429:x1848997993346432:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 189us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.164444:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6078 00000100:00100000:3.0:1763343030.177826:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.189723:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.189779:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.203729:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993348480 00000100:00100000:3.0:1763343030.203745:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993348480 00010000:00010000:3.0:1763343030.203798:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177c00/0x607405d401ae3c60 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8486 expref: 242 pid: 6523 timeout: 1323 lvb_type: 0 00000100:00100000:3.0:1763343030.203848:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2876 00000100:00100000:3.0:1763343030.203860:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:2431:x1848997993348480:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343030.203879:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343030.203887:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177c00/0x607405d401ae3c60 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8486 expref: 242 pid: 6523 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343030.203902:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177c00/0x607405d401ae3c60 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8486 expref: 242 pid: 6523 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343030.203931:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177c00/0x607405d401ae3c60 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8486 expref: 242 pid: 6523 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343030.203955:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b6:0x0].0x0 (ffff9a3403aaba00) 00010000:00010000:3.0:1763343030.203962:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae3c75 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.203976:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae3c75 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.203985:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae3c75 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1b6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.206975:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343030.217510:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010197504:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.218353:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.218386:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010198016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.218416:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.218442:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1763343030.218449:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010197120:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343030.218475:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.220650:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010197632:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343030.221542:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343030.221612:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052aea00/2, rc 0, transno 17179871399 00000100:00100000:3.0:1763343030.221643:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010198016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.221677:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010197632 00000100:00100000:3.0:1763343030.221685:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010197632 00000100:00100000:3.0:1763343030.221718:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010197760 00000100:00100000:3.0:1763343030.221723:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010197760 00000100:00100000:3.0:1763343030.223058:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6085 00000100:00100000:3.0:1763343030.223072:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+60:3659:x1848998010197248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343030.223103:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:621 count 1 00010000:00010000:3.0:1763343030.223129:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae3c91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.223159:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340683e600/0x607405d401ae3aca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8401 expref: 35 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.223168:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343030.223170:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343030.223174:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae3c91 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343030.228479:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010198144:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343030.228496:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d177600/0x607405d401ae3c7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343030.228537:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993348864 00000100:00100000:3.0:1763343030.228544:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993348864 00010000:00010000:3.0:1763343030.228572:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae3a37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac83c9 expref: 36 pid: 15756 timeout: 1323 lvb_type: 1 00000100:00100000:3.0:1763343030.228694:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2878 00000100:00100000:3.0:1763343030.228705:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+36:2432:x1848997993348864:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343030.228717:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343030.228723:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae3a37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac83c9 expref: 36 pid: 15756 timeout: 1323 lvb_type: 1 00010000:00010000:3.0:1763343030.228734:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae3a37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac83c9 expref: 36 pid: 15756 timeout: 1323 lvb_type: 1 00010000:00010000:3.0:1763343030.228760:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae3a37 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac83c9 expref: 36 pid: 15756 timeout: 1323 lvb_type: 1 00010000:00010000:3.0:1763343030.228773:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.228776:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.228780:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae3c83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.228790:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae3c83 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.228812:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343030.228857:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+35:2432:x1848997993348864:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 155us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.229393:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2878 00010000:00010000:3.0:1763343030.229425:0:28993:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae3c83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.229438:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae3c83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.229452:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae3c83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.229462:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae3c83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.229494:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343030.232407:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993348992 00000100:00100000:3.0:1763343030.232425:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993348992 00000100:00100000:3.0:1763343030.232482:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6087 00000100:00100000:3.0:1763343030.232492:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+35:55941:x1848997993348992:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343030.232516:0:8410:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343030.232544:0:8410:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae3c98 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac848d expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343030.232572:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x26f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343030.232595:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.232598:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.232609:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae3c98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac848d expref: 36 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.232650:0:8410:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae3c98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac848d expref: 36 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.232667:0:8410:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343030.232725:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+36:55941:x1848997993348992:12345-192.168.204.21@tcp:101:bash.0 Request processed in 235us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.232734:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6087 00000100:00100000:3.0:1763343030.235492:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993349120 00000100:00100000:3.0:1763343030.235504:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993349120 00010000:00010000:3.0:1763343030.235556:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340683e600/0x607405d401ae3aca lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8401 expref: 36 pid: 8408 timeout: 1323 lvb_type: 0 00000100:00100000:3.0:1763343030.235615:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2880 00000100:00100000:3.0:1763343030.235670:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350921dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+36:2429:x1848997993349120:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343030.235691:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343030.235698:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340683e600/0x607405d401ae3aca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8401 expref: 36 pid: 8408 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343030.235713:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340683e600/0x607405d401ae3aca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8401 expref: 36 pid: 8408 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343030.235741:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340683e600/0x607405d401ae3aca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8401 expref: 36 pid: 8408 timeout: 1323 lvb_type: 0 00010000:00010000:3.0:1763343030.235761:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.235764:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.235769:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae3c91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.235782:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae3c91 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.235823:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343030.238914:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350921dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+35:2429:x1848997993349120:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 3233us (3572us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.238932:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2880 00000100:00100000:3.0:1763343030.241137:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993349376 00000100:00100000:3.0:1763343030.241150:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993349376 00000100:00100000:3.0:1763343030.241212:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6088 00000100:00100000:3.0:1763343030.241223:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:55941:x1848997993349376:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343030.241246:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343030.241270:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae3cc2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac849b expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343030.241300:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x26d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343030.241383:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.241386:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.241400:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae3cc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac849b expref: 14 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.241418:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae3cc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac849b expref: 14 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.241431:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343030.241507:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:55941:x1848997993349376:12345-192.168.204.21@tcp:101:bash.0 Request processed in 285us (2431us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.241514:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6088 00000100:00100000:3.0:1763343030.247380:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.247516:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.263670:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.270081:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.276916:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.285703:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.288318:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.308350:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.310042:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343030.310376:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a34064dce00/0x607405d401ae3cfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.310387:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34064dce00/0x607405d401ae3cfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.310420:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34064dce00/0x607405d401ae3cfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.310430:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34064dce00/0x607405d401ae3cfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.310438:0:27835:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34064dce00/0x607405d401ae3cfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.310445:0:27835:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343030.310449:0:27835:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34064dce00/0x607405d401ae3cfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.310457:0:27835:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34064dce00/0x607405d401ae3cfa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.310471:0:27835:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34064dce00/0x607405d401ae3cfa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.310479:0:27835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34064dce00/0x607405d401ae3cfa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343030.310543:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+37:2430:x1848997993350784:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 33210us (33645us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.310553:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6089 00000100:00100000:3.0:1763343030.315670:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993351680 00000100:00100000:3.0:1763343030.315679:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993351680 00000100:00100000:3.0:1763343030.320594:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993351808 00000100:00100000:3.0:1763343030.320612:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993351808 00000100:00100000:3.0:1763343030.321747:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343030.321765:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010198912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.321867:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.321905:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010199040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343030.324410:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.324514:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010198784 00000100:00100000:3.0:1763343030.324526:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010198784 00000100:00100000:3.0:1763343030.324696:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010198912 00000100:00100000:3.0:1763343030.324702:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010198912 00000100:00100000:3.0:1763343030.324726:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010199168 00000100:00100000:3.0:1763343030.324729:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010199168 00000100:00100000:3.0:1763343030.324747:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010199040 00000100:00100000:3.0:1763343030.324749:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010199040 00000100:00100000:3.0:1763343030.324771:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6090 00000100:00100000:3.0:1763343030.324781:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+62:3658:x1848998010198784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.325072:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+63:3658:x1848998010198784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 291us (3239us total) trans 17179871405 rc 0/0 00000100:00100000:3.0:1763343030.325081:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6090 00000100:00100000:3.0:1763343030.325106:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6091 00000100:00100000:3.0:1763343030.325114:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+62:3660:x1848998010198912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343030.325189:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x270:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343030.325194:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x270:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343030.325197:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x270:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343030.325200:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x270:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343030.325202:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x270:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343030.325249:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+63:3660:x1848998010198912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 137us (3383us total) trans 17179871406 rc 0/0 00000100:00100000:3.0:1763343030.325255:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6091 00000100:00100000:3.0:1763343030.325268:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6092 00000100:00100000:3.0:1763343030.325275:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3657:x1848998010199168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343030.325358:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x26e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343030.325361:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x26e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343030.325363:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x26e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343030.325365:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x26e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343030.325367:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x26e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343030.325394:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3657:x1848998010199168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (3480us total) trans 21474838701 rc 0/0 00000100:00100000:3.0:1763343030.325401:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6092 00000100:00100000:3.0:1763343030.325413:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6093 00000100:00100000:3.0:1763343030.325420:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3660:x1848998010199040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343030.325470:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x26d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343030.325473:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x26d:0x0] updating lvb mtime from disk: 1763343030 -> 1763343030 00002000:00010000:3.0:1763343030.325475:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x26d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343030.325477:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x26d:0x0] updating lvb ctime from disk: 1763343030 -> 1763343030 00002000:00010000:3.0:1763343030.325479:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x26d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343030.325506:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3660:x1848998010199040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (1111us total) trans 21474838702 rc 0/0 00000100:00100000:3.0:1763343030.325512:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6093 00000100:00100000:3.0:1763343030.336002:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.349997:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.353840:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010199424 00000100:00100000:3.0:1763343030.353851:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010199424 00000100:00100000:3.0:1763343030.353916:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993352832 00000100:00100000:3.0:1763343030.353921:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993352832 00000100:00100000:3.0:1763343030.353952:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6095 00000100:00100000:3.0:1763343030.353960:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+37:2429:x1848997993352832:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343030.353973:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763343030.361472:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.366841:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.382365:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.401083:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.410565:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343030.410582:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010199936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343030.410669:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343030.412269:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f38380/2, rc 0, transno 21474838703 00000100:00100000:3.0:1763343030.412274:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010199936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343030.418830:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993354496 00000100:00100000:3.0:1763343030.418844:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993354496 00000100:00100000:3.0:1763343030.418919:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6100 00000100:00100000:3.0:1763343030.418932:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:55941:x1848997993354496:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343030.418958:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343030.418988:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae3df6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac850b expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343030.419034:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x26f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343030.419147:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.419152:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.419167:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae3df6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac850b expref: 16 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.419190:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae3df6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac850b expref: 16 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.419281:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93000, rc 0) 00000100:00100000:3.0:1763343030.420744:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:55941:x1848997993354496:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1804us (2200us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.420757:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6100 00000100:00100000:3.0:1763343030.437714:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993355648 00000100:00100000:3.0:1763343030.437721:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993355648 00000100:00100000:3.0:1763343030.437828:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2979 00000100:00100000:3.0:1763343030.437842:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+222:55941:x1848997993355648:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:3.0:1763343030.439973:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+223:55941:x1848997993355648:12345-192.168.204.21@tcp:35:bash.0 Request processed in 2134us (2372us total) trans 8589939507 rc 0/0 00000100:00100000:3.0:1763343030.439983:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2979 00000100:00100000:3.0:1763343030.457118:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993356032 00000100:00100000:3.0:1763343030.457129:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993356032 00010000:00010000:3.0:1763343030.457176:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a34064dc200/0x607405d401ae3c0c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac845c expref: 18 pid: 8408 timeout: 1324 lvb_type: 1 00000100:00100000:3.0:1763343030.457216:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2883 00000100:00100000:3.0:1763343030.457228:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993356032:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343030.457244:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343030.457273:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a34064dc200/0x607405d401ae3c0c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac845c expref: 18 pid: 8408 timeout: 1324 lvb_type: 1 00010000:00010000:3.0:1763343030.457288:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a34064dc200/0x607405d401ae3c0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac845c expref: 18 pid: 8408 timeout: 1324 lvb_type: 1 00010000:00010000:3.0:1763343030.457312:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34064dc200/0x607405d401ae3c0c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac845c expref: 18 pid: 8408 timeout: 1324 lvb_type: 1 00010000:00010000:3.0:1763343030.457329:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.457331:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.457337:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae3e19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.457347:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae3e19 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.457381:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343030.457436:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993356032:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 210us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.457443:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2883 00000100:00100000:3.0:1763343030.482075:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993356416 00000100:00100000:3.0:1763343030.482090:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993356416 00000100:00100000:3.0:1763343030.486104:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.488095:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.492060:0:6529:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010200320 00000100:00100000:3.0:1763343030.492067:0:6529:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010200320 00000100:00100000:3.0:1763343030.492472:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1848998010200832:0@lo:400:kworker.0 00000100:00100000:3.0:1763343030.492505:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.492531:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1848998010201344:0@lo:400:kworker.0 00000100:00100000:3.0:1763343030.492563:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.492598:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010200704 00000100:00100000:3.0:1763343030.492603:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010200704 00000100:00100000:3.0:1763343030.492662:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010200832 00000100:00100000:3.0:1763343030.492667:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010200832 00000100:00100000:3.0:1763343030.492696:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:3.0:1763343030.492706:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1848998010200704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763343030.492758:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1848998010200704:12345-0@lo:400:kworker.0 Request processed in 52us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.492772:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:3.0:1763343030.492852:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1848998010200832:0@lo:400:kworker.0 00000100:00080000:3.0:1763343030.492903:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1763343030.495777:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1763343030.495788:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1763343030.495842:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1848998010201344:0@lo:400:kworker.0 00000100:00100000:3.0:1763343030.496300:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993357056 00000100:00100000:3.0:1763343030.496308:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993357056 00000100:00100000:3.0:1763343030.496351:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8799 00000100:00100000:3.0:1763343030.496360:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:56799:x1848997993357056:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343030.496375:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343030.496397:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3e90 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac853c expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.496481:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae3e97 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.496496:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae3e97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.496507:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae3e97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343030.496565:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343030.496571:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343030.496611:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae3e90 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac853c expref: 226 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.496778:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae3e97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac853c expref: 225 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.496788:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3512906200) 00010000:00010000:3.0:1763343030.496791:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343030.496794:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93600, rc 0) 00000100:00100000:3.0:1763343030.496833:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:56799:x1848997993357056:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 474us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.496840:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8799 00000100:00100000:3.0:1763343030.500190:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993357184 00000100:00100000:3.0:1763343030.500209:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993357184 00000100:00100000:3.0:1763343030.500308:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6105 00000100:00100000:3.0:1763343030.500320:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+40:56794:x1848997993357184:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343030.500347:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343030.500374:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae3e9e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x270:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8543 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.500416:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3c13 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x270:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8463 expref: 41 pid: 10294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343030.500435:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.500438:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.500444:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae3e9e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x270:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8543 expref: 41 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.500488:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3c13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x270:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8463 expref: 41 pid: 10294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343030.500503:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3c13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x270:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8463 expref: 41 pid: 10294 timeout: 1324 lvb_type: 1 00000100:00100000:3.0:1763343030.500526:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1848998010201600:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343030.500669:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1763343030.502256:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993357312 00000100:00100000:3.0:1763343030.502267:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993357312 00000100:00100000:3.0:1763343030.502339:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8800 00000100:00100000:3.0:1763343030.502349:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:56799:x1848997993357312:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343030.502374:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343030.506235:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3c13 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x270:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8463 expref: 42 pid: 10294 timeout: 1324 lvb_type: 1 00000100:00100000:3.0:1763343030.506253:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1848998010201600:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343030.506309:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae3e9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x270:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8543 expref: 41 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.506321:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93c00, rc 0) 00000100:00100000:3.0:1763343030.506358:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+41:56794:x1848997993357184:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6041us (7853us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.506368:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6105 00000100:00100000:3.0:1763343030.510052:0:6508:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406648000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6508:1848998010201728:192.168.204.21@tcp:105: 00010000:00010000:3.0:1763343030.510081:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343030.510321:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+40:2429:x1848997993357440:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 4525us (4809us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.510337:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2884 00000100:00100000:3.0:1763343030.510375:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993357952 00000100:00100000:3.0:1763343030.510379:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993357952 00002000:00010000:3.0:1763343030.510397:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/624 (0->18446744073709551615) 00002000:00100000:3.0:1763343030.510401:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a353876d880 with x1848997993357952 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343030.510408:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a353876d880. 00000100:00100000:3.0:1763343030.510429:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1510 00000100:00100000:3.0:1763343030.510494:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2430:x1848997993357824:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:3.0:1763343030.510905:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x26e:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:3.0:1763343030.510910:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x26e:0x0] updating lvb mtime from disk: 1763343030 -> 1763343030 00002000:00010000:3.0:1763343030.510913:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x26e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343030.510916:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x26e:0x0] updating lvb ctime from disk: 1763343030 -> 1763343030 00002000:00010000:3.0:1763343030.510919:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x26e:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343030.510960:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993357824:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 512us (876us total) trans 21474838707 rc 0/0 00000100:00100000:3.0:1763343030.510969:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1510 00002000:00010000:3.0:1763343030.510972:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/622 (5->18446744073709551615) 00002000:00100000:3.0:1763343030.510974:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a353876df80 with x1848997993357824 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343030.510979:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a353876df80. 00000100:00100000:3.0:1763343030.520675:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010201984 00000100:00100000:3.0:1763343030.520686:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010201984 00000100:00100000:3.0:1763343030.520744:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6106 00000100:00100000:3.0:1763343030.520753:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:32356:x1848998010201984:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1763343030.520803:0:8407:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 642 00000004:00080000:3.0:1763343030.524931:0:32355:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 0 in progress, 0 in flight, 20 done 00000100:00100000:3.0:1763343030.528951:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993359488 00000100:00100000:3.0:1763343030.528963:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993359488 00000100:00100000:3.0:1763343030.529081:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2982 00000100:00100000:3.0:1763343030.529550:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56799:x1848997993359488:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343030.529878:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56799:x1848997993359488:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 332us (1407us total) trans 8589939514 rc 0/0 00000100:00100000:3.0:1763343030.529886:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2982 00010000:00010000:3.0:1763343030.530425:0:14879:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae3ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343030.530434:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae3ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00000040:00080000:3.0:1763343030.530766:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1286, 88 off109416 00000004:00080000:3.0:1763343030.530778:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1224198156439ns, next at 1225128540585ns, rc = 0 00000040:00080000:3.0:1763343030.530815:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1285, 88 off109416 00000004:00080000:3.0:1763343030.530821:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1224198200459ns, next at 1225128513580ns, rc = 0 00000040:00080000:3.0:1763343030.530849:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1286, 88 off109504 00000004:00080000:3.0:1763343030.530854:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1224198233355ns, next at 1225128513580ns, rc = 0 00000040:00080000:3.0:1763343030.530871:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1287, 88 off109504 00000004:00080000:3.0:1763343030.530875:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1224198254710ns, next at 1225128540585ns, rc = 0 00000100:00100000:3.0:1763343030.533368:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010202240:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.533441:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.533483:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343030.533487:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010202624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.533503:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.533531:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010202368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.533553:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.533571:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343030.533575:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010202496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.533595:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.533645:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010202240 00000100:00100000:3.0:1763343030.533654:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010202240 00000100:00100000:3.0:1763343030.533701:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010202624 00000100:00100000:3.0:1763343030.533704:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010202624 00000100:00100000:3.0:1763343030.533720:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010202368 00000100:00100000:3.0:1763343030.533723:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010202368 00000100:00100000:3.0:1763343030.533738:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010202496 00000100:00100000:3.0:1763343030.533740:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010202496 00000100:00100000:3.0:1763343030.533760:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6108 00000100:00100000:3.0:1763343030.533767:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+69:3660:x1848998010202240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343030.533797:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:625 count 1 00010000:00010000:3.0:1763343030.533828:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92800/0x607405d401ae3f00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x271:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.533854:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae3dfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x271:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8512 expref: 41 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.533863:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343030.533866:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343030.533870:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92800/0x607405d401ae3f00 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x271:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.533902:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae3dfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x271:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8512 expref: 41 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.533919:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae3dfd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x271:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8512 expref: 41 pid: 15756 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343030.533930:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340465c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010203264:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343030.533997:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c300 going to sleep for 11 seconds 00000100:00100000:3.0:1763343030.534029:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6110 00000100:00100000:3.0:1763343030.534037:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+70:3657:x1848998010202368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343030.534049:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:626 count 1 00002000:00010000:3.0:1763343030.534071:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x272:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343030.534077:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3f07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.534085:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.534086:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.534091:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3f07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.534106:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3f07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.534115:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3f07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.534121:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3f07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.534141:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343030.534317:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+71:3657:x1848998010202368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 280us (763us total) trans 17179871414 rc 0/0 00000100:00100000:3.0:1763343030.534325:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6110 00000100:00100000:3.0:1763343030.534345:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6111 00000100:00100000:3.0:1763343030.534350:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+70:3657:x1848998010202496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343030.534400:0:28996:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x26f:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343030.534403:0:28996:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x26f:0x0] updating lvb mtime from disk: 1763343030 -> 1763343030 00002000:00010000:3.0:1763343030.534405:0:28996:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x26f:0x0] updating lvb atime from disk: 1763343030 -> 1763343030 00002000:00010000:3.0:1763343030.534408:0:28996:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x26f:0x0] updating lvb ctime from disk: 1763343030 -> 1763343030 00002000:00010000:3.0:1763343030.534410:0:28996:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x26f:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343030.534433:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+71:3657:x1848998010202496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (837us total) trans 17179871415 rc 0/0 00000100:00100000:3.0:1763343030.534439:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6111 00000100:00100000:3.0:1763343030.534453:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6112 00000100:00100000:3.0:1763343030.534459:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3659:x1848998010203136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343030.534532:0:28996:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x26e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343030.534535:0:28996:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x26e:0x0] updating lvb mtime from disk: 1763343030 -> 1763343030 00002000:00010000:3.0:1763343030.534538:0:28996:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x26e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343030.534540:0:28996:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x26e:0x0] updating lvb ctime from disk: 1763343030 -> 1763343030 00002000:00010000:3.0:1763343030.534542:0:28996:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x26e:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343030.534570:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3659:x1848998010203136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (790us total) trans 21474838709 rc 0/0 00000100:00100000:3.0:1763343030.534576:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6112 00000100:00100000:3.0:1763343030.534590:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6113 00000100:00100000:3.0:1763343030.534597:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3659:x1848998010202752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343030.534608:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:623 count 1 00010000:00010000:3.0:1763343030.534651:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3f0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.534665:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae3df6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac850b expref: 12 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.534673:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343030.534675:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343030.534677:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3f0e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.534703:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae3df6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac850b expref: 12 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.534712:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae3df6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac850b expref: 12 pid: 8407 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343030.534727:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340465d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010203392:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343030.534762:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c540 going to sleep for 11 seconds 00010000:00010000:3.0:1763343030.534791:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343030.534798:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3f07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.534805:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343030.534809:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3f07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.534815:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3f07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.534829:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3f07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.534836:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92e00/0x607405d401ae3f07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.534851:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343030.534853:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343030.534855:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343030.534869:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010202880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343030.534896:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343030.534929:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f3ad80/2, rc 0, transno 17179871415 00000100:00100000:3.0:1763343030.534934:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010202496:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343030.534944:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f38000/2, rc 0, transno 17179871414 00000100:00100000:3.0:1763343030.534947:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010202368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.534956:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343030.534961:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010203008:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343030.534984:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.535005:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010203008 00000100:00100000:3.0:1763343030.535020:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010203008 00000100:00100000:3.0:1763343030.535040:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6115 00000100:00100000:3.0:1763343030.535046:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010203008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343030.535109:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x26d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343030.535112:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x26d:0x0] updating lvb mtime from disk: 1763343030 -> 1763343030 00002000:00010000:3.0:1763343030.535114:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x26d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343030.535116:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x26d:0x0] updating lvb ctime from disk: 1763343030 -> 1763343030 00002000:00010000:3.0:1763343030.535118:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x26d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343030.535148:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3657:x1848998010203008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (163us total) trans 21474838710 rc 0/0 00000100:00100000:3.0:1763343030.535155:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6115 00000004:00080000:3.0:1763343030.535186:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f3bb80/2, rc 0, transno 17179871413 00000100:00100000:3.0:1763343030.535190:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010202624:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343030.535207:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406648380/2, rc 0, transno 21474838710 00000100:00100000:3.0:1763343030.535210:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010203008:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1763343030.535260:0:14879:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000c822d50 reply state 000000004ef0dd17 transno 8589939515 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae3ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343030.535276:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae3ef9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343030.535287:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b6:0x0].0x0 (ffff9a3403aaba00) 00010000:00010000:3.0:1763343030.535290:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763343030.535293:0:14879:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343030.535299:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b6:0x0].0x0 (ffff9a3403aaba00) 00010000:00010000:3.0:1763343030.535302:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343030.535307:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae3cd0 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1b6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac84a2 expref: 218 pid: 6523 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1763343030.535390:0:14879:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763343030.535403:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+218:56794:x1848997993358976:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 10649us (10817us total) trans 8589939515 rc 0/0 00000100:00100000:3.0:1763343030.535411:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2980 00000100:00100000:3.0:1763343030.539407:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340465d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010203392:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343030.539427:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae3f0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343030.544071:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f38380/2, rc 0, transno 17179871416 00000100:00100000:3.0:1763343030.544081:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010202240:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.546689:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993360256 00000100:00100000:3.0:1763343030.546702:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993360256 00000100:00100000:3.0:1763343030.546777:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8805 00000100:00100000:3.0:1763343030.546789:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+219:56794:x1848997993360256:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343030.546820:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343030.546847:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae3f3f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1b6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8566 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.547238:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae3f3f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8566 expref: 220 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.547257:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92e00/0x607405d401ae3f3f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8566 expref: 220 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.547282:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b6:0x0].0x0 (ffff9a3403aaba00) 00010000:00010000:3.0:1763343030.547286:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343030.547291:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92e00, rc 0) 00000100:00100000:3.0:1763343030.547455:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+222:56794:x1848997993360256:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 669us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.547463:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8805 00000100:00100000:3.0:1763343030.562072:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.568946:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993361792 00000100:00100000:3.0:1763343030.568955:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993361792 00010000:00010000:3.0:1763343030.569000:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae3f7e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac857b expref: 228 pid: 28422 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343030.569053:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2889 00000100:00100000:3.0:1763343030.569064:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:2430:x1848997993361792:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343030.569082:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343030.569090:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae3f7e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac857b expref: 228 pid: 28422 timeout: 1324 lvb_type: 0 00010000:00010000:3.0:1763343030.569103:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae3f7e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac857b expref: 228 pid: 28422 timeout: 1324 lvb_type: 0 00010000:00010000:3.0:1763343030.569134:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae3f7e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac857b expref: 228 pid: 28422 timeout: 1324 lvb_type: 0 00010000:00010000:3.0:1763343030.569154:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b9:0x0].0x0 (ffff9a3538bf7700) 00010000:00010000:3.0:1763343030.569159:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae3f93 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.569169:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae3f93 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.569177:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae3f93 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1b9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.569209:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343030.569270:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:2430:x1848997993361792:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 207us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.569279:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2889 00000001:00080000:3.0:1763343030.580435:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939521 is committed 00000004:00080000:3.0:1763343030.580453:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 850 committed 00000004:00080000:3.0:1763343030.580482:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 851 committed 00000004:00080000:3.0:1763343030.580503:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 850 committed 00000004:00080000:3.0:1763343030.580506:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 849 committed 00000100:00100000:3.0:1763343030.583332:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010204416:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343030.583374:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.592398:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010205056:192.168.204.21@tcp:105: 00010000:00010000:3.0:1763343030.592445:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae3f8c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1b9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8582 expref: 222 pid: 10042 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763343030.592472:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae3f93 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8582 expref: 221 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.592515:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3500030600, rc 0) 00000100:00100000:3.0:1763343030.592557:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+221:55941:x1848997993361536:12345-192.168.204.21@tcp:101:bash.0 Request processed in 30349us (30489us total) trans 8589939521 rc 0/0 00000100:00100000:3.0:1763343030.592571:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8810 00000004:00080000:3.0:1763343030.593260:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7f100/2, rc 0, transno 17179871419 00000100:00100000:3.0:1763343030.593321:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010203776:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763343030.594542:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c71500/2, rc 0, transno 21474838715 00000100:00100000:3.0:1763343030.594551:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010204544:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343030.597732:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2984 00000100:00100000:3.0:1763343030.597748:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+222:56794:x1848997993362560:12345-192.168.204.21@tcp:49:lfs.0 00000100:00100000:3.0:1763343030.597907:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+222:56794:x1848997993362560:12345-192.168.204.21@tcp:49:lfs.0 Request processed in 163us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343030.598127:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2984 00000100:00100000:3.0:1763343030.602922:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.607922:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.611149:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993363456 00000100:00100000:3.0:1763343030.611160:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993363456 00000100:00100000:3.0:1763343030.611228:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8812 00000100:00100000:3.0:1763343030.611240:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+222:56794:x1848997993363456:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343030.611277:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343030.611307:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae3fcb lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac859e expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.611513:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3fd2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.611538:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.611553:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.611569:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae3fd9 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.611577:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae3fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.611585:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae3fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.612911:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3fe0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.612933:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.612944:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae3fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343030.612958:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b9:0x0]: returning size 2 00010000:00010000:3.0:1763343030.613088:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3fd2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.613097:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3fd2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.613105:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.613112:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3fd2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.613131:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343030.613139:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3fd2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.613148:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3fd2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.613163:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616d00) 00010000:00010000:3.0:1763343030.613166:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343030.613172:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3fd2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.613179:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae3fd2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.613195:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae3fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.613202:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae3fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.613303:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae3fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.613309:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343030.613313:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae3fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.613324:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae3fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.613332:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404616f00) 00010000:00010000:3.0:1763343030.613335:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343030.613338:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae3fd9 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.613345:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae3fd9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000100:00100000:3.0:1763343030.613642:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993363584 00000100:00100000:3.0:1763343030.613652:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993363584 00000100:00100000:3.0:1763343030.620542:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993363840 00000100:00100000:3.0:1763343030.620558:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993363840 00000100:00100000:3.0:1763343030.620657:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2987 00000100:00100000:3.0:1763343030.620667:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:56794:x1848997993363840:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343030.620963:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:56794:x1848997993363840:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 297us (1670us total) trans 8589939524 rc 0/0 00000100:00100000:3.0:1763343030.620972:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2987 00000100:00100000:3.0:1763343030.621020:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993363968 00000100:00100000:3.0:1763343030.621024:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993363968 00002000:00010000:3.0:1763343030.621050:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/627 (0->18446744073709551615) 00002000:00100000:3.0:1763343030.621055:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d10ea00 with x1848997993363968 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343030.621069:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340d10ea00. 00000100:00100000:3.0:1763343030.621098:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993364096 00000100:00100000:3.0:1763343030.621102:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993364096 00002000:00010000:3.0:1763343030.621116:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/625 (0->18446744073709551615) 00002000:00100000:3.0:1763343030.621119:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537913480 with x1848997993364096 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343030.621127:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537913480. 00000100:00100000:3.0:1763343030.621147:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1512 00000100:00100000:3.0:1763343030.621154:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+40:2429:x1848997993363968:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343030.621359:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x273:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343030.621364:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x273:0x0] updating lvb mtime from disk: 0 -> 1763343030 00002000:00010000:3.0:1763343030.621367:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x273:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343030.621370:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x273:0x0] updating lvb ctime from disk: 0 -> 1763343030 00002000:00010000:3.0:1763343030.621373:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x273:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343030.621401:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+41:2429:x1848997993363968:12345-192.168.204.21@tcp:10:bash.0 Request processed in 246us (983us total) trans 17179871421 rc 0/0 00000100:00100000:3.0:1763343030.621409:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1512 00002000:00010000:3.0:1763343030.621413:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/627 (0->18446744073709551615) 00002000:00100000:3.0:1763343030.621416:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d10ea00 with x1848997993363968 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343030.621420:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340d10ea00. 00000100:00100000:3.0:1763343030.621436:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1513 00000100:00100000:3.0:1763343030.621442:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2429:x1848997993364096:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343030.621549:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x271:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343030.621553:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x271:0x0] updating lvb mtime from disk: 0 -> 1763343030 00002000:00010000:3.0:1763343030.621556:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x271:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343030.621558:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x271:0x0] updating lvb ctime from disk: 0 -> 1763343030 00002000:00010000:3.0:1763343030.621561:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x271:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343030.621586:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993364096:12345-192.168.204.21@tcp:10:bash.0 Request processed in 144us (1105us total) trans 21474838717 rc 0/0 00000100:00100000:3.0:1763343030.621594:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1513 00002000:00010000:3.0:1763343030.621598:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/625 (0->18446744073709551615) 00002000:00100000:3.0:1763343030.621602:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537913480 with x1848997993364096 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343030.621607:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537913480. 00010000:00010000:0.0:1763343030.692244:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a34039e7100) 00010000:00010000:0.0:1763343030.692247:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343030.692251:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae40b2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85e4 expref: 234 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.692262:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d800, rc 0) 00000100:00100000:0.0:1763343030.692399:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56802:x1848997993366656:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 821us (2672us total) trans 8589939530 rc 301/301 00000100:00100000:0.0:1763343030.692407:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8822 00000100:00100000:3.0:1763343030.692768:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343030.693090:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993366784 00000100:00100000:0.0:1763343030.693098:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993366784 00010000:00010000:0.0:1763343030.693124:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4096 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85d6 expref: 233 pid: 28422 timeout: 1324 lvb_type: 0 00000100:00100000:0.0:1763343030.693157:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2895 00000100:00100000:0.0:1763343030.693165:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:2429:x1848997993366784:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343030.693177:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343030.693183:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4096 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85d6 expref: 233 pid: 28422 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343030.693194:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4096 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85d6 expref: 233 pid: 28422 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343030.693210:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4096 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85d6 expref: 233 pid: 28422 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343030.693222:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a34039e7100) 00010000:00010000:0.0:1763343030.693226:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae40ab lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.693239:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae40ab lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.693244:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae40ab lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.693262:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343030.693290:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:2429:x1848997993366784:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 126us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343030.693295:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2895 00000100:00100000:3.0:1763343030.695337:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993367040 00000100:00100000:3.0:1763343030.695348:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993367040 00000100:00100000:3.0:1763343030.695452:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2991 00000100:00100000:3.0:1763343030.695461:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56802:x1848997993367040:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343030.699367:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993367552 00000100:00100000:0.0:1763343030.699382:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993367552 00000100:00100000:0.0:1763343030.699450:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8823 00000100:00100000:0.0:1763343030.699461:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56802:x1848997993367552:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343030.699495:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343030.699527:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae40ce lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac85eb expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343030.699716:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993367296 00000100:00100000:3.0:1763343030.699723:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993367296 00000100:00100000:3.0:1763343030.699765:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2992 00000100:00100000:3.0:1763343030.699773:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56801:x1848997993367296:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343030.700049:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56801:x1848997993367296:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 276us (873us total) trans 8589939533 rc 0/0 00000100:00100000:3.0:1763343030.700057:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2992 00010000:00010000:0.0:1763343030.700653:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae40d5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.700674:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae40d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.700690:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae40d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.700702:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae40dc lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.700710:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae40dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.700717:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae40dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.700831:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae40e3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.700840:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae40e3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.700848:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae40e3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343030.700860:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1bb:0x0]: returning size 0 00010000:00010000:0.0:1763343030.700927:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae40d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.700935:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae40d5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.700942:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae40d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.700949:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343030.700953:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae40d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.700962:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae40d5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.700976:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bfb00) 00010000:00010000:0.0:1763343030.700979:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343030.700984:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae40d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.700994:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae40d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.701017:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae40dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.701024:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae40dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.701029:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae40dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.701034:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343030.701036:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae40dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.701042:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae40dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.701050:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bfd00) 00010000:00010000:0.0:1763343030.701052:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343030.701055:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae40dc lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.701060:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae40dc lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.701099:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae40ce lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85eb expref: 236 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.701119:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae40e3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85eb expref: 235 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.701131:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a34037bf200) 00010000:00010000:0.0:1763343030.701133:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343030.701135:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665da00, rc 0) 00000100:00100000:0.0:1763343030.701180:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56802:x1848997993367552:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1722us (1926us total) trans 8589939534 rc 0/0 00000100:00100000:0.0:1763343030.701188:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8823 00000100:00100000:0.0:1763343030.710592:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993367936 00000100:00100000:0.0:1763343030.710606:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993367936 00000100:00100000:0.0:1763343030.711800:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6127 00000100:00100000:0.0:1763343030.711813:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993367936:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343030.711827:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343030.711842:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4106 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac85f2 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343030.711867:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x273:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343030.711887:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343030.711890:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343030.711901:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4106 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85f2 expref: 13 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343030.711917:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4106 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85f2 expref: 13 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343030.711928:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665dc00, rc 0) 00000100:00100000:0.0:1763343030.711962:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993367936:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 154us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343030.711972:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6127 00000100:00100000:0.0:1763343030.717225:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993368320 00000100:00100000:0.0:1763343030.717240:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993368320 00000100:00100000:0.0:1763343030.717326:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8825 00000100:00100000:0.0:1763343030.717340:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:55941:x1848997993368320:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343030.717374:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343030.717404:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae410d lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8600 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.717449:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4114 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.717467:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4114 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.717480:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4114 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.717658:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae410d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8600 expref: 239 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343030.718156:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:0.0:1763343030.718239:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4114 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8600 expref: 238 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.718251:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:0.0:1763343030.718255:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343030.718259:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d200, rc 0) 00000100:00100000:0.0:1763343030.719069:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:55941:x1848997993368320:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1729us (2119us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343030.719085:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8825 00000100:00100000:3.0:1763343030.723249:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.723290:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343030.723724:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993369088 00000100:00100000:0.0:1763343030.723732:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993369088 00000100:00100000:0.0:1763343030.723803:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8826 00000100:00100000:0.0:1763343030.723814:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993369088:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343030.723891:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343030.723926:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031600/0x607405d401ae40f8 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1bb:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85f9 expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.723950:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:0.0:1763343030.723957:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343030.724502:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae413e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.724576:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae4130 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.724585:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae413e lrc: 4/0,1 mode: --/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343030.724604:0:28422:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae4130 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.724615:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae413e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:0.0:1763343030.735033:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993369472 00000100:00100000:0.0:1763343030.735048:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993369472 00000100:00100000:0.0:1763343030.735137:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2996 00000100:00100000:0.0:1763343030.735152:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56802:x1848997993369472:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:0.0:1763343030.735368:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56802:x1848997993369472:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 218us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343030.735376:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2996 00010000:00010000:3.0:1763343030.738508:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae413e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.738521:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae413e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000001:00080000:3.0:1763343030.738666:0:28422:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939539 00000004:00010000:3.0:1763343030.738723:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000099bcaf8b reply state 00000000060fa67b transno 8589939541 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae413e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.738739:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae413e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.738746:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:3.0:1763343030.738749:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343030.738752:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343030.738866:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:55941:x1848997993369088:12345-192.168.204.21@tcp:36:bash.0 Request processed in 15051us (15573us total) trans 8589939541 rc 0/0 00000100:00100000:3.0:1763343030.738873:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8826 00000020:00080000:3.0:1763343030.738878:0:28422:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343030.749808:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993369728 00000100:00100000:3.0:1763343030.749824:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993369728 00000100:00100000:0.0:1763343030.751239:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993369984 00000100:00100000:0.0:1763343030.751256:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993369984 00000100:00100000:0.0:1763343030.751331:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8828 00000100:00100000:0.0:1763343030.751343:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:55941:x1848997993369728:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343030.751381:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343030.751413:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae4145 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac860e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.751495:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae4145 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac860e expref: 245 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.751513:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae4145 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac860e expref: 245 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.751535:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:0.0:1763343030.751539:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343030.751544:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665da00, rc 0) 00000100:00100000:0.0:1763343030.751633:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:55941:x1848997993369728:12345-192.168.204.21@tcp:101:bash.0 Request processed in 278us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343030.751641:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8828 00000100:00100000:0.0:1763343030.751661:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8829 00000100:00100000:0.0:1763343030.751668:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56803:x1848997993369984:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343030.751675:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343030.751690:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae414c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8615 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.751765:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4153 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.751774:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4153 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.751782:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4153 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.751791:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae415a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.751797:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae415a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.751802:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae415a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.751912:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4161 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.751919:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4161 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.751924:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4161 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343030.751935:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1bb:0x0]: returning size 0 00010000:00010000:0.0:1763343030.752035:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4153 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.752042:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4153 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.752048:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4153 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.752055:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4153 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.752061:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343030.752064:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4153 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.752072:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4153 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.752082:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bf300) 00010000:00010000:0.0:1763343030.752084:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343030.752087:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4153 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.752094:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4153 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.752108:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae415a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.752114:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae415a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.752119:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae415a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.752124:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343030.752127:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae415a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.752137:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae415a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.752144:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bfd00) 00010000:00010000:0.0:1763343030.752146:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343030.752149:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae415a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.752154:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae415a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343030.752194:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae414c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8615 expref: 247 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.752211:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4161 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8615 expref: 246 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.752217:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:0.0:1763343030.752219:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343030.752222:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665ce00, rc 0) 00000100:00100000:0.0:1763343030.752263:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56803:x1848997993369984:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 595us (2403us total) trans 8589939542 rc 0/0 00000100:00100000:0.0:1763343030.752270:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8829 00000100:00100000:0.0:1763343030.761930:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993370496 00000100:00100000:0.0:1763343030.761943:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993370496 00000100:00100000:0.0:1763343030.762026:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2997 00000100:00100000:0.0:1763343030.762037:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56803:x1848997993370496:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343030.762350:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56803:x1848997993370496:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 313us (539us total) trans 8589939543 rc 0/0 00000100:00100000:0.0:1763343030.762359:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2997 00000100:00100000:0.0:1763343030.766736:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010205696:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343030.766775:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae4176 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:3.0:1763343030.769580:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993370752 00000100:00100000:3.0:1763343030.769596:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993370752 00000100:00100000:3.0:1763343030.770926:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8831 00000100:00100000:3.0:1763343030.770943:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56803:x1848997993370752:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343030.770976:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343030.771020:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae417d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8623 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.771170:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4184 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.771190:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4184 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.771210:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4184 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343030.771225:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1bb:0x0]: returning size 0 00010000:00010000:3.0:1763343030.771382:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae417d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8623 expref: 251 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.771410:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4184 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8623 expref: 250 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.771419:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:3.0:1763343030.771423:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1763343030.771428:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:3.0:1763343030.771512:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56803:x1848997993370752:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 574us (2818us total) trans 8589939544 rc 0/0 00000100:00100000:3.0:1763343030.771520:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8831 00000100:00100000:0.0:1763343030.772298:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993370880 00000100:00100000:0.0:1763343030.772318:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993370880 00010000:00010000:0.0:1763343030.772360:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4161 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8615 expref: 250 pid: 6523 timeout: 1324 lvb_type: 0 00000100:00100000:0.0:1763343030.772409:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2897 00000100:00100000:0.0:1763343030.772418:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:2429:x1848997993370880:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343030.772433:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343030.772439:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4161 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8615 expref: 250 pid: 6523 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343030.772451:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4161 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8615 expref: 250 pid: 6523 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343030.772470:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4161 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8615 expref: 250 pid: 6523 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343030.772484:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:0.0:1763343030.772489:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae4176 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.772498:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae4176 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.772506:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae4176 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.772542:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343030.772587:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:2429:x1848997993370880:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 170us (2518us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343030.772594:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2897 00000100:00100000:3.0:1763343030.776411:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993371008 00000100:00100000:3.0:1763343030.776429:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993371008 00000100:00100000:3.0:1763343030.776519:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8832 00000100:00100000:3.0:1763343030.776532:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56803:x1848997993371008:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343030.776563:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343030.776595:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4192 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac862a expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.776769:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae4199 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.776786:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae4176 lrc: 2/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.776797:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae4199 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.776820:0:10041:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae4176 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.776836:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae4199 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.778641:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae3ffc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.778655:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae3ffc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.778664:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae3ffc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.778670:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343030.778675:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae3ffc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.778684:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae3ffc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.778707:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bfd00) 00010000:00010000:3.0:1763343030.778711:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343030.778717:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae3ffc lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.778724:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae3ffc lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.778746:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae408f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.778753:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae408f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.778764:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae408f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.778768:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343030.778771:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae408f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.778776:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae408f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.778782:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bfd00) 00010000:00010000:3.0:1763343030.778785:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343030.778788:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae408f lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.778793:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae408f lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.778813:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae413e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.778817:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae413e lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.778822:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae413e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.778827:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343030.778830:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae413e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.778835:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae413e lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.778842:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:3.0:1763343030.778844:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343030.778847:0:3643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae4199 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.778857:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae413e lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.778862:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae413e lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343030.780815:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010206464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.780864:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.780894:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343030.780899:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010206848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.780920:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.780947:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010205952:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343030.780971:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.780986:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010206592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.781021:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.781038:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1763343030.781044:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010206080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343030.781065:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.781079:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010206720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.781096:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.781129:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010206464 00000100:00100000:3.0:1763343030.781137:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010206464 00000100:00100000:3.0:1763343030.781174:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010206848 00000100:00100000:3.0:1763343030.781178:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010206848 00000100:00100000:3.0:1763343030.781197:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010205952 00000100:00100000:3.0:1763343030.781199:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010205952 00000100:00100000:3.0:1763343030.781215:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010206592 00000100:00100000:3.0:1763343030.781217:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010206592 00000100:00100000:3.0:1763343030.781231:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010206080 00000100:00100000:3.0:1763343030.781233:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010206080 00000100:00100000:3.0:1763343030.781246:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010206720 00000100:00100000:3.0:1763343030.781248:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010206720 00000100:00100000:3.0:1763343030.781262:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6130 00000100:00100000:3.0:1763343030.781270:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:3660:x1848998010206464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343030.781296:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:627 count 1 00010000:00010000:3.0:1763343030.781325:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae41a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.781346:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c000/0x607405d401ae3fc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8597 expref: 40 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.781355:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343030.781357:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343030.781361:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae41a7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.781391:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665c000/0x607405d401ae3fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8597 expref: 40 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.781404:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c000/0x607405d401ae3fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8597 expref: 40 pid: 28996 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343030.781416:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010206976:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343030.781469:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343030.781488:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6131 00000100:00100000:3.0:1763343030.781496:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3660:x1848998010206848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.781720:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+78:3660:x1848998010206848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 224us (797us total) trans 17179871422 rc 0/0 00000100:00100000:3.0:1763343030.781727:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6131 00000100:00100000:3.0:1763343030.781745:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6132 00000100:00100000:3.0:1763343030.781752:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3657:x1848998010205952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343030.781766:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:626 count 1 00002000:00010000:3.0:1763343030.781794:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x272:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343030.781800:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae41ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.781807:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.781809:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.781814:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae41ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.781827:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae41ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.781837:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae41ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.781844:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae41ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.781867:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343030.782083:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3657:x1848998010205952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 331us (1110us total) trans 21474838719 rc 0/0 00000100:00100000:3.0:1763343030.782090:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6132 00000100:00100000:3.0:1763343030.782102:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6133 00000100:00100000:3.0:1763343030.782107:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3657:x1848998010206592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343030.782119:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:628 count 1 00002000:00010000:3.0:1763343030.782135:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x274:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343030.782140:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae41b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.782148:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.782149:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.782152:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae41b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.782161:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae41b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.782169:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae41b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.782177:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae41b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.782191:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343030.782319:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+78:3657:x1848998010206592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 211us (1296us total) trans 17179871423 rc 0/0 00000100:00100000:3.0:1763343030.782327:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6133 00000100:00100000:3.0:1763343030.782339:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6134 00000100:00100000:3.0:1763343030.782344:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3657:x1848998010206080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343030.782407:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343030.782410:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343030.782413:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343030.782415:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343030.782418:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343030.782442:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3657:x1848998010206080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (1376us total) trans 21474838720 rc 0/0 00000100:00100000:3.0:1763343030.782449:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6134 00000100:00100000:3.0:1763343030.782462:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6135 00000100:00100000:3.0:1763343030.782468:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3657:x1848998010206720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343030.782535:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+78:3657:x1848998010206720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (1436us total) trans 17179871424 rc 0/0 00000100:00100000:3.0:1763343030.782541:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6135 00000004:00080000:3.0:1763343030.782602:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d4a80/2, rc 0, transno 17179871422 00000100:00100000:3.0:1763343030.782609:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010206848:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343030.782689:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b9f80/2, rc 0, transno 21474838720 00000100:00100000:3.0:1763343030.782695:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010206080:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343030.782703:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d4700/2, rc 0, transno 17179871424 00000100:00100000:3.0:1763343030.782707:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010206720:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343030.782715:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095bad80/2, rc 0, transno 21474838719 00000100:00100000:3.0:1763343030.782719:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010205952:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763343030.782727:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d6d80/2, rc 0, transno 17179871423 00000100:00100000:3.0:1763343030.782730:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010206592:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763343030.782861:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343030.782870:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae41ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.782879:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343030.782884:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae41ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.782895:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae41ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.782918:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae41ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.782925:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93000/0x607405d401ae41ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.782943:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343030.782946:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae41b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.782959:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343030.782963:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae41b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.782969:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae41b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.782980:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae41b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.782986:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae41b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.782999:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343030.783001:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343030.783012:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343030.798821:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343030.798856:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343030.798885:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343030.799880:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c000/0x607405d401ae3fc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8597 expref: 40 pid: 28996 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343030.799895:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010206976:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343030.799920:0:8408:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae41a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.799930:0:8408:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae41a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.799937:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae41a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.799947:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae41a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.799954:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae41a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.799980:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343030.800293:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+78:3660:x1848998010206464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19021us (19426us total) trans 17179871425 rc 0/0 00000100:00100000:3.0:1763343030.800303:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6130 00000100:00100000:3.0:1763343030.800325:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993371392 00000100:00100000:3.0:1763343030.800331:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993371392 00000100:00100000:3.0:1763343030.800360:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6136 00000100:00100000:3.0:1763343030.800366:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:55941:x1848997993371392:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343030.800384:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343030.800401:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae41bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8631 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.800425:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4106 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85f2 expref: 13 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343030.800432:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.800433:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343030.800437:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae41bc lrc: 4/0,0 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8631 expref: 13 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.800467:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4106 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85f2 expref: 13 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343030.800480:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4106 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85f2 expref: 13 pid: 28996 timeout: 1324 lvb_type: 1 00000100:00100000:3.0:1763343030.800494:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1848998010207104:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343030.800554:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108ce40 going to sleep for 11 seconds 00010000:00010000:0.0:1763343030.800669:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343030.800679:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae41a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.800687:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93c00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343030.800692:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae41a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.800708:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae41a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.800725:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae41a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.800733:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93c00/0x607405d401ae41a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.800754:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343030.800756:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343030.800757:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343030.801273:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343030.801280:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae41a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.801288:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343030.801291:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae41a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.801299:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae41a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.801312:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae41a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.801320:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae41a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.801339:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343030.801340:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343030.801342:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343030.802098:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343030.802174:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993371648 00000100:00100000:0.0:1763343030.802183:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993371648 00000100:00100000:0.0:1763343030.802232:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8833 00000100:00100000:0.0:1763343030.802240:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+223:56803:x1848997993371648:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343030.802268:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343030.802297:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae41c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8638 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.802402:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae41ca lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802418:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae41ca lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802430:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae41ca lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802443:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae41d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802450:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae41d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802457:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae41d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802584:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae41d8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802595:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae41d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802603:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae41d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343030.802615:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1bb:0x0]: returning size 2 00010000:00010000:0.0:1763343030.802751:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae41ca lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802759:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae41ca lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802765:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae41ca lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802772:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae41ca lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802778:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343030.802782:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae41ca lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802789:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae41ca lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802801:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bfe00) 00010000:00010000:0.0:1763343030.802805:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343030.802810:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae41ca lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802816:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae41ca lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802835:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae41d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802841:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae41d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802847:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae41d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802852:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343030.802855:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae41d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802861:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae41d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802867:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bf300) 00010000:00010000:0.0:1763343030.802869:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343030.802872:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae41d1 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802877:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae41d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.802922:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae41c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8638 expref: 226 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.802938:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae41d8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8638 expref: 225 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.802945:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:0.0:1763343030.802949:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343030.802952:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dc000, rc 0) 00000100:00100000:0.0:1763343030.803028:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:56803:x1848997993371648:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 788us (934us total) trans 8589939546 rc 0/0 00000100:00100000:0.0:1763343030.803036:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8833 00000100:00100000:3.0:1763343030.808515:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:1.0:1763343030.813902:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92a00, rc 0) 00000100:00100000:1.0:1763343030.814000:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:55941:x1848997993371392:12345-192.168.204.21@tcp:101:bash.0 Request processed in 13631us (15111us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343030.814023:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6136 00000100:00100000:1.0:1763343030.815740:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343030.815892:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993372032 00000100:00100000:0.0:1763343030.815908:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993372032 00010000:00010000:0.0:1763343030.815960:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4106 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85f2 expref: 13 pid: 28996 timeout: 1324 lvb_type: 1 00000100:00100000:0.0:1763343030.816028:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2900 00000100:00100000:0.0:1763343030.816039:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993372032:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343030.816059:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343030.816065:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4106 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85f2 expref: 13 pid: 28996 timeout: 1324 lvb_type: 1 00010000:00010000:0.0:1763343030.816078:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4106 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85f2 expref: 13 pid: 28996 timeout: 1324 lvb_type: 1 00010000:00010000:0.0:1763343030.816107:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4106 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac85f2 expref: 13 pid: 28996 timeout: 1324 lvb_type: 1 00010000:00010000:0.0:1763343030.816126:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343030.816129:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343030.816139:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae41bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8631 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.816151:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae41bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8631 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.816204:0:27834:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae41bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8631 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343030.816222:0:27834:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060adf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:27834:1848998010207232:192.168.204.21@tcp:105: 00000100:00100000:0.0:1763343030.816342:0:27834:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34050d5240 going to sleep for 11 seconds 00000100:00100000:1.0:1763343030.819697:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343030.819780:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993372160 00000100:00100000:0.0:1763343030.819799:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993372160 00000100:00100000:0.0:1763343030.819866:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2999 00000100:00100000:0.0:1763343030.819876:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56803:x1848997993372160:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:0.0:1763343030.820064:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56803:x1848997993372160:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 188us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343030.820072:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2999 00000100:00100000:1.0:1763343030.820888:0:27834:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060adf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:27834:1848998010207232:192.168.204.21@tcp:105: 00010000:00010000:1.0:1763343030.820924:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343030.822142:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993372032:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 6092us (6403us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343030.822157:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2900 00000100:00100000:3.0:1763343030.822225:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343030.822263:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993372288 00000100:00100000:1.0:1763343030.822275:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993372288 00000100:00100000:0.0:1763343030.823790:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6137 00000100:00100000:0.0:1763343030.823810:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+40:55941:x1848997993372288:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343030.823832:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343030.823857:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc400/0x607405d401ae41e6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac863f expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343030.823883:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x275:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343030.823908:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343030.823911:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343030.823920:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc400/0x607405d401ae41e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac863f expref: 41 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.823937:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc400/0x607405d401ae41e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac863f expref: 41 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.823951:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dc400, rc 0) 00000100:00100000:0.0:1763343030.824036:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+41:55941:x1848997993372288:12345-192.168.204.21@tcp:101:bash.0 Request processed in 234us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343030.824043:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6137 00000100:00100000:0.0:1763343030.828544:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993372544 00000100:00100000:0.0:1763343030.828554:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993372544 00002000:00010000:0.0:1763343030.828597:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/629 (0->18446744073709551615) 00002000:00100000:0.0:1763343030.828602:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d1a4700 with x1848997993372544 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343030.828614:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340d1a4700. 00000100:00100000:0.0:1763343030.828676:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993372416 00000100:00100000:0.0:1763343030.828680:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993372416 00002000:00010000:0.0:1763343030.828695:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/627 (0->18446744073709551615) 00002000:00100000:0.0:1763343030.828698:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d1a5500 with x1848997993372416 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343030.828705:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340d1a5500. 00000100:00100000:0.0:1763343030.828737:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1514 00000100:00100000:0.0:1763343030.828749:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+41:2430:x1848997993372544:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:1.0:1763343030.828798:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1515 00000100:00100000:1.0:1763343030.828822:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993372416:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343030.828937:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x275:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343030.828943:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x275:0x0] updating lvb mtime from disk: 0 -> 1763343030 00002000:00010000:0.0:1763343030.828946:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x275:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343030.828948:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x275:0x0] updating lvb ctime from disk: 0 -> 1763343030 00002000:00010000:0.0:1763343030.828952:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x275:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343030.829032:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+42:2430:x1848997993372544:12345-192.168.204.21@tcp:10:bash.0 Request processed in 283us (685us total) trans 17179871426 rc 0/0 00002000:00010000:1.0:1763343030.829039:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1763343030.829049:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1514 00002000:00010000:1.0:1763343030.829051:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb mtime from disk: 0 -> 1763343030 00002000:00010000:0.0:1763343030.829058:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/629 (0->18446744073709551615) 00002000:00010000:1.0:1763343030.829059:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343030.829068:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb ctime from disk: 0 -> 1763343030 00002000:00010000:1.0:1763343030.829073:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00100000:0.0:1763343030.829081:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d1a4700 with x1848997993372544 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343030.829090:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340d1a4700. 00000100:00100000:1.0:1763343030.829131:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993372416:12345-192.168.204.21@tcp:10:bash.0 Request processed in 317us (725us total) trans 21474838722 rc 0/0 00000100:00100000:1.0:1763343030.829141:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1515 00002000:00010000:1.0:1763343030.829147:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/627 (0->18446744073709551615) 00002000:00100000:1.0:1763343030.829151:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d1a5500 with x1848997993372416 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343030.829160:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340d1a5500. 00000100:00100000:0.0:1763343030.835387:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993372800 00000100:00100000:0.0:1763343030.835399:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993372800 00000100:00100000:0.0:1763343030.835458:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3000 00000100:00100000:0.0:1763343030.835467:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:55941:x1848997993372800:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343030.835765:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:55941:x1848997993372800:12345-192.168.204.21@tcp:35:bash.0 Request processed in 299us (935us total) trans 8589939548 rc 0/0 00000100:00100000:0.0:1763343030.835772:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3000 00000100:00100000:3.0:1763343030.843899:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993373056 00000100:00100000:3.0:1763343030.843913:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993373056 00000100:00100000:3.0:1763343030.843983:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8834 00000100:00100000:3.0:1763343030.843995:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56804:x1848997993373056:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343030.844034:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343030.844064:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae41ed lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8646 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.844221:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae41f4 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.844240:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae4199 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac862a expref: 228 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.844249:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae41d8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8638 expref: 228 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.844259:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae41f4 lrc: 5/0,1 mode: --/CW res: [0x200000405:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343030.844310:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae41d8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8638 expref: 228 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.844324:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae41d8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8638 expref: 228 pid: 10041 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343030.844339:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c251f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010207360:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343030.844455:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae4199 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac862a expref: 228 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.844465:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae4199 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac862a expref: 228 pid: 10041 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343030.844475:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010207488:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343030.844499:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c300 going to sleep for 11 seconds 00000100:00100000:1.0:1763343030.845713:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.849493:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c251f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010207360:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343030.849516:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010207488:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343030.849553:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae41f4 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:1.0:1763343030.853813:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343030.853855:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.854250:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343030.854287:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993373440 00000100:00100000:0.0:1763343030.854304:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993373440 00010000:00010000:0.0:1763343030.854363:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae41d8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8638 expref: 231 pid: 10041 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343030.854391:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993373952 00000100:00100000:1.0:1763343030.854413:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993373952 00000100:00100000:0.0:1763343030.854422:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2901 00000100:00100000:0.0:1763343030.854435:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350921e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:2429:x1848997993373440:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343030.854455:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343030.854464:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae41d8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8638 expref: 232 pid: 10041 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343030.854482:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae41d8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8638 expref: 232 pid: 10041 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343030.854491:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8835 00000100:00100000:1.0:1763343030.854511:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56805:x1848997993373952:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:0.0:1763343030.854528:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae41d8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8638 expref: 232 pid: 10041 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343030.854556:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:0.0:1763343030.854562:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae41f4 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.854573:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae41f4 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.854580:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343030.854687:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350921e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:2429:x1848997993373440:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 254us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343030.854695:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2901 00010000:00010000:1.0:1763343030.855141:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343030.855171:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae4176 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac861c expref: 228 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.855197:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4184 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8623 expref: 227 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.855211:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4114 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8600 expref: 226 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.855222:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:1.0:1763343030.855227:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343030.855255:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4202 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.855321:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4202 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.855331:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4202 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.855344:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4209 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.855350:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4209 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.855356:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4209 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.855430:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4210 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.855439:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae41f4 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8646 expref: 225 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.855446:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4210 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.855480:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae41f4 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8646 expref: 225 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.855494:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae41f4 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8646 expref: 225 pid: 10042 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343030.855510:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010207616:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343030.855602:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340c767780 going to sleep for 11 seconds 00000100:00100000:0.0:1763343030.861762:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343030.862016:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010207616:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343030.862057:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4210 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343030.863021:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343030.863121:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993374208 00000100:00100000:0.0:1763343030.863130:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993374208 00010000:00010000:0.0:1763343030.863165:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae41f4 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8646 expref: 228 pid: 10042 timeout: 1324 lvb_type: 0 00000100:00100000:0.0:1763343030.863198:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2903 00000100:00100000:0.0:1763343030.863206:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:2430:x1848997993374208:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343030.863221:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343030.863227:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae41f4 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8646 expref: 228 pid: 10042 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343030.863241:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae41f4 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8646 expref: 228 pid: 10042 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343030.863266:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae41f4 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1bb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8646 expref: 228 pid: 10042 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343030.863285:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:0.0:1763343030.863291:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4210 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.863303:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4210 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.863309:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4210 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.863316:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae421e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.863322:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae421e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.863328:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae421e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343030.864794:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae421e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343030.864829:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae421e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343030.864994:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1bb:0x0]: returning size 5 00000004:00200000:1.0:1763343030.865012:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343030.865039:0:10042:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae421e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343030.865086:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae4217 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac864d expref: 229 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.865114:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae421e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac864d expref: 228 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.865123:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:1.0:1763343030.865126:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343030.865130:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3500031400, rc 0) 00000100:00100000:1.0:1763343030.865218:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56804:x1848997993374080:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3297us (3471us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343030.865227:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8836 00010000:00010000:0.0:1763343030.866376:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4210 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.866412:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343030.866475:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:2430:x1848997993374208:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 3267us (3456us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343030.866487:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2903 00000100:00100000:1.0:1763343030.870102:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343030.871045:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8837 00000100:00100000:1.0:1763343030.871063:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56804:x1848997993374464:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343030.871099:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343030.871130:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4225 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8654 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.871315:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae422c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.871333:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae422c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.871349:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae422c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343030.871365:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1bb:0x0]: returning size 5 00010000:00010000:1.0:1763343030.871517:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4225 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8654 expref: 230 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.871540:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae422c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8654 expref: 229 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.871551:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:1.0:1763343030.871555:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343030.871559:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:1.0:1763343030.871682:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56804:x1848997993374464:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 625us (1593us total) trans 8589939552 rc 0/0 00000100:00100000:1.0:1763343030.871691:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8837 00000100:00100000:3.0:1763343030.875145:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343030.875217:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993374592 00000100:00100000:1.0:1763343030.875232:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993374592 00000100:00100000:1.0:1763343030.878150:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6138 00000100:00100000:1.0:1763343030.878179:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993374592:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:1.0:1763343030.878241:0:10294:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176c00/0x607405d401ae423a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.878263:0:10294:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae41bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8631 expref: 13 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.878272:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343030.878275:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343030.878279:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176c00/0x607405d401ae423a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.878322:0:10294:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae41bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8631 expref: 13 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.878338:0:10294:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae41bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8631 expref: 13 pid: 8408 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343030.878356:0:10294:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10294:1848998010207744:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343030.878472:0:10294:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340c7673c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343030.880275:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343030.882087:0:10294:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10294:1848998010207744:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343030.882125:0:10294:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d176c00/0x607405d401ae423a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343030.883590:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.887252:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343030.889101:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993374976 00000100:00100000:1.0:1763343030.889119:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993374976 00000100:00100000:1.0:1763343030.889192:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8839 00000100:00100000:1.0:1763343030.889202:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56806:x1848997993374976:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343030.889227:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343030.889257:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4256 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8662 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.889337:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae425d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889353:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae425d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889366:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae425d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889377:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4264 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889384:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4264 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889390:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4264 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889436:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae425d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889442:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae425d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889448:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae425d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889455:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae425d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889461:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343030.889466:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae425d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889474:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae425d lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889486:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e7800) 00010000:00010000:1.0:1763343030.889489:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343030.889494:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae425d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889501:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae425d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889517:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4264 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889523:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4264 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889529:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4264 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889533:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343030.889536:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4264 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889542:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4264 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889548:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e7a00) 00010000:00010000:1.0:1763343030.889551:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343030.889553:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4264 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889559:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4264 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.889586:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4256 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8662 expref: 230 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.889596:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e7800) 00010000:00010000:1.0:1763343030.889599:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343030.889603:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4256 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8662 expref: 230 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.889616:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:1.0:1763343030.889723:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56806:x1848997993374976:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 521us (2471us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343030.889732:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8839 00000100:00100000:3.0:1763343030.892124:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343030.892212:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993375104 00000100:00100000:0.0:1763343030.892225:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993375104 00010000:00010000:0.0:1763343030.892272:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae41bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8631 expref: 16 pid: 8408 timeout: 1324 lvb_type: 0 00000100:00100000:0.0:1763343030.892322:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2904 00000100:00100000:0.0:1763343030.892333:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993375104:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343030.892353:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1763343030.892375:0:13199:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1763343030.892378:0:13199:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763343030.892385:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae41bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8631 expref: 16 pid: 8408 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343030.892400:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae41bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8631 expref: 16 pid: 8408 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343030.892428:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae41bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8631 expref: 16 pid: 8408 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343030.892447:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343030.892449:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343030.892456:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176c00/0x607405d401ae423a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.892466:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176c00/0x607405d401ae423a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.892566:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343030.892673:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993375104:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 340us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343030.892683:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2904 00000100:00100000:3.0:1763343030.893373:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343030.895712:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993375232 00000100:00100000:0.0:1763343030.895732:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993375232 00000100:00100000:0.0:1763343030.895805:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8840 00000100:00100000:0.0:1763343030.895817:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56806:x1848997993375232:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343030.895851:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343030.895881:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae426b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8669 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.895960:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae4272 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.895976:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae4272 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.895991:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae4272 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:0.0:1763343030.896057:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343030.896064:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343030.896109:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae426b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8669 expref: 231 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.896128:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae4272 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8669 expref: 230 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.896139:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bfc00) 00010000:00010000:0.0:1763343030.896143:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343030.896147:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dc200, rc 0) 00000100:00100000:0.0:1763343030.896236:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56806:x1848997993375232:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 421us (2863us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343030.896249:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8840 00000100:00100000:3.0:1763343030.896642:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343030.896936:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993375488 00000100:00100000:1.0:1763343030.896946:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993375488 00000100:00100000:1.0:1763343030.896998:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8841 00000100:00100000:1.0:1763343030.897016:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56804:x1848997993375488:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:1.0:1763343030.897071:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343030.897098:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae421e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac864d expref: 230 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.897116:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:1.0:1763343030.897121:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343030.897150:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4279 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.897161:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4279 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.897169:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4279 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000040:00080000:1.0:1763343030.897467:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1295, 88 off110200 00000004:00080000:1.0:1763343030.897477:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1224564855110ns, next at 1225128513580ns, rc = 0 00000040:00080000:1.0:1763343030.897514:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1296, 88 off110200 00000004:00080000:1.0:1763343030.897519:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1224564898375ns, next at 1225128540585ns, rc = 0 00000040:00080000:1.0:1763343030.897551:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1297, 88 off110288 00000004:00080000:1.0:1763343030.897556:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1224564935088ns, next at 1225128540585ns, rc = 0 00000040:00080000:1.0:1763343030.897567:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1296, 88 off110288 00000004:00080000:1.0:1763343030.897570:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1224564949782ns, next at 1225128513580ns, rc = 0 00000100:00100000:3.0:1763343030.901567:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343030.901910:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993375616 00000100:00100000:0.0:1763343030.901926:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993375616 00000100:00100000:0.0:1763343030.901996:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8842 00000100:00100000:0.0:1763343030.902026:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56806:x1848997993375616:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343030.902058:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343030.902089:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae4280 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8670 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.902192:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4287 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902209:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4287 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902223:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4287 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902232:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae428e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902239:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae428e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902245:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae428e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902291:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4287 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902297:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4287 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902305:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4287 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902312:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4287 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902317:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343030.902321:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4287 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902329:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4287 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902342:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bfc00) 00010000:00010000:0.0:1763343030.902346:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343030.902350:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4287 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902355:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4287 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902371:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae428e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902376:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae428e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902382:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae428e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902386:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343030.902388:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae428e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902397:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae428e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902403:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e7a00) 00010000:00010000:0.0:1763343030.902405:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343030.902407:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae428e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902412:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae428e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.902439:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae4280 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8670 expref: 232 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.902448:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bfc00) 00010000:00010000:0.0:1763343030.902450:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343030.902453:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae4280 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8670 expref: 232 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.902461:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dce00, rc 0) 00000100:00100000:0.0:1763343030.902536:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56806:x1848997993375616:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 519us (985us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343030.902544:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8842 00010000:00010000:1.0:1763343030.904836:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4209 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.904860:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4209 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.904869:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4209 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.904875:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343030.905267:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4209 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.905279:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4209 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343030.905503:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343030.905530:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010207872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343030.905617:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.905703:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010208000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343030.905729:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343030.905773:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010207872 00000100:00100000:3.0:1763343030.905785:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010207872 00000100:00100000:3.0:1763343030.905837:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010208000 00000100:00100000:3.0:1763343030.905839:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010208000 00000100:00100000:3.0:1763343030.905863:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6139 00000100:00100000:3.0:1763343030.905873:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3659:x1848998010207872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343030.906127:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3659:x1848998010207872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 254us (508us total) trans 21474838724 rc 0/0 00000100:00100000:3.0:1763343030.906136:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6139 00000100:00100000:3.0:1763343030.906158:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6140 00000100:00100000:3.0:1763343030.906164:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3657:x1848998010208000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343030.906238:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3657:x1848998010208000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (507us total) trans 21474838725 rc 0/0 00000100:00100000:3.0:1763343030.906244:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6140 00000004:00080000:3.0:1763343030.906290:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b5f80/2, rc 0, transno 21474838725 00000100:00100000:3.0:1763343030.906296:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010208000:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343030.906313:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537968380/2, rc 0, transno 21474838724 00000100:00100000:3.0:1763343030.906317:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537968380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010207872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343030.906483:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343030.906493:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010208128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343030.906526:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343030.906558:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010208128 00000100:00100000:0.0:1763343030.906561:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010208128 00000100:00100000:0.0:1763343030.906591:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6141 00000100:00100000:0.0:1763343030.906598:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+78:3657:x1848998010208128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343030.906720:0:8408:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x275:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343030.906724:0:8408:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x275:0x0] updating lvb mtime from disk: 1763343030 -> 1763343030 00002000:00010000:0.0:1763343030.906727:0:8408:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x275:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343030.906730:0:8408:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x275:0x0] updating lvb ctime from disk: 1763343030 -> 1763343030 00002000:00010000:0.0:1763343030.906733:0:8408:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x275:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343030.906771:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+79:3657:x1848998010208128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 172us (243us total) trans 17179871427 rc 0/0 00000100:00100000:0.0:1763343030.906778:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6141 00000004:00080000:0.0:1763343030.906806:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a4e300/2, rc 0, transno 17179871427 00000100:00100000:0.0:1763343030.906811:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010208128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343030.906822:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010208256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343030.906847:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343030.906873:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010208256 00000100:00100000:0.0:1763343030.906876:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010208256 00000100:00100000:0.0:1763343030.906898:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6142 00000100:00100000:0.0:1763343030.906904:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+79:3659:x1848998010208256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343030.906985:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+80:3659:x1848998010208256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (136us total) trans 17179871428 rc 0/0 00000100:00100000:0.0:1763343030.906992:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6142 00000004:00080000:0.0:1763343030.907027:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052ad500/2, rc 0, transno 17179871428 00000100:00100000:0.0:1763343030.907031:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010208256:0@lo:2:osp-syn-1-0.0 00000004:00010000:0.0:1763343030.907116:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000052d31a56 reply state 00000000164fa999 transno 8589939553 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4279 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.907141:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4279 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343030.907152:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:0.0:1763343030.907156:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343030.907161:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1763343030.907261:0:10041:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343030.907291:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+223:56804:x1848997993375488:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 10274us (10668us total) trans 8589939553 rc 0/0 00000100:00100000:0.0:1763343030.907299:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8841 00010000:00010000:1.0:1763343030.908409:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e7a00) 00010000:00010000:1.0:1763343030.908413:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343030.908421:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4209 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.908430:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4209 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.910126:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4279 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.910144:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4279 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.910152:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4279 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.910158:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343030.910162:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4279 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.910170:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4279 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.910187:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:3.0:1763343030.910190:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343030.910195:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4279 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343030.910201:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4279 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000100:00100000:1.0:1763343030.913352:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993375872 00000100:00100000:1.0:1763343030.913372:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993375872 00000100:00100000:1.0:1763343030.913459:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8843 00000100:00100000:1.0:1763343030.913470:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+221:56806:x1848997993375872:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343030.913499:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343030.913503:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343030.913539:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae4272 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8669 expref: 221 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.913562:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bfc00) 00010000:00010000:1.0:1763343030.913574:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343030.913594:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4295 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8677 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.913742:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae429c lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.913758:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae429c lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.913769:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae429c lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.913785:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae42a3 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.913792:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae42a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.913799:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae42a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.914332:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae42aa lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.914344:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae42aa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.914353:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae42aa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343030.914364:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1bc:0x0]: returning size 0 00010000:00010000:1.0:1763343030.914396:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae429c lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.914403:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae429c lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.914408:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae429c lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.914414:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae429c lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.914420:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343030.914424:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae429c lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.914432:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae429c lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.914441:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e7800) 00010000:00010000:1.0:1763343030.914444:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343030.914448:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae429c lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.914454:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae429c lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00010000:1.0:1763343030.914467:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006ca861b9 reply state 000000004c10447a transno 8589939554 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae42a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.914483:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae42a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.914488:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e7d00) 00010000:00010000:1.0:1763343030.914490:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343030.914493:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343030.914523:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4295 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8677 expref: 223 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.914543:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae42aa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8677 expref: 222 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.914550:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a34039e7700) 00010000:00010000:1.0:1763343030.914553:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343030.914555:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176800, rc 0) 00000100:00100000:1.0:1763343030.917916:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+223:56806:x1848997993375872:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4428us (7463us total) trans 8589939554 rc 0/0 00000100:00100000:1.0:1763343030.917932:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8843 00000100:00100000:1.0:1763343030.918509:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993376000 00000100:00100000:1.0:1763343030.918521:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993376000 00000100:00100000:1.0:1763343030.918577:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8844 00000100:00100000:1.0:1763343030.918588:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+223:56804:x1848997993376000:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343030.919425:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343030.919482:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae42b8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac867e expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.919565:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae42b8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac867e expref: 224 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.919584:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae42b8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac867e expref: 224 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.919606:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:1.0:1763343030.919609:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343030.919614:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176e00, rc 0) 00000100:00100000:1.0:1763343030.919711:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:56804:x1848997993376000:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1124us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343030.919719:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8844 00000100:00100000:3.0:1763343030.922588:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993376256 00000100:00100000:3.0:1763343030.922603:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993376256 00000100:00100000:3.0:1763343030.922712:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8845 00000100:00100000:3.0:1763343030.922723:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:56806:x1848997993376256:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343030.922754:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343030.922780:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae42bf lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8685 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.922932:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae42c6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.922949:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae42aa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8677 expref: 225 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.922959:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae42c6 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.923009:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae42aa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8677 expref: 225 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.923025:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae42aa lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8677 expref: 225 pid: 10041 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343030.923040:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010208384:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343030.923138:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c300 going to sleep for 11 seconds 00000100:00100000:1.0:1763343030.923538:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993376384 00000100:00100000:1.0:1763343030.923546:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993376384 00000100:00100000:1.0:1763343030.923582:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8846 00000100:00100000:1.0:1763343030.923591:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56804:x1848997993376384:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343030.923602:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343030.923617:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae42cd lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac868c expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.923695:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae42d4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.923706:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae42d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.923719:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae42d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343030.923755:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1bb:0x0]: returning size 5 00000004:00200000:1.0:1763343030.923761:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343030.923784:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae42d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343030.923815:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae42cd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac868c expref: 228 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.923835:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae42d4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac868c expref: 227 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.923844:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:1.0:1763343030.923848:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763343030.923852:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00000100:00100000:1.0:1763343030.923898:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56804:x1848997993376384:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 307us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343030.923906:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8846 00000100:00100000:3.0:1763343030.936966:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010208384:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343030.937015:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae42c6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:0.0:1763343030.937290:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993376640 00000100:00100000:0.0:1763343030.937301:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993376640 00000100:00100000:1.0:1763343030.937423:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993376512 00000100:00100000:1.0:1763343030.937428:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993376512 00010000:00010000:1.0:1763343030.937458:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae42aa lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8677 expref: 227 pid: 10041 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343030.937496:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2905 00000100:00100000:1.0:1763343030.937505:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:2429:x1848997993376512:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343030.937527:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343030.937535:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae42aa lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8677 expref: 227 pid: 10041 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343030.937549:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae42aa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8677 expref: 227 pid: 10041 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343030.937582:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae42aa lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8677 expref: 227 pid: 10041 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343030.937602:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a34039e7700) 00010000:00010000:1.0:1763343030.937607:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae42c6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343030.937617:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae42c6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343030.937664:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae42c6 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343030.937690:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343030.937752:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:2429:x1848997993376512:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 246us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343030.937760:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2905 00000100:00100000:0.0:1763343030.938742:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6143 00000100:00100000:0.0:1763343030.938758:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993376640:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343030.938781:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343030.938809:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae42db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8693 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343030.938838:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x273:0x0] initial LVB size: 5, mtime: 0x691a7ab6, atime: 0x0, ctime: 0x691a7ab6, blocks: 0x8 00010000:00010000:0.0:1763343030.938859:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343030.938862:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343030.938874:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae42db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8693 expref: 15 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343030.938891:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae42db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8693 expref: 15 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343030.938904:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665dc00, rc 0) 00000100:00100000:0.0:1763343030.938948:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993376640:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 196us (1773us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343030.938958:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6143 00010000:00010000:3.0:1763343030.940155:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae42c6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.940171:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae42c6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343030.940205:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1bc:0x0]: returning size 0 00000004:00080000:3.0:1763343030.940456:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x277:0x0], index 1: 0 00000004:00080000:3.0:1763343030.940464:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x275:0x0], index 0: 0 00000004:00080000:3.0:1763343030.940469:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x276:0x0], index 0: 0 00000004:00080000:3.0:1763343030.940473:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x278:0x0], index 1: 0 00010000:00010000:3.0:1763343030.940612:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae42c6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.940664:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae42c6 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.940671:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae42c6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.940678:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343030.940683:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae42c6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.940691:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae42c6 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.940713:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a34039e7700) 00010000:00010000:3.0:1763343030.940717:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343030.940722:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae42c6 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.940728:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae42c6 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343030.940789:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae42bf lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8685 expref: 226 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.940801:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a34039e7700) 00010000:00010000:3.0:1763343030.940804:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343030.940808:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae42bf lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8685 expref: 226 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343030.940823:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:3.0:1763343030.940894:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:56806:x1848997993376256:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 18172us (18492us total) trans 8589939555 rc 301/301 00000100:00100000:3.0:1763343030.940903:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8845 00000100:00100000:0.0:1763343030.952885:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993376896 00000100:00100000:0.0:1763343030.952904:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993376896 00000100:00100000:0.0:1763343030.952991:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3002 00000100:00100000:0.0:1763343030.953014:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:56806:x1848997993376896:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343030.956181:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56806:x1848997993376896:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 3161us (4274us total) trans 8589939556 rc 0/0 00000100:00100000:0.0:1763343030.956202:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3002 00000100:00100000:0.0:1763343030.960522:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.960665:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993377152 00000100:00100000:3.0:1763343030.960681:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993377152 00000100:00100000:3.0:1763343030.960975:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3003 00000100:00100000:3.0:1763343030.960989:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56806:x1848997993377152:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343030.962129:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56806:x1848997993377152:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1133us (1613us total) trans 8589939557 rc 0/0 00000100:00100000:3.0:1763343030.962144:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3003 00000100:00100000:1.0:1763343030.985354:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343030.985448:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993377408 00000100:00100000:3.0:1763343030.985461:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993377408 00000100:00100000:3.0:1763343030.985548:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8847 00000100:00100000:3.0:1763343030.985561:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:55941:x1848997993377408:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343030.985596:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763343030.990201:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993377536 00000100:00100000:3.0:1763343030.990214:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993377536 00000100:00100000:0.0:1763343030.990483:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8848 00000100:00100000:0.0:1763343030.990500:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:55941:x1848997993377536:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343030.990531:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343030.990559:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae430c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac86a1 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343030.990605:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4313 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.990743:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4313 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343030.990762:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4313 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343030.991047:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae430c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86a1 expref: 231 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.991070:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4313 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86a1 expref: 230 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.991080:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a35167a9b00) 00010000:00010000:1.0:1763343030.991083:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343030.991088:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d800, rc 0) 00000100:00100000:1.0:1763343030.991209:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:55941:x1848997993377536:12345-192.168.204.21@tcp:101:bash.0 Request processed in 714us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343030.991217:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8848 00000100:00100000:0.0:1763343030.996486:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343030.997830:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993377920 00000100:00100000:0.0:1763343030.997843:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993377920 00000100:00100000:1.0:1763343030.998284:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993377792 00000100:00100000:1.0:1763343030.998292:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993377792 00000100:00100000:1.0:1763343030.998346:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8849 00000100:00100000:1.0:1763343030.998358:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:55941:x1848997993377792:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:1.0:1763343030.998438:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343030.998477:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae42fe lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac869a expref: 230 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343030.998501:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a35167a9b00) 00010000:00010000:1.0:1763343030.998508:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343030.998784:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6144 00000100:00100000:0.0:1763343030.998796:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993377920:12345-192.168.204.21@tcp:23:lfs.0 00010000:00010000:1.0:1763343030.998804:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae431a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343030.998821:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae431a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343030.998831:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae431a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000001:00080000:1.0:1763343030.998900:0:10042:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939559 00000004:00010000:1.0:1763343030.998927:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000c822d50 reply state 0000000067ae5d07 transno 8589939560 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae431a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343030.998941:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae431a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343030.998947:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a35167a9b00) 00010000:00010000:1.0:1763343030.998951:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343030.998954:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343030.999784:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993377920:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 983us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343030.999785:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:55941:x1848997993377792:12345-192.168.204.21@tcp:36:bash.0 Request processed in 1425us (3310us total) trans 8589939560 rc 0/0 00000100:00100000:1.0:1763343030.999797:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8849 00000100:00100000:0.0:1763343030.999797:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6144 00000020:00080000:1.0:1763343030.999804:0:10042:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343031.005906:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010208512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1763343031.006013:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343031.007887:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343031.007905:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010208640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1763343031.007965:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343031.008032:0:8851:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010208512 00000100:00100000:1.0:1763343031.008044:0:8851:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010208512 00000100:00100000:1.0:1763343031.008129:0:8851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:1.0:1763343031.008140:0:8851:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+80:3660:x1848998010208512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1763343031.008171:0:8851:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 485015488 pending 114688 free 3919171584 avail 3687649280 00000100:00100000:1.0:1763343031.008225:0:8851:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+80:3660:x1848998010208512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.008235:0:8851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:1.0:1763343031.008344:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.008447:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.008475:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993378048 00000100:00100000:1.0:1763343031.008479:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993378048 00000100:00100000:1.0:1763343031.008510:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8850 00000100:00100000:1.0:1763343031.008518:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:55941:x1848997993378048:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343031.008537:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.008565:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4321 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac86a8 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.008668:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4321 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86a8 expref: 233 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.008687:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4321 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86a8 expref: 233 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.008718:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a35167a9b00) 00010000:00010000:1.0:1763343031.008721:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343031.008726:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:1.0:1763343031.008772:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:55941:x1848997993378048:12345-192.168.204.21@tcp:101:bash.0 Request processed in 254us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.008778:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8850 00000100:00100000:1.0:1763343031.008810:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993378176 00000100:00100000:1.0:1763343031.008814:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993378176 00000100:00100000:1.0:1763343031.008852:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6145 00000100:00100000:1.0:1763343031.008859:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993378176:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:3.0:1763343031.008929:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010208512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1763343031.008936:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993378176:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 78us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.008942:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6145 00000100:00100000:1.0:1763343031.009818:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010208640 00000100:00100000:1.0:1763343031.009825:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010208640 00000100:00100000:1.0:1763343031.010875:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1763343031.010888:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+20:3658:x1848998010208640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1763343031.010923:0:8411:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484929472 pending 28672 free 3920236544 avail 3688714240 00000100:00100000:1.0:1763343031.011022:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+20:3658:x1848998010208640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (3055us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.011030:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1763343031.017297:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8851 00000100:00100000:1.0:1763343031.017314:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:55941:x1848997993378432:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343031.017343:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.017347:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343031.017386:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4321 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86a8 expref: 233 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.017413:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a35167a9b00) 00010000:00010000:1.0:1763343031.017420:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343031.017441:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae4328 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac86af expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.017506:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae432f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.017523:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae432f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.017534:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae432f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000040:00080000:1.0:1763343031.017872:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1298, 88 off110376 00000004:00080000:1.0:1763343031.017883:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1224685261690ns, next at 1225128540585ns, rc = 0 00000040:00080000:1.0:1763343031.017931:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1297, 88 off110376 00000004:00080000:1.0:1763343031.017938:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1224685317253ns, next at 1225128513580ns, rc = 0 00000040:00080000:1.0:1763343031.017967:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1298, 88 off110464 00000004:00080000:1.0:1763343031.017972:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1224685351398ns, next at 1225128513580ns, rc = 0 00000040:00080000:1.0:1763343031.017981:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1299, 88 off110464 00000004:00080000:1.0:1763343031.017984:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1224685363453ns, next at 1225128540585ns, rc = 0 00000001:00080000:0.0:1763343031.019688:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939561 is committed 00000004:00080000:0.0:1763343031.019703:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 856 committed 00000004:00080000:0.0:1763343031.019719:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 857 committed 00000004:00080000:0.0:1763343031.019730:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 856 committed 00000004:00080000:0.0:1763343031.019732:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 855 committed 00000100:00100000:0.0:1763343031.019835:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a350121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010209024:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.019839:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010208768:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1763343031.019905:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae42a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.019918:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae42a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.019931:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae42a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.019939:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.019944:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae42a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.019953:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae42a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.019969:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e7d00) 00010000:00010000:1.0:1763343031.019972:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.019978:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae42a3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.019985:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae42a3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.020025:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae431a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.020050:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae431a lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.020055:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae431a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.020061:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.020063:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae431a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.020068:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae431a lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.020077:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a35167a9b00) 00000100:00100000:0.0:1763343031.020139:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343031.020196:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343031.020202:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010209152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.020226:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343031.020266:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6146 00000100:00100000:0.0:1763343031.020276:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3659:x1848998010209024:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343031.020322:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.020327:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae431a lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000100:00100000:0.0:1763343031.020483:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3659:x1848998010209024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (343us total) trans 21474838726 rc 0/0 00000100:00100000:0.0:1763343031.020492:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6146 00000004:00080000:0.0:1763343031.020551:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a350121aa00/2, rc 0, transno 21474838726 00000100:00100000:0.0:1763343031.020558:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a350121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010209024:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343031.020599:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae431a lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1bc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.020721:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae432f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1bc:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86af expref: 225 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.020731:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a35167a9b00) 00010000:00010000:1.0:1763343031.020734:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343031.020752:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae4328 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86af expref: 225 pid: 10042 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343031.020768:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae432f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1bc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86af expref: 224 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.020799:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a35167a9b00) 00010000:00010000:1.0:1763343031.020802:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343031.020805:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00000100:00100000:1.0:1763343031.020860:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:55941:x1848997993378432:12345-192.168.204.21@tcp:101:bash.0 Request processed in 3552us (4531us total) trans 8589939561 rc 0/0 00000100:00100000:1.0:1763343031.020868:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8851 00000100:00100000:3.0:1763343031.024206:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.024271:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010208896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.024345:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343031.024484:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010208768 00000100:00100000:0.0:1763343031.024496:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010208768 00000100:00100000:0.0:1763343031.024563:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010208896 00000100:00100000:0.0:1763343031.024567:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010208896 00000100:00100000:0.0:1763343031.024598:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6148 00000100:00100000:0.0:1763343031.024608:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+81:3658:x1848998010208768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.024874:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+82:3658:x1848998010208768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 267us (678us total) trans 17179871430 rc 0/0 00000100:00100000:0.0:1763343031.024882:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6148 00000100:00100000:0.0:1763343031.024903:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6149 00000100:00100000:0.0:1763343031.024910:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3658:x1848998010208896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343031.025021:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3658:x1848998010208896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (673us total) trans 21474838727 rc 0/0 00000100:00100000:0.0:1763343031.025028:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6149 00000004:00080000:3.0:1763343031.025139:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b4700/2, rc 0, transno 17179871430 00000100:00100000:3.0:1763343031.025147:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010208768:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343031.025159:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34097a6d80/2, rc 0, transno 21474838727 00000100:00100000:3.0:1763343031.025163:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010208896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343031.026419:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993378560 00000100:00100000:1.0:1763343031.026430:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993378560 00000100:00100000:1.0:1763343031.026499:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1516 00000100:00100000:1.0:1763343031.026509:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354151e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993378560:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:1.0:1763343031.026577:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177200/0x607405d401ae4336 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.026596:0:8415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.026600:0:8415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.026607:0:8415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177200/0x607405d401ae4336 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.026656:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177200/0x607405d401ae4336 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.026796:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177200/0x607405d401ae4336 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.026806:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177200/0x607405d401ae4336 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.026816:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d177200/0x607405d401ae4336 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.026824:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.026828:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177200/0x607405d401ae4336 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.026838:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177200/0x607405d401ae4336 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.026857:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d177200/0x607405d401ae4336 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.026869:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177200/0x607405d401ae4336 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343031.026942:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354151e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993378560:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 434us (690us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763343031.026951:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1516 00000100:00100000:3.0:1763343031.028287:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993378688 00000100:00100000:3.0:1763343031.028301:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993378688 00000100:00100000:3.0:1763343031.028364:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6150 00000100:00100000:3.0:1763343031.028373:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+42:55941:x1848997993378688:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343031.028393:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.028417:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae433d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac86b6 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343031.028453:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x277:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343031.028681:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.028684:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.028695:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae433d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86b6 expref: 43 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.028712:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae433d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86b6 expref: 43 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.028726:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343031.028849:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+43:55941:x1848997993378688:12345-192.168.204.21@tcp:101:bash.0 Request processed in 476us (2507us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.028857:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6150 00000100:00080000:3.0:1763343031.028883:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763343031.032875:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993378944 00000100:00100000:1.0:1763343031.032876:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993378816 00000100:00100000:3.0:1763343031.032888:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993378944 00000100:00100000:1.0:1763343031.032888:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993378816 00000100:00100000:3.0:1763343031.032959:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6151 00000100:00100000:1.0:1763343031.032959:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8852 00000100:00100000:3.0:1763343031.032970:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:55941:x1848997993378944:12345-192.168.204.21@tcp:101:bash.0 00000100:00100000:1.0:1763343031.032970:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:56804:x1848997993378816:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.032994:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.032994:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.033028:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae434b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac86c4 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.033029:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4344 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac86bd expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343031.033060:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x275:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343031.033072:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae4352 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.033083:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.033085:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.033087:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae4352 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.033095:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae434b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86c4 expref: 16 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.033101:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae4352 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.033109:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae434b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86c4 expref: 16 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.033122:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:3.0:1763343031.033187:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:55941:x1848997993378944:12345-192.168.204.21@tcp:101:bash.0 Request processed in 219us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.033194:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6151 00010000:00010000:1.0:1763343031.033254:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4344 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86bd expref: 226 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.033276:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176c00/0x607405d401ae4352 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86bd expref: 225 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.033290:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:1.0:1763343031.033293:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343031.033297:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176c00, rc 0) 00000100:00100000:1.0:1763343031.034448:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:56804:x1848997993378816:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1471us (2383us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.034459:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8852 00000100:00100000:3.0:1763343031.038549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.038591:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.038675:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.038953:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993379072 00000100:00100000:0.0:1763343031.038967:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993379072 00000100:00100000:0.0:1763343031.039064:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993379200 00000100:00100000:0.0:1763343031.039068:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993379200 00002000:00010000:0.0:1763343031.039084:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/631 (0->18446744073709551615) 00002000:00100000:0.0:1763343031.039089:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b4e00 with x1848997993379200 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343031.039106:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34095b4e00. 00000100:00100000:0.0:1763343031.039130:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993379328 00000100:00100000:0.0:1763343031.039134:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993379328 00002000:00010000:0.0:1763343031.039152:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/629 (0->18446744073709551615) 00002000:00100000:0.0:1763343031.039155:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b7800 with x1848997993379328 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343031.039162:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34095b7800. 00000100:00100000:0.0:1763343031.039190:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1517 00000100:00100000:0.0:1763343031.039201:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2429:x1848997993379072:12345-192.168.204.21@tcp:4:lfs.0 00002000:00010000:0.0:1763343031.039267:0:24021:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x276:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343031.039281:0:24021:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae4359 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.039297:0:24021:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.039300:0:24021:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.039307:0:24021:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae4359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.039323:0:24021:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae4359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343031.039440:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1518 00000100:00100000:1.0:1763343031.039451:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2430:x1848997993379200:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:1.0:1763343031.039605:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x277:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343031.039609:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x277:0x0] updating lvb mtime from disk: 0 -> 1763343030 00002000:00010000:1.0:1763343031.039612:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x277:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.039614:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x277:0x0] updating lvb ctime from disk: 0 -> 1763343030 00002000:00010000:1.0:1763343031.039617:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x277:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343031.039729:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+45:2430:x1848997993379200:12345-192.168.204.21@tcp:10:bash.0 Request processed in 279us (1136us total) trans 17179871431 rc 0/0 00000100:00100000:1.0:1763343031.039747:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1518 00002000:00010000:1.0:1763343031.039752:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/631 (0->18446744073709551615) 00002000:00100000:1.0:1763343031.039755:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b4e00 with x1848997993379200 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343031.039760:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34095b4e00. 00000100:00100000:1.0:1763343031.039782:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1519 00000100:00100000:1.0:1763343031.039790:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993379328:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:1.0:1763343031.039892:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x275:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343031.039895:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x275:0x0] updating lvb mtime from disk: 0 -> 1763343030 00002000:00010000:1.0:1763343031.039899:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x275:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.039902:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x275:0x0] updating lvb ctime from disk: 0 -> 1763343030 00002000:00010000:1.0:1763343031.039904:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x275:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343031.040191:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993379328:12345-192.168.204.21@tcp:10:bash.0 Request processed in 401us (1514us total) trans 21474838728 rc 0/0 00000100:00100000:1.0:1763343031.040199:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1519 00002000:00010000:1.0:1763343031.040202:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/629 (0->18446744073709551615) 00002000:00100000:1.0:1763343031.040205:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b7800 with x1848997993379328 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343031.040210:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34095b7800. 00000001:00080000:1.0:1763343031.045737:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871432 is committed 00000001:00080000:1.0:1763343031.045769:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871430 is committed 00002000:00010000:0.0:1763343031.046298:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x276:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763343031.046305:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x276:0x0] updating lvb mtime from disk: 0 -> 1763343030 00002000:00010000:0.0:1763343031.046308:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x276:0x0] updating lvb ctime from disk: 0 -> 1763343030 00002000:00010000:0.0:1763343031.046311:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x276:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763343031.046329:0:24021:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae4359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.046342:0:24021:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae4359 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.046352:0:24021:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae4359 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.046359:0:24021:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343031.046364:0:24021:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae4359 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.046374:0:24021:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae4359 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.046405:0:24021:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae4359 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.046413:0:24021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae4359 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343031.046551:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993379072:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 7341us (8008us total) trans 17179871432 rc 0/0 00000100:00100000:0.0:1763343031.046565:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1517 00000100:00100000:3.0:1763343031.047757:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.048391:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993379584 00000100:00100000:0.0:1763343031.048407:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993379584 00000100:00100000:0.0:1763343031.048492:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3004 00000100:00100000:0.0:1763343031.048504:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:55941:x1848997993379584:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343031.049040:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:55941:x1848997993379584:12345-192.168.204.21@tcp:35:bash.0 Request processed in 536us (1290us total) trans 8589939562 rc 0/0 00000100:00100000:0.0:1763343031.049052:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3004 00000100:00100000:1.0:1763343031.065919:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993379712 00000100:00100000:1.0:1763343031.065933:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993379712 00000100:00100000:1.0:1763343031.066026:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8853 00000100:00100000:1.0:1763343031.066039:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56807:x1848997993379712:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:1.0:1763343031.066074:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.066105:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4360 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac86cb expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.066197:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4367 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.066215:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4367 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.066228:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4367 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.066243:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae436e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.066250:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae436e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.066256:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae436e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.066360:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4375 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.066371:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4375 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067158:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4375 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343031.067216:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1bc:0x0]: returning size 5 00000004:00200000:1.0:1763343031.067222:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343031.067248:0:10042:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4375 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067261:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4375 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067273:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4367 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067280:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4367 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067286:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4367 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067292:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4367 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067302:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.067307:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4367 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067314:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4367 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067325:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:1.0:1763343031.067329:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.067335:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4367 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067340:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4367 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067358:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae436e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067363:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae436e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067368:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae436e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067372:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.067374:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae436e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067380:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae436e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067386:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdc800) 00010000:00010000:1.0:1763343031.067388:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.067392:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae436e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.067397:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae436e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.068358:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4360 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86cb expref: 228 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.068383:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4375 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86cb expref: 227 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.068392:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a35167a9b00) 00010000:00010000:1.0:1763343031.068396:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343031.068399:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:1.0:1763343031.068509:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56807:x1848997993379712:12345-192.168.204.21@tcp:101:rm.0 Request processed in 2471us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.068519:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8853 00000100:00100000:3.0:1763343031.071179:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.071414:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993379968 00000100:00100000:1.0:1763343031.071429:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993379968 00000100:00100000:1.0:1763343031.072524:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8854 00000100:00100000:1.0:1763343031.072542:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56804:x1848997993379968:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:1.0:1763343031.072614:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.072665:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae42d4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1bb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac868c expref: 227 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.072691:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:1.0:1763343031.072696:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343031.072780:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae437c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.072798:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae437c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.072809:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae437c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00010000:1.0:1763343031.072949:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000042f23ced reply state 0000000048aee2a9 transno 8589939563 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae437c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.072963:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae437c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.072969:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:1.0:1763343031.072972:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343031.072975:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343031.073109:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56804:x1848997993379968:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 573us (1945us total) trans 8589939563 rc 0/0 00000100:00100000:1.0:1763343031.073118:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8854 00000100:00100000:3.0:1763343031.075913:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.075979:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993380224 00000100:00100000:1.0:1763343031.075994:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993380224 00000100:00100000:1.0:1763343031.076468:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8855 00000100:00100000:1.0:1763343031.076482:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56807:x1848997993380224:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:1.0:1763343031.076557:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343031.076593:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae432f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1bc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86af expref: 228 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343031.076692:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:1.0:1763343031.076880:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4375 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86cb expref: 227 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.076898:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4313 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1bc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86a1 expref: 226 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.076912:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a35167a9b00) 00000100:00100000:0.0:1763343031.076917:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993380352 00000100:00100000:0.0:1763343031.076925:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993380352 00010000:00010000:1.0:1763343031.076926:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343031.076963:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4383 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00000100:00100000:0.0:1763343031.076976:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6152 00010000:00010000:1.0:1763343031.076980:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4383 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00000100:00100000:0.0:1763343031.076987:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:56804:x1848997993380352:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.076995:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4383 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.077013:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.077026:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae438a lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.077034:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4391 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac86d2 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.077035:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae438a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077055:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae438a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00002000:00010000:0.0:1763343031.077072:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x276:0x0] initial LVB size: 4096, mtime: 0x691a7ab6, atime: 0x0, ctime: 0x691a7ab6, blocks: 0x8 00010000:00010000:0.0:1763343031.077097:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.077101:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.077110:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4391 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86d2 expref: 14 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.077127:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4391 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86d2 expref: 14 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.077145:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665da00, rc 0) 00010000:00010000:1.0:1763343031.077173:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4398 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077183:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4398 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077191:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4398 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000040:00080000:1.0:1763343031.077531:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1300, 64 off110528 00000040:00080000:1.0:1763343031.077571:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1299, 64 off110528 00000040:00080000:1.0:1763343031.077585:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1300, 64 off110592 00000040:00080000:1.0:1763343031.077598:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1301, 64 off110592 00010000:00010000:1.0:1763343031.077712:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae439f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077723:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae439f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077731:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae439f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077740:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae439f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077747:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae439f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077753:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae439f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077773:0:10042:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343031.077795:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343031.077801:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae439f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077807:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.077812:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae439f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077819:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae439f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077830:0:13198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:1.0:1763343031.077833:0:13198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343031.077837:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae439f lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077846:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae439f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077860:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.077863:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.077866:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.077880:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4398 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077887:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4398 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077892:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4398 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077897:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.077902:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4398 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077907:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4398 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077915:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bc:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:1.0:1763343031.077918:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343031.077921:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4398 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.077926:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae4398 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.078138:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4383 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.078149:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4383 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.078154:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4383 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.078161:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4383 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.078166:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.078170:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4383 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.078175:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4383 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.078186:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc600) 00010000:00010000:1.0:1763343031.078188:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.078192:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4383 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.078197:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4383 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:1.0:1763343031.078218:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000038f0a7b9 reply state 0000000080ec79a2 transno 8589939564 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae438a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.078229:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae438a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.078235:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcf00) 00010000:00010000:1.0:1763343031.078238:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343031.078241:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343031.078543:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:56804:x1848997993380352:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1555us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.078554:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6152 00000100:00100000:1.0:1763343031.079520:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56807:x1848997993380224:12345-192.168.204.21@tcp:36:rm.0 Request processed in 3036us (3617us total) trans 8589939564 rc 0/0 00000100:00100000:1.0:1763343031.079533:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8855 00000100:00100000:0.0:1763343031.089737:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.089932:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993380480 00000100:00100000:3.0:1763343031.089946:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993380480 00000100:00100000:3.0:1763343031.090037:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6153 00000100:00100000:3.0:1763343031.090049:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:56804:x1848997993380480:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.090075:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.090104:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae43a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac86d9 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343031.090135:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x274:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343031.090163:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.090166:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.090177:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae43a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86d9 expref: 18 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.090195:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae43a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86d9 expref: 18 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.090210:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343031.090291:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:56804:x1848997993380480:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 244us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.090298:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6153 00000100:00100000:3.0:1763343031.092510:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.093689:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993380608 00000100:00100000:0.0:1763343031.093706:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993380608 00000100:00100000:1.0:1763343031.094934:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993380736 00000100:00100000:1.0:1763343031.094943:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993380736 00002000:00010000:1.0:1763343031.095926:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/628 (0->18446744073709551615) 00002000:00100000:1.0:1763343031.095933:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34035e8e00 with x1848997993380736 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343031.095941:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34035e8e00. 00000100:00100000:1.0:1763343031.095961:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1521 00000100:00100000:1.0:1763343031.095967:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993380736:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:1.0:1763343031.096132:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x274:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343031.096136:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x274:0x0] updating lvb mtime from disk: 0 -> 1763343030 00002000:00010000:1.0:1763343031.096139:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x274:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.096141:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x274:0x0] updating lvb ctime from disk: 0 -> 1763343030 00002000:00010000:1.0:1763343031.096143:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x274:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343031.096221:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993380736:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 252us (1471us total) trans 21474838729 rc 0/0 00000100:00100000:1.0:1763343031.096228:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1521 00002000:00010000:1.0:1763343031.096233:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/628 (0->18446744073709551615) 00002000:00100000:1.0:1763343031.096235:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34035e8e00 with x1848997993380736 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343031.096240:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34035e8e00. 00000100:00100000:3.0:1763343031.098304:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.099113:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993380864 00000100:00100000:0.0:1763343031.099125:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993380864 00000100:00100000:0.0:1763343031.099190:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8856 00000100:00100000:0.0:1763343031.099201:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56808:x1848997993380864:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.099230:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.099256:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae43ad lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac86e0 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.099351:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae43b4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099368:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae43b4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099380:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae43b4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099392:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae43bb lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099400:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae43bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099406:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae43bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099455:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae43b4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099463:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae43b4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099469:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae43b4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099475:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae43b4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099481:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.099485:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae43b4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099493:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae43b4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099507:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:0.0:1763343031.099511:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.099517:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae43b4 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099523:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae43b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099539:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae43bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099546:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae43bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099552:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae43bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099557:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.099560:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae43bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099565:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae43bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099572:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcf00) 00010000:00010000:0.0:1763343031.099575:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.099578:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae43bb lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099583:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae43bb lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.099615:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae43ad lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86e0 expref: 228 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.099682:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:0.0:1763343031.099684:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.099689:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae43ad lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86e0 expref: 228 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.099707:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c400, rc 0) 00000100:00100000:0.0:1763343031.099752:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56808:x1848997993380864:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 552us (1460us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343031.099759:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8856 00000100:00100000:0.0:1763343031.103317:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.104692:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.104852:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993381248 00000100:00100000:0.0:1763343031.104860:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993381248 00000100:00100000:0.0:1763343031.104908:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8858 00000100:00100000:0.0:1763343031.104917:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56808:x1848997993381248:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.104931:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.104949:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae43c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac86e7 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.105022:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae43d0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105033:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae43d0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105043:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae43d0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105054:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae43d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105062:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae43d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105069:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae43d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105108:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae43d0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105116:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae43d0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105122:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae43d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105128:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae43d0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105134:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.105140:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae43d0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105148:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae43d0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105159:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141a00) 00010000:00010000:0.0:1763343031.105162:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.105166:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae43d0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105172:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae43d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105188:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae43d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105194:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae43d7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105200:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae43d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105206:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.105208:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae43d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105214:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae43d7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105222:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcf00) 00010000:00010000:0.0:1763343031.105224:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.105227:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae43d7 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105232:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae43d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.105259:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae43c9 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86e7 expref: 230 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.105269:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141a00) 00010000:00010000:0.0:1763343031.105272:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.105275:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae43c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86e7 expref: 230 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.105289:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d000, rc 0) 00000100:00100000:0.0:1763343031.105333:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56808:x1848997993381248:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 417us (641us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343031.105340:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8858 00000100:00100000:3.0:1763343031.109371:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.109807:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993381376 00000100:00100000:0.0:1763343031.109821:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993381376 00000100:00100000:0.0:1763343031.109897:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6154 00000100:00100000:0.0:1763343031.109909:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:56804:x1848997993381376:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.109934:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.109958:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae43de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac86ee expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.110008:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae42db lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8693 expref: 20 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343031.110017:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.110020:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.110024:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae43de lrc: 4/0,0 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86ee expref: 20 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.110073:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae42db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8693 expref: 20 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343031.110087:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae42db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8693 expref: 20 pid: 28648 timeout: 1324 lvb_type: 1 00000100:00100000:0.0:1763343031.110103:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010209280:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343031.110208:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34050d5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343031.112023:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993381504 00000100:00100000:3.0:1763343031.112038:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993381504 00000100:00100000:3.0:1763343031.112114:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8859 00000100:00100000:3.0:1763343031.112126:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56808:x1848997993381504:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.112158:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.112188:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae43e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac86f5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.112266:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae43ec lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.112284:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae43ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.112298:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae43ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:3.0:1763343031.112371:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343031.112378:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343031.112430:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae43e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86f5 expref: 231 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.112456:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae43ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86f5 expref: 230 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.112467:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdd00) 00010000:00010000:3.0:1763343031.112472:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343031.112476:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:3.0:1763343031.112581:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56808:x1848997993381504:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 457us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.112589:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8859 00000100:00100000:0.0:1763343031.117406:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010209280:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343031.117460:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae43de lrc: 3/0,0 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86ee expref: 20 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.117487:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665cc00, rc 0) 00000100:00100000:0.0:1763343031.118403:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:56804:x1848997993381376:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8487us (9038us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.118417:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6154 00000100:00100000:1.0:1763343031.118693:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.118862:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.118960:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993381760 00000100:00100000:3.0:1763343031.118972:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993381760 00000100:00100000:3.0:1763343031.119053:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8860 00000100:00100000:3.0:1763343031.119064:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56808:x1848997993381760:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.119095:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.119122:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae43f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac86fc expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.119208:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae43fa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119225:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae43fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119239:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae43fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119252:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4401 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119259:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4401 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119265:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4401 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119318:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae43fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119326:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae43fa lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119332:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae43fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119339:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.119344:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae43fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119351:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae43fa lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119366:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdd00) 00010000:00010000:3.0:1763343031.119370:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.119376:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae43fa lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119382:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae43fa lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119396:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4401 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119403:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4401 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119409:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4401 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119414:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.119416:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4401 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119422:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4401 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119428:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcf00) 00010000:00010000:3.0:1763343031.119430:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.119433:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4401 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119439:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4401 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.119467:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae43f3 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86fc expref: 231 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.119478:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdd00) 00010000:00010000:3.0:1763343031.119480:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.119484:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae43f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86fc expref: 231 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.119492:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92c00, rc 0) 00000100:00100000:3.0:1763343031.119556:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56808:x1848997993381760:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 494us (693us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343031.119564:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8860 00000100:00100000:0.0:1763343031.120052:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993381632 00000100:00100000:0.0:1763343031.120060:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993381632 00010000:00010000:0.0:1763343031.120093:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae42db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8693 expref: 20 pid: 28648 timeout: 1324 lvb_type: 1 00000100:00100000:0.0:1763343031.120129:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2906 00000100:00100000:0.0:1763343031.120139:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993381632:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343031.120154:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343031.120178:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae42db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8693 expref: 20 pid: 28648 timeout: 1324 lvb_type: 1 00010000:00010000:0.0:1763343031.120191:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae42db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8693 expref: 20 pid: 28648 timeout: 1324 lvb_type: 1 00010000:00010000:0.0:1763343031.120212:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae42db lrc: 0/0,0 mode: --/PR res: [0x280000401:0x273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8693 expref: 20 pid: 28648 timeout: 1324 lvb_type: 1 00010000:00010000:0.0:1763343031.120227:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.120230:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.120239:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae43de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86ee expref: 19 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.120250:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae43de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86ee expref: 19 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.120299:0:13199:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae43de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86ee expref: 19 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343031.120317:0:13199:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:13199:1848998010209408:192.168.204.21@tcp:105: 00000100:00100000:0.0:1763343031.120394:0:13199:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34050d5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1763343031.124296:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.124706:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993382016 00000100:00100000:3.0:1763343031.124720:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993382016 00000100:00100000:3.0:1763343031.124789:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8861 00000100:00100000:3.0:1763343031.124801:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56808:x1848997993382016:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.124831:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.124836:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343031.124877:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae43ec lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86f5 expref: 230 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.124903:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdd00) 00010000:00010000:3.0:1763343031.124918:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343031.124941:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4408 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8703 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.125115:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae440f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125132:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae440f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125145:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae440f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125157:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae4416 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125165:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae4416 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125172:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae4416 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125763:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae441d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125775:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae441d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125783:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae441d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:3.0:1763343031.125796:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1be:0x0]: returning size 0 00010000:00010000:3.0:1763343031.125828:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae440f lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125836:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae440f lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125844:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae440f lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125851:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae440f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125858:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.125863:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae440f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125871:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae440f lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125881:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bd600) 00010000:00010000:3.0:1763343031.125884:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.125889:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae440f lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125899:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae440f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:3.0:1763343031.125912:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002565af47 reply state 00000000ca047c80 transno 8589939566 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae4416 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125923:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae4416 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.125930:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcf00) 00010000:00010000:3.0:1763343031.125932:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343031.125936:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343031.125971:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4408 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8703 expref: 232 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.125992:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae441d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8703 expref: 231 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.126015:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a34037bdc00) 00010000:00010000:3.0:1763343031.126017:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343031.126019:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93a00, rc 0) 00000100:00100000:3.0:1763343031.126114:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56808:x1848997993382016:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1315us (1835us total) trans 8589939566 rc 0/0 00000100:00100000:3.0:1763343031.126122:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8861 00000100:00100000:0.0:1763343031.131617:0:13199:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:13199:1848998010209408:192.168.204.21@tcp:105: 00010000:00010000:0.0:1763343031.131704:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343031.131786:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993381632:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 11646us (13093us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.131799:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2906 00000100:00100000:3.0:1763343031.133757:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993382144 00000100:00100000:3.0:1763343031.133777:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993382144 00000100:00100000:3.0:1763343031.133956:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6155 00000100:00100000:3.0:1763343031.133971:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993382144:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:3.0:1763343031.134204:0:28648:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343031.134209:0:28648:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb mtime from disk: 1763343030 -> 1763343030 00002000:00010000:3.0:1763343031.134213:0:28648:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb atime from disk: 0 -> 1763343030 00002000:00010000:3.0:1763343031.134216:0:28648:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb ctime from disk: 1763343030 -> 1763343031 00002000:00010000:3.0:1763343031.134219:0:28648:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343031.134289:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993382144:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 321us (3074us total) trans 21474838730 rc 0/0 00000100:00100000:3.0:1763343031.134299:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6155 00000100:00100000:1.0:1763343031.136238:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.136290:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993382400 00000100:00100000:1.0:1763343031.136302:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993382400 00000100:00100000:1.0:1763343031.136360:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8862 00000100:00100000:1.0:1763343031.136370:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56808:x1848997993382400:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.136400:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.136428:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae442b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac870a expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.136569:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4432 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.136587:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae441d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8703 expref: 233 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.136598:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4432 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.136667:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae441d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8703 expref: 233 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.136683:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae441d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8703 expref: 233 pid: 6523 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343031.136698:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010209536:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343031.136801:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340498f840 going to sleep for 11 seconds 00000100:00100000:3.0:1763343031.142750:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993382656 00000100:00100000:3.0:1763343031.142767:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993382656 00000100:00100000:3.0:1763343031.143552:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3005 00000100:00100000:3.0:1763343031.143567:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56804:x1848997993382656:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:3.0:1763343031.143701:0:14879:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1bb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae422c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8654 expref: 234 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.143768:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343031.143785:0:14879:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae42b8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac867e expref: 234 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.143795:0:14879:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343031.143841:0:14879:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae42b8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac867e expref: 234 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.143855:0:14879:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae42b8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac867e expref: 234 pid: 10041 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343031.143879:0:14879:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c250a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010209664:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343031.143989:0:14879:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343031.144261:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.144312:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993382784 00000100:00100000:1.0:1763343031.144319:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993382784 00010000:00010000:1.0:1763343031.144350:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae441d lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8703 expref: 235 pid: 6523 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343031.144386:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2907 00000100:00100000:1.0:1763343031.144394:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:2429:x1848997993382784:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.144407:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.144413:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae441d lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8703 expref: 235 pid: 6523 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343031.144426:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae441d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8703 expref: 235 pid: 6523 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343031.144442:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a34037bdc00) 00010000:00010000:1.0:1763343031.144448:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4432 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.144457:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4432 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.144464:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4432 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.144481:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.144519:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:2429:x1848997993382784:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 125us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.144527:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2907 00010000:00010000:3.0:1763343031.145756:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae441d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8703 expref: 234 pid: 6523 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343031.145776:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010209536:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343031.145799:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4432 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.145808:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4432 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.145814:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4432 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343031.145843:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1be:0x0]: returning size 0 00000004:00080000:3.0:1763343031.146084:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x277:0x0], index 0: 0 00000004:00080000:3.0:1763343031.146092:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x279:0x0], index 1: 0 00000004:00080000:3.0:1763343031.146097:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x27a:0x0], index 1: 0 00000004:00080000:3.0:1763343031.146101:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x278:0x0], index 0: 0 00010000:00010000:3.0:1763343031.146233:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4432 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.146242:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4432 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.146248:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4432 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.146258:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.146276:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4432 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.146286:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4432 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.146303:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a34037bdc00) 00010000:00010000:3.0:1763343031.146306:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343031.146311:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4432 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.146318:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4432 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.146380:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae442b lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac870a expref: 234 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.146391:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a34037bdc00) 00010000:00010000:3.0:1763343031.146393:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343031.146397:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae442b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac870a expref: 234 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.146412:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:3.0:1763343031.146493:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56808:x1848997993382400:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 10123us (10266us total) trans 8589939567 rc 301/301 00000100:00100000:3.0:1763343031.146503:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8862 00000100:00100000:3.0:1763343031.150963:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.151067:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993382912 00000100:00100000:1.0:1763343031.151082:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993382912 00010000:00010000:1.0:1763343031.151140:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae42b8 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac867e expref: 233 pid: 10041 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343031.151207:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2908 00000100:00100000:1.0:1763343031.151219:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350921c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:2429:x1848997993382912:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.151240:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.151248:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae42b8 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac867e expref: 233 pid: 10041 timeout: 1324 lvb_type: 0 00000100:00100000:0.0:1763343031.151732:0:14879:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c250a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010209664:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343031.152237:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae42b8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac867e expref: 233 pid: 10041 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343031.152394:0:14879:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.152476:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae42b8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac867e expref: 233 pid: 10041 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343031.152500:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:1.0:1763343031.152506:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.152519:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.152528:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.152976:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.153067:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350921c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:2429:x1848997993382912:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1847us (2117us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.153080:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2908 00010000:00010000:0.0:1763343031.153286:0:14879:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343031.153295:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00000040:00080000:0.0:1763343031.153599:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1301, 88 off110680 00000004:00080000:0.0:1763343031.153609:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1224820987161ns, next at 1225128513580ns, rc = 0 00000040:00080000:0.0:1763343031.153674:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1302, 88 off110680 00000004:00080000:0.0:1763343031.153680:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1224821058805ns, next at 1225128540585ns, rc = 0 00000040:00080000:0.0:1763343031.153705:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1303, 88 off110768 00000004:00080000:0.0:1763343031.153710:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1224821089354ns, next at 1225128540585ns, rc = 0 00000040:00080000:0.0:1763343031.153721:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1302, 88 off110768 00000004:00080000:0.0:1763343031.153725:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1224821104264ns, next at 1225128513580ns, rc = 0 00000100:00100000:1.0:1763343031.155792:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993383168 00000100:00100000:1.0:1763343031.155806:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993383168 00000100:00100000:1.0:1763343031.155869:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3006 00000100:00100000:1.0:1763343031.155882:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56808:x1848997993383168:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343031.158238:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56808:x1848997993383168:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 2343us (3011us total) trans 8589939569 rc 0/0 00000100:00100000:1.0:1763343031.158256:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3006 00010000:00010000:3.0:1763343031.159942:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae437c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.159957:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae437c lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.159965:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae437c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.159972:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.159977:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae437c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.159986:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae437c lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.160018:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:3.0:1763343031.160022:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.160028:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae437c lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.160035:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae437c lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.160058:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae438a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.160065:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae438a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.160070:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae438a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.160075:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.160078:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae438a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.160085:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae438a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.160093:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcf00) 00010000:00010000:3.0:1763343031.160096:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.160099:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae438a lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.160105:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae438a lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.160117:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae43c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.160122:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae43c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.160128:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae43c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.160133:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.160136:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae43c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.160142:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae43c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.160149:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:3.0:1763343031.160152:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.160154:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae43c2 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.160160:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae43c2 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.160171:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae4416 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.160177:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae4416 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.160182:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae4416 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.160187:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.160190:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae4416 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.160195:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae4416 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.160202:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcf00) 00010000:00010000:3.0:1763343031.160204:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.160207:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae4416 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.160213:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae4416 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343031.160428:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010210048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343031.160518:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343031.160565:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343031.160571:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010210176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343031.160592:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343031.160674:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010210048 00000100:00100000:0.0:1763343031.160684:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010210048 00000100:00100000:0.0:1763343031.160739:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010210176 00000100:00100000:0.0:1763343031.160742:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010210176 00000100:00100000:0.0:1763343031.160765:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6156 00000100:00100000:0.0:1763343031.160774:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3659:x1848998010210048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343031.160975:0:28994:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343031.160979:0:28994:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb mtime from disk: 1763343030 -> 1763343030 00002000:00010000:0.0:1763343031.160982:0:28994:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb atime from disk: 1763343030 -> 1763343030 00002000:00010000:0.0:1763343031.160984:0:28994:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb ctime from disk: 1763343031 -> 1763343031 00002000:00010000:0.0:1763343031.160987:0:28994:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x273:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343031.161041:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3659:x1848998010210048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 267us (522us total) trans 21474838731 rc 0/0 00000100:00100000:0.0:1763343031.161048:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6156 00000100:00100000:0.0:1763343031.161068:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6157 00000100:00100000:0.0:1763343031.161075:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3659:x1848998010210176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343031.161126:0:28994:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x274:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343031.161129:0:28994:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x274:0x0] updating lvb mtime from disk: 1763343030 -> 1763343030 00002000:00010000:0.0:1763343031.161131:0:28994:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x274:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343031.161134:0:28994:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x274:0x0] updating lvb ctime from disk: 1763343030 -> 1763343030 00002000:00010000:0.0:1763343031.161136:0:28994:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x274:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343031.161157:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3659:x1848998010210176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (564us total) trans 21474838732 rc 0/0 00000100:00100000:0.0:1763343031.161162:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6157 00000004:00080000:0.0:1763343031.161211:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b90000/2, rc 0, transno 21474838732 00000100:00100000:0.0:1763343031.161217:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010210176:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343031.161225:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b93b80/2, rc 0, transno 21474838731 00000100:00100000:0.0:1763343031.161228:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010210048:0@lo:2:osp-syn-0-0.0 00000004:00010000:0.0:1763343031.161274:0:14879:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000994637ce reply state 00000000ae113cba transno 8589939568 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343031.161294:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343031.161302:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:0.0:1763343031.161305:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343031.161308:0:14879:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343031.161314:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:0.0:1763343031.161316:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343031.161324:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae422c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8654 expref: 222 pid: 10041 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1763343031.161429:0:14879:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343031.161441:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+222:56804:x1848997993382656:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 17879us (19469us total) trans 8589939568 rc 0/0 00000100:00100000:0.0:1763343031.161449:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3005 00010000:00010000:1.0:1763343031.161753:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.161762:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.161770:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.161775:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.161780:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.161787:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.161799:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:1.0:1763343031.161801:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343031.161805:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.161812:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4439 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00000100:00100000:1.0:1763343031.161919:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010210688:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343031.161961:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343031.161989:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343031.162008:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010210560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343031.162033:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343031.162059:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010210688 00000100:00100000:1.0:1763343031.162064:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010210688 00000100:00100000:1.0:1763343031.162093:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010210560 00000100:00100000:1.0:1763343031.162096:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010210560 00000100:00100000:1.0:1763343031.162115:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6158 00000100:00100000:1.0:1763343031.162121:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3660:x1848998010210688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763343031.162239:0:28995:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x276:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343031.162242:0:28995:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x276:0x0] updating lvb mtime from disk: 1763343030 -> 1763343030 00002000:00010000:1.0:1763343031.162246:0:28995:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x276:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.162248:0:28995:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x276:0x0] updating lvb ctime from disk: 1763343030 -> 1763343030 00002000:00010000:1.0:1763343031.162250:0:28995:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x276:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343031.162285:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3660:x1848998010210688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 164us (323us total) trans 17179871434 rc 0/0 00000100:00100000:1.0:1763343031.162292:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6158 00000100:00100000:1.0:1763343031.162309:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6159 00000100:00100000:1.0:1763343031.162315:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3660:x1848998010210560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763343031.162379:0:28995:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x275:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343031.162382:0:28995:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x275:0x0] updating lvb mtime from disk: 1763343030 -> 1763343030 00002000:00010000:1.0:1763343031.162385:0:28995:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x275:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.162387:0:28995:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x275:0x0] updating lvb ctime from disk: 1763343030 -> 1763343030 00002000:00010000:1.0:1763343031.162389:0:28995:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x275:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343031.162413:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3660:x1848998010210560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (380us total) trans 17179871435 rc 0/0 00000100:00100000:1.0:1763343031.162419:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6159 00000100:00100000:1.0:1763343031.162459:0:3660:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871430 gen 2 00000004:00080000:1.0:1763343031.162466:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340664b100, transno 17179871329 00000004:00080000:1.0:1763343031.162474:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340664a300, transno 17179871330 00000004:00080000:1.0:1763343031.162477:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406648a80, transno 17179871331 00000004:00080000:1.0:1763343031.162480:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340664b800, transno 17179871332 00000004:00080000:1.0:1763343031.162483:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d4e00, transno 17179871333 00000004:00080000:1.0:1763343031.162486:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d6a00, transno 17179871334 00000004:00080000:1.0:1763343031.162489:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d4000, transno 17179871335 00000004:00080000:1.0:1763343031.162492:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d5c00, transno 17179871336 00000004:00080000:1.0:1763343031.162494:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d7480, transno 17179871338 00000004:00080000:1.0:1763343031.162497:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d5880, transno 17179871339 00000004:00080000:1.0:1763343031.162499:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d5f80, transno 17179871340 00000004:00080000:1.0:1763343031.162502:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d7b80, transno 17179871341 00000004:00080000:1.0:1763343031.162505:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a2d80, transno 17179871344 00000004:00080000:1.0:1763343031.162508:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a3100, transno 17179871345 00000004:00080000:1.0:1763343031.162511:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d5180, transno 17179871346 00000004:00080000:1.0:1763343031.162514:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d4380, transno 17179871347 00000004:00080000:1.0:1763343031.162517:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c3bb80, transno 17179871351 00000004:00080000:1.0:1763343031.162520:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062f2300, transno 17179871352 00000004:00080000:1.0:1763343031.162523:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062f3b80, transno 17179871353 00000004:00080000:1.0:1763343031.162526:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062f3800, transno 17179871354 00000004:00080000:1.0:1763343031.162529:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c3bdc00, transno 17179871355 00000004:00080000:1.0:1763343031.162532:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c3bc000, transno 17179871356 00000004:00080000:1.0:1763343031.162535:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c3bf100, transno 17179871357 00000004:00080000:1.0:1763343031.162538:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c3bea00, transno 17179871358 00000004:00080000:1.0:1763343031.162541:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c3bd500, transno 17179871361 00000004:00080000:1.0:1763343031.162544:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340a658e00, transno 17179871362 00000004:00080000:1.0:1763343031.162547:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a351fc76d80, transno 17179871363 00000004:00080000:1.0:1763343031.162551:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406553800, transno 17179871364 00000004:00080000:1.0:1763343031.162555:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad6680, transno 17179871368 00000004:00080000:1.0:1763343031.162558:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad5180, transno 17179871369 00000004:00080000:1.0:1763343031.162561:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad5880, transno 17179871370 00000004:00080000:1.0:1763343031.162564:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad4000, transno 17179871371 00000004:00080000:1.0:1763343031.162568:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad2a00, transno 17179871372 00000004:00080000:1.0:1763343031.162571:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad3480, transno 17179871373 00000004:00080000:1.0:1763343031.162574:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b92300, transno 17179871376 00000004:00080000:1.0:1763343031.162577:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b91500, transno 17179871377 00000004:00080000:1.0:1763343031.162580:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a351fc74e00, transno 17179871378 00000004:00080000:1.0:1763343031.162583:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406551c00, transno 17179871379 00000004:00080000:1.0:1763343031.162586:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062c8a80, transno 17179871380 00000004:00080000:1.0:1763343031.162589:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062ca680, transno 17179871381 00000004:00080000:1.0:1763343031.162593:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340a65b100, transno 17179871385 00000004:00080000:1.0:1763343031.162596:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a4a80, transno 17179871386 00000004:00080000:1.0:1763343031.162599:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a7800, transno 17179871387 00000004:00080000:1.0:1763343031.162601:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a4e00, transno 17179871388 00000004:00080000:1.0:1763343031.162605:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406649880, transno 17179871389 00000004:00080000:1.0:1763343031.162607:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340664ad80, transno 17179871390 00000004:00080000:1.0:1763343031.162611:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340664b480, transno 17179871391 00000004:00080000:1.0:1763343031.162614:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340664bb80, transno 17179871392 00000004:00080000:1.0:1763343031.162617:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340ccc0000, transno 17179871394 00000004:00080000:1.0:1763343031.162664:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad4380, transno 17179871395 00000004:00080000:1.0:1763343031.162667:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad7800, transno 17179871396 00000004:00080000:1.0:1763343031.162671:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340ccc0700, transno 17179871397 00000004:00080000:1.0:1763343031.162674:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052aea00, transno 17179871399 00000004:00080000:1.0:1763343031.162677:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052adf80, transno 17179871400 00000004:00080000:1.0:1763343031.162680:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052af800, transno 17179871401 00000004:00080000:1.0:1763343031.162684:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052ac000, transno 17179871402 00000004:00080000:1.0:1763343031.162687:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3409a4f800, transno 17179871405 00000004:00080000:1.0:1763343031.162691:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34034f1880, transno 17179871406 00000004:00080000:1.0:1763343031.162707:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a1180, transno 17179871408 00000004:00080000:1.0:1763343031.162710:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a0a80, transno 17179871409 00000004:00080000:1.0:1763343031.162713:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f3bb80, transno 17179871413 00000004:00080000:1.0:1763343031.162717:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f38000, transno 17179871414 00000004:00080000:1.0:1763343031.162720:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f3ad80, transno 17179871415 00000004:00080000:1.0:1763343031.162722:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f38380, transno 17179871416 00000004:00080000:1.0:1763343031.162726:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7c000, transno 17179871417 00000004:00080000:1.0:1763343031.162729:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7d500, transno 17179871418 00000004:00080000:1.0:1763343031.162732:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7f100, transno 17179871419 00000004:00080000:1.0:1763343031.162735:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3503520e00, transno 17179871420 00000004:00080000:1.0:1763343031.162737:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d4a80, transno 17179871422 00000004:00080000:1.0:1763343031.162741:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d6d80, transno 17179871423 00000004:00080000:1.0:1763343031.162744:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d4700, transno 17179871424 00000004:00080000:1.0:1763343031.162747:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d5500, transno 17179871425 00000004:00080000:1.0:1763343031.162750:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3409a4e300, transno 17179871427 00000004:00080000:1.0:1763343031.162752:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052ad500, transno 17179871428 00000004:00080000:1.0:1763343031.162756:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b5500, transno 17179871429 00000004:00080000:1.0:1763343031.162758:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b4700, transno 17179871430 00000100:00100000:1.0:1763343031.162765:0:3660:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a34095ba680 x1848998010210560/t17179871435(17179871435) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343047 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1763343031.162775:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095ba680/2, rc 0, transno 17179871435 00000100:00100000:1.0:1763343031.162780:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010210560:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763343031.162794:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b8700/2, rc 0, transno 17179871434 00000100:00100000:1.0:1763343031.162798:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010210688:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763343031.163229:0:32357:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 4 in progress, 2 in flight, 76 done 00000100:00100000:3.0:1763343031.164139:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010209920 00000100:00100000:3.0:1763343031.164149:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010209920 00000100:00100000:3.0:1763343031.164193:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010210432 00000100:00100000:3.0:1763343031.164196:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010210432 00000100:00100000:3.0:1763343031.164213:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010209792 00000100:00100000:3.0:1763343031.164216:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010209792 00000100:00100000:3.0:1763343031.164233:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010210304 00000100:00100000:3.0:1763343031.164236:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010210304 00000100:00100000:3.0:1763343031.164256:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6160 00000100:00100000:3.0:1763343031.164265:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3658:x1848998010209920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343031.164298:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:630 count 1 00002000:00010000:3.0:1763343031.164339:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x276:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343031.164348:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4447 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.164366:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.164368:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.164375:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.164393:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.164404:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.164413:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.164434:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343031.164709:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3658:x1848998010209920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 444us (1310us total) trans 21474838733 rc 0/0 00000100:00100000:3.0:1763343031.164717:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6160 00000100:00100000:3.0:1763343031.164737:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6161 00000100:00100000:3.0:1763343031.164743:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3658:x1848998010210432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343031.164756:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:632 count 1 00002000:00010000:3.0:1763343031.165389:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x278:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343031.165396:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae444e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.165408:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.165410:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.165413:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae444e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.165426:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae444e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.165435:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae444e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.165442:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae444e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.165465:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343031.165689:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3658:x1848998010210432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 945us (2228us total) trans 17179871436 rc 0/0 00000100:00100000:3.0:1763343031.165697:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6161 00000100:00100000:3.0:1763343031.165718:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6162 00000100:00100000:3.0:1763343031.165727:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3658:x1848998010209792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343031.165746:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:629 count 1 00010000:00010000:3.0:1763343031.165760:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4455 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x275:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.165777:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae434b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86c4 expref: 19 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.165790:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343031.165792:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343031.165795:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4455 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x275:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.165836:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae434b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86c4 expref: 19 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.165853:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae434b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86c4 expref: 19 pid: 28648 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343031.165870:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c250e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010210816:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343031.165955:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343031.165989:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6163 00000100:00100000:3.0:1763343031.166010:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3658:x1848998010210304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343031.166025:0:27833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:631 count 1 00010000:00010000:3.0:1763343031.166041:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae445c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.166054:0:27833:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae433d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86b6 expref: 14 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.166060:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343031.166062:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343031.166065:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae445c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.166090:0:27833:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae433d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86b6 expref: 14 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.166099:0:27833:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae433d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86b6 expref: 14 pid: 28994 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343031.166110:0:27833:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c251880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27833:1848998010210944:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343031.166135:0:27833:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c300 going to sleep for 11 seconds 00010000:00010000:3.0:1763343031.166172:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343031.166181:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.166190:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343031.166195:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.166204:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4447 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.166227:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4447 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.166235:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4447 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.166254:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343031.166259:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae444e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.166265:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343031.166268:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae444e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.166276:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae444e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.166286:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae444e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.166293:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae444e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.166304:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343031.166305:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343031.166307:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343031.166315:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343031.166367:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b93800/2, rc 0, transno 21474838733 00000100:00100000:3.0:1763343031.166374:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010209920:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763343031.166391:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095bb100/2, rc 0, transno 17179871436 00000100:00100000:3.0:1763343031.166396:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010210432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343031.171126:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.172380:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.173042:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993383424 00000100:00100000:0.0:1763343031.173057:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993383424 00000100:00100000:0.0:1763343031.173143:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3007 00000100:00100000:0.0:1763343031.173156:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+221:56808:x1848997993383424:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343031.173485:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+222:56808:x1848997993383424:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 330us (2371us total) trans 8589939570 rc 0/0 00000100:00100000:0.0:1763343031.173494:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3007 00000100:00100000:3.0:1763343031.174012:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993383552 00000100:00100000:3.0:1763343031.174020:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993383552 00000100:00100000:3.0:1763343031.174067:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8863 00000100:00100000:3.0:1763343031.174076:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+222:56804:x1848997993383552:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.174094:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.174120:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae4463 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8711 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.174189:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae4463 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8711 expref: 223 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.174208:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93000/0x607405d401ae4463 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8711 expref: 223 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.174228:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:3.0:1763343031.174232:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343031.174237:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93000, rc 0) 00000100:00100000:3.0:1763343031.174285:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+223:56804:x1848997993383552:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 210us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.174291:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8863 00000100:00100000:1.0:1763343031.175725:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.175764:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993383808 00000100:00100000:1.0:1763343031.175773:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993383808 00010000:00010000:1.0:1763343031.175811:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae433d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86b6 expref: 15 pid: 28994 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343031.175848:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2909 00000100:00100000:1.0:1763343031.175856:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993383808:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.175871:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.175876:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae433d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86b6 expref: 15 pid: 28994 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343031.175887:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae433d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86b6 expref: 15 pid: 28994 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343031.175917:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.175920:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.175926:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae445c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.175938:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae445c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.175962:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.176020:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993383808:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 164us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.176029:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2909 00000100:00100000:1.0:1763343031.176078:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.176095:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993383680 00000100:00100000:1.0:1763343031.176100:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993383680 00010000:00010000:1.0:1763343031.176117:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae434b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86c4 expref: 20 pid: 28648 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343031.176138:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2910 00000100:00100000:1.0:1763343031.176145:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993383680:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.176157:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.176162:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae434b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86c4 expref: 20 pid: 28648 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343031.176173:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae434b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86c4 expref: 20 pid: 28648 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343031.176190:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.176192:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.176195:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4455 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.176204:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4455 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.176215:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.176236:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993383680:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 91us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.176243:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2910 00010000:00010000:3.0:1763343031.177268:0:27833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae433d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86b6 expref: 14 pid: 28994 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343031.177283:0:27833:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c251880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27833:1848998010210944:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343031.177301:0:27833:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae445c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.177309:0:27833:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae445c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.177315:0:27833:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae445c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.177324:0:27833:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae445c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.177332:0:27833:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae445c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.177360:0:27833:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343031.177535:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3658:x1848998010210304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11537us (13991us total) trans 17179871437 rc 0/0 00000100:00100000:3.0:1763343031.177543:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6163 00000004:00080000:3.0:1763343031.177588:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b90380/2, rc 0, transno 21474838734 00000100:00100000:3.0:1763343031.177595:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010209792:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763343031.177608:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b9500/2, rc 0, transno 17179871437 00000100:00100000:3.0:1763343031.177612:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010210304:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763343031.178992:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763343031.179018:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4455 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.179037:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.179041:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4455 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.179052:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4455 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.179077:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4455 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.179085:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4455 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.179114:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343031.179118:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae445c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.179125:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.179128:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae445c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.179135:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae445c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.179145:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae445c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.179158:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae445c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.179172:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.179174:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.179176:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343031.182342:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.182444:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993384064 00000100:00100000:0.0:1763343031.182459:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993384064 00000100:00100000:0.0:1763343031.182609:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3008 00000100:00100000:0.0:1763343031.182715:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+223:56804:x1848997993384064:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:0.0:1763343031.183074:0:6526:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1bb:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343031.183147:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1303, 64 off110832 00000040:00080000:0.0:1763343031.183169:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1304, 64 off110832 00000040:00080000:0.0:1763343031.183179:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1305, 64 off110896 00000040:00080000:0.0:1763343031.183188:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1304, 64 off110896 00010000:00010000:0.0:1763343031.183265:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae446a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343031.183288:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae446a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343031.183304:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae446a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343031.183314:0:6526:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae446a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343031.183320:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae446a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343031.183327:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae446a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00000100:00100000:3.0:1763343031.185192:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:1.0:1763343031.185740:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343031.185753:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae446a lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343031.185764:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.185769:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae446a lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343031.185779:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae446a lrc: 5/0,0 mode: PW/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343031.185800:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1bb:0x0].0x0 (ffff9a3538bf7400) 00010000:00010000:1.0:1763343031.185803:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343031.185809:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae446a lrc: 3/0,0 mode: --/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343031.185817:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.185818:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.185820:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343031.185955:0:6526:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1763343031.185966:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae446a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1bb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00000100:00100000:0.0:1763343031.188064:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56804:x1848997993384064:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 5441us (5744us total) trans 8589939571 rc 0/0 00000100:00100000:0.0:1763343031.188076:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3008 00000100:00100000:3.0:1763343031.193930:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.194060:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.196118:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8866 00000100:00100000:0.0:1763343031.196137:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56804:x1848997993384704:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.196152:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.196163:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae44a2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8726 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.196272:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae44a9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.196281:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae44a9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.196290:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae44a9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343031.196302:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1be:0x0]: returning size 0 00010000:00010000:0.0:1763343031.196452:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae44a2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8726 expref: 231 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.196473:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae44a9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8726 expref: 230 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.196489:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:0.0:1763343031.196493:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763343031.196498:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d200, rc 0) 00000100:00100000:0.0:1763343031.196596:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56804:x1848997993384704:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 466us (2535us total) trans 8589939573 rc 0/0 00000100:00100000:0.0:1763343031.196604:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8866 00000100:00100000:0.0:1763343031.205720:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.205796:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993384832 00000100:00100000:0.0:1763343031.205805:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.205810:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993384832 00000100:00100000:3.0:1763343031.205888:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6164 00000100:00100000:1.0:1763343031.205891:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993385088 00000100:00100000:1.0:1763343031.205896:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993385088 00000100:00100000:3.0:1763343031.205901:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993384832:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.205926:0:27833:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763343031.205943:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8867 00010000:00010000:3.0:1763343031.205954:0:27833:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae44b7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac872d expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343031.205960:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:55941:x1848997993385088:12345-192.168.204.21@tcp:36:bash.0 00002000:00010000:3.0:1763343031.205992:0:27833:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x277:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343031.206022:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.206025:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.206037:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343031.206039:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae44b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac872d expref: 20 pid: 27833 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343031.206057:0:27833:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae44b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac872d expref: 20 pid: 27833 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343031.206066:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae4486 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8718 expref: 229 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.206071:0:27833:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00010000:00010000:1.0:1763343031.206085:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:1.0:1763343031.206092:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343031.206141:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993384832:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 243us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.206149:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6164 00010000:00010000:1.0:1763343031.206336:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae44be lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.206351:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae44be lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.206361:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae44be lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000001:00080000:1.0:1763343031.206415:0:10042:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939574 00000004:00010000:1.0:1763343031.206442:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ce65263f reply state 00000000bf85cbc0 transno 8589939575 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae44be lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.206455:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae44be lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.206461:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:1.0:1763343031.206463:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343031.206466:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343031.206524:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:55941:x1848997993385088:12345-192.168.204.21@tcp:36:bash.0 Request processed in 573us (717us total) trans 8589939575 rc 0/0 00000100:00100000:1.0:1763343031.206530:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8867 00000020:00080000:1.0:1763343031.206534:0:10042:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343031.210590:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.210750:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993385344 00000100:00100000:0.0:1763343031.210763:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993385344 00000100:00100000:0.0:1763343031.210843:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8868 00000100:00100000:0.0:1763343031.210854:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:55941:x1848997993385344:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343031.210885:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.210889:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343031.210926:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae44a9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8726 expref: 231 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.210961:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:0.0:1763343031.210969:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343031.210987:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae44c5 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8734 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.211060:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae44cc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.211076:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae44cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.211092:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae44cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:0.0:1763343031.211367:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1305, 88 off110984 00000004:00080000:0.0:1763343031.211377:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1224878755901ns, next at 1225128513580ns, rc = 0 00000040:00080000:0.0:1763343031.211422:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1306, 88 off110984 00000004:00080000:0.0:1763343031.211427:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1224878806325ns, next at 1225128540585ns, rc = 0 00000040:00080000:0.0:1763343031.211458:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1307, 88 off111072 00000004:00080000:0.0:1763343031.211463:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1224878842658ns, next at 1225128540585ns, rc = 0 00000040:00080000:0.0:1763343031.211474:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1306, 88 off111072 00000004:00080000:0.0:1763343031.211479:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1224878857623ns, next at 1225128513580ns, rc = 0 00000100:00100000:3.0:1763343031.213346:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.216159:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993385472 00000100:00100000:1.0:1763343031.216184:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993385472 00000100:00100000:1.0:1763343031.216277:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8869 00000100:00100000:1.0:1763343031.216289:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56804:x1848997993385472:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.216318:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.216346:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae44d3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac873b expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.216416:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae44cc lrc: 2/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.216430:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae44d3 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac873b expref: 234 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.216454:0:10042:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae44cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.216468:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae44d3 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac873b expref: 234 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.216486:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:1.0:1763343031.216490:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343031.216494:0:10042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae44d3 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac873b expref: 234 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.216502:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177200, rc 0) 00000100:00100000:1.0:1763343031.216602:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56804:x1848997993385472:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 314us (3268us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.216611:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8869 00000001:00080000:0.0:1763343031.217424:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939576 is committed 00000004:00080000:0.0:1763343031.217435:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 861 committed 00000004:00080000:0.0:1763343031.217444:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 860 committed 00000004:00080000:0.0:1763343031.217451:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 859 committed 00000004:00080000:0.0:1763343031.217453:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 860 committed 00010000:00010000:0.0:1763343031.217546:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae44cc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8734 expref: 226 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.217559:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:0.0:1763343031.217561:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343031.217565:0:28422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae44d3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac873b expref: 226 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.217574:0:28422:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae44d3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac873b expref: 226 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.217582:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae44d3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac873b expref: 226 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.217655:0:28422:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae44d3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac873b expref: 226 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343031.217673:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b93480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010211072:192.168.204.21@tcp:105: 00000100:00100000:0.0:1763343031.218009:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34050d56c0 going to sleep for 11 seconds 00010000:00010000:1.0:1763343031.219495:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae44be lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.219516:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae44be lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.219525:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae44be lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.219532:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.219539:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae44be lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.219549:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae44be lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.219570:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:1.0:1763343031.219573:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.219579:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae44be lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.219586:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae44be lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000100:00100000:3.0:1763343031.222732:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6168 00000100:00100000:3.0:1763343031.222759:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3658:x1848998010211200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343031.222795:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:629 count 1 00010000:00010000:3.0:1763343031.222824:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae44e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.222847:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc400/0x607405d401ae41e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac863f expref: 13 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.222855:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343031.222857:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343031.222861:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae44e1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.222900:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc400/0x607405d401ae41e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac863f expref: 13 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.222911:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc400/0x607405d401ae41e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac863f expref: 13 pid: 8408 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343031.222925:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c250000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010211840:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343031.223023:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c780 going to sleep for 11 seconds 00000100:00100000:0.0:1763343031.225213:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010212224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343031.225316:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.225377:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010212224 00000100:00100000:0.0:1763343031.225380:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343031.225389:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010212224 00000100:00100000:0.0:1763343031.225390:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010212352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343031.225422:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.225453:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010212352 00000100:00100000:3.0:1763343031.225457:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010212352 00000100:00100000:3.0:1763343031.225489:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6169 00000100:00100000:3.0:1763343031.225499:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3659:x1848998010212224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343031.225567:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010211968:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343031.225603:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1763343031.225726:0:27833:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343031.225730:0:27833:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343031.225733:0:27833:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343031.225735:0:27833:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343031.225737:0:27833:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343031.225791:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3659:x1848998010212224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 294us (475us total) trans 21474838735 rc 0/0 00000100:00100000:3.0:1763343031.225799:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6169 00000100:00100000:0.0:1763343031.226108:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010211968 00000100:00100000:0.0:1763343031.226114:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010211968 00000100:00100000:0.0:1763343031.226147:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6170 00000100:00100000:0.0:1763343031.226155:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3659:x1848998010212352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.226163:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6171 00000100:00100000:3.0:1763343031.226174:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3657:x1848998010211968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343031.226191:0:27833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:627 count 1 00010000:00010000:3.0:1763343031.226216:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae44e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.226241:0:27833:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae43de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86ee expref: 19 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.226250:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343031.226253:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343031.226258:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae44e8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343031.226279:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3659:x1848998010212352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (854us total) trans 21474838736 rc 0/0 00000100:00100000:0.0:1763343031.226286:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6170 00010000:00010000:3.0:1763343031.226299:0:27833:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae43de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86ee expref: 19 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.226313:0:27833:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae43de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86ee expref: 19 pid: 28648 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343031.226327:0:27833:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c250e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27833:1848998010212480:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343031.226361:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343031.226401:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010212096 00000100:00100000:0.0:1763343031.226405:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010212096 00000100:00100000:3.0:1763343031.226409:0:27833:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343031.226431:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6172 00000100:00100000:0.0:1763343031.226440:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3658:x1848998010212096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343031.226453:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:628 count 1 00010000:00010000:0.0:1763343031.226468:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665c000/0x607405d401ae44ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x274:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343031.226482:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c252300/2, rc 0, transno 21474838736 00010000:00010000:0.0:1763343031.226489:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae43a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86d9 expref: 19 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343031.226493:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010212352:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763343031.226504:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343031.226507:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343031.226510:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c000/0x607405d401ae44ef lrc: 4/0,1 mode: --/PW res: [0x280000401:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343031.226514:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c253480/2, rc 0, transno 21474838735 00000100:00100000:3.0:1763343031.226522:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010212224:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763343031.226539:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae43a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86d9 expref: 19 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.226550:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae43a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86d9 expref: 19 pid: 28994 timeout: 1324 lvb_type: 0 00000100:00100000:0.0:1763343031.226560:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010212608:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343031.226585:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34050d5000 going to sleep for 11 seconds 00000100:00100000:0.0:1763343031.232020:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b93480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010211072:192.168.204.21@tcp:105: 00010000:00010000:0.0:1763343031.232088:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae44c5 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8734 expref: 225 pid: 28422 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343031.232114:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae44cc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8734 expref: 224 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.232159:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c400, rc 0) 00000100:00100000:0.0:1763343031.232239:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:55941:x1848997993385344:12345-192.168.204.21@tcp:101:bash.0 Request processed in 21385us (21664us total) trans 8589939576 rc 0/0 00000100:00100000:0.0:1763343031.232254:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8868 00000100:00100000:3.0:1763343031.232331:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c250000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010211840:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343031.232355:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae44e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343031.232528:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.232565:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.232776:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2911 00000100:00100000:0.0:1763343031.232793:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993385600:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343031.232818:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343031.232830:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4391 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86d2 expref: 15 pid: 28994 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343031.232852:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4391 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86d2 expref: 15 pid: 28994 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343031.232893:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4391 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86d2 expref: 15 pid: 28994 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343031.232926:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.232930:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.232940:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405136600/0x607405d401ae44da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.233043:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae44e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.233053:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae44e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.233063:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae44e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.233069:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405136600/0x607405d401ae44da lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.233073:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae44e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.233097:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343031.233115:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343031.234275:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.234327:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993385856 00000100:00100000:1.0:1763343031.234335:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993385856 00000100:00100000:1.0:1763343031.234379:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3009 00000100:00100000:1.0:1763343031.234388:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:56804:x1848997993385856:12345-192.168.204.21@tcp:49:lfs.0 00000100:00100000:1.0:1763343031.234541:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:56804:x1848997993385856:12345-192.168.204.21@tcp:49:lfs.0 Request processed in 153us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.234548:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3009 00000100:00100000:1.0:1763343031.234761:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.234780:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993385984 00000100:00100000:1.0:1763343031.234791:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993385984 00010000:00010000:1.0:1763343031.234810:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae43de lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86ee expref: 20 pid: 28648 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343031.234834:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2913 00000100:00100000:1.0:1763343031.234840:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993385984:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.234850:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.234854:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae43de lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86ee expref: 20 pid: 28648 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343031.234866:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae43de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86ee expref: 20 pid: 28648 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343031.234895:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.234897:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.234901:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae44e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.234910:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae44e8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.234927:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.234949:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993385984:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 109us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.234955:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2913 00000100:00100000:1.0:1763343031.234992:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.235017:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993386112 00000100:00100000:1.0:1763343031.235021:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993386112 00010000:00010000:1.0:1763343031.235034:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae43a6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86d9 expref: 20 pid: 28994 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343031.235050:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2914 00000100:00100000:1.0:1763343031.235055:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993386112:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.235063:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.235066:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae43a6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86d9 expref: 20 pid: 28994 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343031.235075:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae43a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86d9 expref: 20 pid: 28994 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343031.235099:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.235101:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.235105:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665c000/0x607405d401ae44ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235112:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c000/0x607405d401ae44ef lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235122:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.235139:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993386112:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 83us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.235145:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2914 00010000:00010000:1.0:1763343031.235228:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae43a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86d9 expref: 19 pid: 28994 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343031.235243:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010212608:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343031.235265:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340665c000/0x607405d401ae44ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235274:0:8410:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340665c000/0x607405d401ae44ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235282:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665c000/0x607405d401ae44ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235292:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665c000/0x607405d401ae44ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235298:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c000/0x607405d401ae44ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235315:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763343031.235557:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3658:x1848998010212096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9117us (9194us total) trans 21474838737 rc 0/0 00000100:00100000:1.0:1763343031.235565:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6172 00010000:00010000:1.0:1763343031.235589:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763343031.235597:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae44e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235607:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.235612:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae44e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235649:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae44e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235664:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae44e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235671:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93600/0x607405d401ae44e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235690:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343031.235693:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665c000/0x607405d401ae44ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235699:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.235701:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665c000/0x607405d401ae44ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235709:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665c000/0x607405d401ae44ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235718:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665c000/0x607405d401ae44ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235729:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665c000/0x607405d401ae44ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235743:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.235745:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.235746:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343031.235778:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c251c00/2, rc 0, transno 21474838737 00000100:00100000:1.0:1763343031.235785:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010212096:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763343031.235853:0:27833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae43de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac86ee expref: 18 pid: 28648 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343031.235863:0:27833:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c250e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27833:1848998010212480:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343031.235880:0:27833:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae44e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235888:0:27833:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae44e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235895:0:27833:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae44e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235903:0:27833:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae44e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235910:0:27833:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae44e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.235928:0:27833:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343031.236171:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3657:x1848998010211968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9999us (10566us total) trans 21474838738 rc 0/0 00000100:00100000:1.0:1763343031.236179:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6171 00010000:00010000:1.0:1763343031.236202:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343031.236208:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae44e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.236216:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92c00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.236220:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae44e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.236228:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae44e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.236241:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae44e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.236249:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae44e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.236263:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.236264:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.236266:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343031.236397:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c251500/2, rc 0, transno 21474838738 00000100:00100000:1.0:1763343031.236403:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010211968:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763343031.236439:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.236458:0:28648:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3405136600/0x607405d401ae44da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.236467:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405136600/0x607405d401ae44da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.236476:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405136600/0x607405d401ae44da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.236483:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405136600/0x607405d401ae44da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.236498:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343031.236509:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343031.236513:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405136600/0x607405d401ae44da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.236520:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405136600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.236524:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405136600/0x607405d401ae44da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.236531:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405136600/0x607405d401ae44da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.236542:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405136600/0x607405d401ae44da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.236555:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405136600/0x607405d401ae44da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.236570:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.236572:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.236573:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343031.236854:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3658:x1848998010211328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16080us (16678us total) trans 17179871441 rc 0/0 00000100:00100000:1.0:1763343031.236861:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6167 00000004:00080000:1.0:1763343031.236897:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035e8a80/2, rc 0, transno 17179871441 00000100:00100000:1.0:1763343031.236903:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010211328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.237600:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993385600:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 4804us (5065us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.237645:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2911 00000100:00100000:0.0:1763343031.237776:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993386240 00000100:00100000:0.0:1763343031.237786:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993386240 00000100:00100000:0.0:1763343031.237847:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3010 00000100:00100000:0.0:1763343031.237858:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:55941:x1848997993386240:12345-192.168.204.21@tcp:49:bash.0 00000100:00100000:0.0:1763343031.240163:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:55941:x1848997993386240:12345-192.168.204.21@tcp:49:bash.0 Request processed in 2289us (2434us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.240181:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3010 00000100:00100000:0.0:1763343031.241790:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.241885:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993386496 00000100:00100000:1.0:1763343031.241897:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993386496 00000100:00100000:1.0:1763343031.242270:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3011 00000100:00100000:1.0:1763343031.242283:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:56804:x1848997993386496:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343031.242592:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:56804:x1848997993386496:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 311us (814us total) trans 8589939577 rc 0/0 00000100:00100000:1.0:1763343031.242600:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3011 00000100:00100000:3.0:1763343031.242963:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3658:x1848998010211200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20215us (22745us total) trans 17179871440 rc 0/0 00000100:00100000:3.0:1763343031.242977:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6168 00000004:00080000:0.0:1763343031.243032:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035ea300/2, rc 0, transno 17179871440 00000100:00100000:0.0:1763343031.243041:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010211200:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.247908:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.248129:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.248881:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993386624 00000100:00100000:3.0:1763343031.248894:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993386624 00000100:00100000:3.0:1763343031.248967:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6173 00000100:00100000:3.0:1763343031.248983:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:55941:x1848997993386624:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343031.249602:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.249655:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae44f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8742 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.249705:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae44b7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac872d expref: 19 pid: 27833 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343031.249720:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.249723:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.249728:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae44f6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8742 expref: 19 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.249776:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae44b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac872d expref: 19 pid: 27833 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343031.249798:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae44b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac872d expref: 19 pid: 27833 timeout: 1324 lvb_type: 1 00000100:00100000:3.0:1763343031.249820:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c250380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010212736:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343031.249951:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343031.255176:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.255294:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.255395:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c250380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010212736:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343031.255499:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993387136 00000100:00100000:0.0:1763343031.255507:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993387136 00000100:00100000:0.0:1763343031.255552:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3012 00000100:00100000:0.0:1763343031.255564:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56804:x1848997993387136:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343031.255849:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56804:x1848997993387136:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 285us (691us total) trans 8589939579 rc 0/0 00000100:00100000:0.0:1763343031.255857:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3012 00010000:00010000:3.0:1763343031.255962:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae44f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8742 expref: 19 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.255978:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93a00, rc 0) 00000100:00100000:3.0:1763343031.259661:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.259813:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993387392 00000100:00100000:0.0:1763343031.259826:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993387392 00000100:00100000:0.0:1763343031.259904:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3013 00000100:00100000:0.0:1763343031.259916:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56804:x1848997993387392:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:0.0:1763343031.260143:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56804:x1848997993387392:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 228us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.260151:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3013 00000100:00100000:1.0:1763343031.262413:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.262498:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993387520 00000100:00100000:3.0:1763343031.262511:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993387520 00000100:00100000:3.0:1763343031.262565:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6174 00000100:00100000:3.0:1763343031.262575:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:55941:x1848997993387520:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343031.262600:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.263594:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae4520 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8750 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343031.263654:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x279:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343031.263683:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.263686:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.263699:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae4520 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8750 expref: 13 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.263718:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae4520 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8750 expref: 13 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.263733:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343031.263781:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:55941:x1848997993387520:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1207us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.263789:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6174 00000100:00100000:1.0:1763343031.269034:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.269091:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.269783:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1522 00000100:00100000:1.0:1763343031.269795:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2432:x1848997993387648:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:1.0:1763343031.270035:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343031.270040:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb mtime from disk: 0 -> 1763343031 00002000:00010000:1.0:1763343031.270043:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.270045:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb ctime from disk: 0 -> 1763343031 00002000:00010000:1.0:1763343031.270048:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343031.270131:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2432:x1848997993387648:12345-192.168.204.21@tcp:10:bash.0 Request processed in 338us (1113us total) trans 21474838739 rc 0/0 00000100:00100000:1.0:1763343031.270150:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1522 00002000:00010000:1.0:1763343031.270157:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/631 (0->18446744073709551615) 00002000:00100000:1.0:1763343031.270161:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34059d4000 with x1848997993387648 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343031.270167:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34059d4000. 00000100:00100000:1.0:1763343031.272145:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.273340:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.273443:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993388288 00000100:00100000:0.0:1763343031.273450:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993388288 00000100:00100000:0.0:1763343031.273496:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3014 00000100:00100000:0.0:1763343031.273506:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:55941:x1848997993388288:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343031.273767:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:55941:x1848997993388288:12345-192.168.204.21@tcp:35:bash.0 Request processed in 262us (427us total) trans 8589939581 rc 0/0 00000100:00100000:0.0:1763343031.273776:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3014 00000100:00100000:3.0:1763343031.281364:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.286949:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.287186:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993388800 00000100:00100000:3.0:1763343031.287199:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993388800 00000100:00100000:3.0:1763343031.287280:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3015 00000100:00100000:3.0:1763343031.287291:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56810:x1848997993388800:12345-192.168.204.21@tcp:35:rm.0 00000100:00100000:1.0:1763343031.289803:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.289973:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010212992:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343031.290017:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae4543 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1be:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.290475:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae4543 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1be:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.290482:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae4543 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1be:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343031.290517:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1be:0x0]: returning size 5 00010000:00010000:0.0:1763343031.290758:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae453c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac875e expref: 234 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.290777:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae4543 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1be:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac875e expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.290785:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:0.0:1763343031.290789:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763343031.290792:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137200, rc 0) 00000100:00100000:0.0:1763343031.290838:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56809:x1848997993388544:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 9003us (9507us total) trans 8589939583 rc 0/0 00000100:00100000:0.0:1763343031.290847:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8872 00000100:00100000:1.0:1763343031.295209:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.296526:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.300030:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993389440 00000100:00100000:3.0:1763343031.300042:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993389440 00010000:00010000:3.0:1763343031.300094:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae4543 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1be:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac875e expref: 232 pid: 28422 timeout: 1324 lvb_type: 0 00000100:00100000:3.0:1763343031.300144:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2917 00000100:00100000:3.0:1763343031.300156:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:2430:x1848997993389440:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343031.300175:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343031.300184:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae4543 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1be:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac875e expref: 232 pid: 28422 timeout: 1324 lvb_type: 0 00010000:00010000:3.0:1763343031.300197:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae4543 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1be:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac875e expref: 232 pid: 28422 timeout: 1324 lvb_type: 0 00010000:00010000:3.0:1763343031.300225:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae4543 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1be:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac875e expref: 232 pid: 28422 timeout: 1324 lvb_type: 0 00010000:00010000:3.0:1763343031.300246:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:3.0:1763343031.300252:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae455f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.300272:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae455f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.300284:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae455f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.300293:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae456d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343031.300300:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae456d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343031.300306:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae456d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343031.300340:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343031.300413:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:2430:x1848997993389440:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 259us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.300422:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2917 00010000:00010000:1.0:1763343031.301698:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae456d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.301707:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae456d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343031.301739:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1be:0x0]: returning size 5 00000004:00200000:1.0:1763343031.301744:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343031.301764:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae456d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.301797:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae4566 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8765 expref: 232 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.301813:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae456d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8765 expref: 231 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.301820:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:1.0:1763343031.301822:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343031.301824:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d170000, rc 0) 00000100:00100000:1.0:1763343031.301866:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56809:x1848997993389312:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 5258us (5341us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.301877:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8874 00000100:00100000:1.0:1763343031.314711:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993389696 00000100:00100000:1.0:1763343031.314727:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993389696 00000100:00100000:0.0:1763343031.317941:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.318953:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.319143:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993389952 00000100:00100000:1.0:1763343031.319151:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993389952 00000100:00100000:1.0:1763343031.319199:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6175 00000100:00100000:1.0:1763343031.319208:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993389952:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:1.0:1763343031.319243:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae459e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.319261:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae44f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8742 expref: 19 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.319270:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343031.319273:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343031.319277:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae459e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.319321:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae44f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8742 expref: 19 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.319336:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae44f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8742 expref: 19 pid: 28996 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343031.319356:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010213248:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343031.319439:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3538bea3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343031.321393:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.321490:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.321658:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993390208 00000100:00100000:0.0:1763343031.321665:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993390208 00002000:00100000:0.0:1763343031.321722:0:24024:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x277:0x0] (0->4) req@ffff9a340c250e00 x1848997993390208/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:527/0 lens 496/0 e 0 to 0 dl 1763343042 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343031.321735:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340c250e00 with x1848997993390208 ext(0->4) 00010000:00010000:0.0:1763343031.321745:0:24024:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae44f6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8742 expref: 20 pid: 28996 timeout: 1324 lvb_type: 0 00010000:00010000:0.0:1763343031.321760:0:24024:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae44f6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8742 expref: 20 pid: 28996 timeout: 1324 lvb_type: 0 00002000:00010000:0.0:1763343031.321768:0:24024:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a340c250e00 00000100:00100000:0.0:1763343031.321795:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 99 00000100:00100000:0.0:1763343031.321802:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993390208:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:1.0:1763343031.322412:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010213248:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343031.322444:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae459e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343031.324918:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.325132:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993390336 00000100:00100000:3.0:1763343031.325143:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993390336 00000100:00100000:3.0:1763343031.325208:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8878 00000100:00100000:1.0:1763343031.325211:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993390208:12345-192.168.204.21@tcp:4:bash.0 Request processed in 3408us (3720us total) trans 21474838740 rc 0/0 00000100:00100000:3.0:1763343031.325218:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56811:x1848997993390336:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:1.0:1763343031.325224:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 99 00002000:00100000:1.0:1763343031.325239:0:24024:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x277:0x0] (0->4) req@ffff9a340c250e00 x1848997993390208/t21474838740(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:527/0 lens 496/448 e 0 to 0 dl 1763343042 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1763343031.325240:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1763343031.325249:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340c250e00 with x1848997993390208 ext(0->4) 00010000:00010000:1.0:1763343031.325260:0:24024:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae44f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8742 expref: 22 pid: 28996 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343031.325276:0:24024:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae44f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8742 expref: 22 pid: 28996 timeout: 1324 lvb_type: 0 00002000:00010000:1.0:1763343031.325284:0:24024:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a340c250e00 00010000:00010000:3.0:1763343031.325501:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae45ba lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8781 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.325585:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae45c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343031.325607:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae45c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343031.325661:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae45c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343031.325722:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343031.325727:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343031.325767:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae45ba lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8781 expref: 235 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.325784:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae45c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8781 expref: 234 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.325793:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bda00) 00010000:00010000:3.0:1763343031.325797:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343031.325800:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92800, rc 0) 00000100:00100000:3.0:1763343031.325836:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56811:x1848997993390336:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 620us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.325842:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8878 00000100:00100000:0.0:1763343031.328306:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.329215:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993390464 00000100:00100000:1.0:1763343031.329232:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993390464 00010000:00010000:1.0:1763343031.329303:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae44f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8742 expref: 22 pid: 28996 timeout: 1324 lvb_type: 0 00000100:00100000:1.0:1763343031.329350:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2918 00000100:00100000:1.0:1763343031.329360:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993390464:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.329381:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763343031.329406:0:27834:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1763343031.329411:0:27834:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763343031.329419:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae44f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8742 expref: 22 pid: 28996 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343031.329434:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae44f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8742 expref: 22 pid: 28996 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343031.329462:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93a00/0x607405d401ae44f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x277:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8742 expref: 22 pid: 28996 timeout: 1324 lvb_type: 0 00010000:00010000:1.0:1763343031.329481:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.329483:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.329489:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae459e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.329501:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae459e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.329543:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.329638:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993390464:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 262us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.329647:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2918 00000100:00100000:0.0:1763343031.330539:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.332807:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56811:x1848997993390592:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1824us (2229us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343031.332819:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8879 00000100:00100000:1.0:1763343031.333063:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.333136:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993390848 00000100:00100000:0.0:1763343031.333146:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993390848 00000100:00100000:0.0:1763343031.333192:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8880 00000100:00100000:0.0:1763343031.333201:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56809:x1848997993390848:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343031.333256:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343031.333367:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae456d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8765 expref: 234 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.333384:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:0.0:1763343031.333388:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343031.333427:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae45dd lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.333441:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae45dd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.333450:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae45dd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:0.0:1763343031.333850:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1307, 88 off111160 00000004:00080000:0.0:1763343031.333861:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1225001239486ns, next at 1225128513580ns, rc = 0 00000040:00080000:0.0:1763343031.333913:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1308, 88 off111160 00000004:00080000:0.0:1763343031.333918:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1225001297526ns, next at 1225128540585ns, rc = 0 00000040:00080000:0.0:1763343031.333940:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1309, 88 off111248 00000004:00080000:0.0:1763343031.333945:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1225001323905ns, next at 1225128540585ns, rc = 0 00000040:00080000:0.0:1763343031.333954:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1308, 88 off111248 00000004:00080000:0.0:1763343031.333957:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1225001336302ns, next at 1225128513580ns, rc = 0 00010000:00010000:1.0:1763343031.337731:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae4558 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.337753:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae4558 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.337761:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae4558 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.337772:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d170600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.337777:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae4558 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.337786:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae4558 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.337807:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a35167a9100) 00010000:00010000:1.0:1763343031.337811:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.337817:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae4558 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.337823:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae4558 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343031.338155:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d0ed3eb1 reply state 00000000435eedf0 transno 8589939586 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae45dd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.338174:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae45dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.338182:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:0.0:1763343031.338185:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343031.338189:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343031.338241:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010213632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343031.338242:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010213760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.338327:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1763343031.338472:0:28422:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343031.338490:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+224:56809:x1848997993390848:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 5286us (5425us total) trans 8589939586 rc 0/0 00000100:00100000:0.0:1763343031.338500:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8880 00000100:00100000:1.0:1763343031.339081:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343031.339136:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae45dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.339144:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae45dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.339150:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae45dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.339156:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.339160:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae45dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.339167:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae45dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.339181:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:1.0:1763343031.339184:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343031.339187:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae45dd lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.339193:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae45dd lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343031.339217:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010213632 00000100:00100000:1.0:1763343031.339221:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010213632 00000100:00100000:1.0:1763343031.339248:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6177 00000100:00100000:1.0:1763343031.339254:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3657:x1848998010213504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343031.339527:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3657:x1848998010213504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 272us (932us total) trans 21474838741 rc 0/0 00000100:00100000:1.0:1763343031.339533:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6177 00000100:00100000:1.0:1763343031.339547:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6178 00000100:00100000:1.0:1763343031.339552:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3657:x1848998010213376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343031.340169:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00002000:00010000:1.0:1763343031.340323:0:27833:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x279:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343031.340327:0:27833:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x279:0x0] updating lvb mtime from disk: 1763343031 -> 1763343031 00002000:00010000:1.0:1763343031.340330:0:27833:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x279:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.340333:0:27833:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x279:0x0] updating lvb ctime from disk: 1763343031 -> 1763343031 00002000:00010000:1.0:1763343031.340336:0:27833:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x279:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343031.340445:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3657:x1848998010213376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 891us (1783us total) trans 17179871444 rc 0/0 00000100:00100000:1.0:1763343031.340452:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6178 00000004:00080000:3.0:1763343031.340456:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095bb800/2, rc 0, transno 17179871444 00000100:00100000:3.0:1763343031.340460:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010213376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343031.344089:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.344217:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993391232 00000100:00100000:0.0:1763343031.344230:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993391232 00000100:00100000:0.0:1763343031.344302:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8882 00000100:00100000:0.0:1763343031.344314:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:56809:x1848997993391232:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.344346:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.344372:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae4607 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8796 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.344454:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae4607 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8796 expref: 226 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.344471:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae4607 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8796 expref: 226 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.344494:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:0.0:1763343031.344497:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343031.344502:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665da00, rc 0) 00000100:00100000:0.0:1763343031.344565:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56809:x1848997993391232:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 253us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.344574:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8882 00000100:00100000:1.0:1763343031.349462:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.350158:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.350518:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8883 00000100:00100000:1.0:1763343031.350532:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56811:x1848997993391488:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.350566:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.350595:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae460e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac879d expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343031.350714:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8884 00000100:00100000:0.0:1763343031.350727:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56809:x1848997993391616:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.350734:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.350745:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4615 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac87a4 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.350755:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae461c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.350772:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae45f9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac878f expref: 229 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.350782:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae461c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.350797:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4623 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.350808:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4623 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.350820:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4623 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.350822:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae45f9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac878f expref: 229 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.350836:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae45f9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac878f expref: 229 pid: 28422 timeout: 1325 lvb_type: 0 00000004:00200000:0.0:1763343031.350848:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1be:0x0]: returning size 5 00000100:00100000:1.0:1763343031.350851:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010213888:192.168.204.21@tcp:104: 00000004:00200000:0.0:1763343031.350853:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343031.350888:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4623 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.350918:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4615 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87a4 expref: 230 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.350942:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4623 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87a4 expref: 229 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.350952:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:0.0:1763343031.350956:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763343031.350960:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c000, rc 0) 00000100:00100000:1.0:1763343031.351486:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3538bea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343031.351612:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56809:x1848997993391616:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 888us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.351638:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8884 00000100:00100000:0.0:1763343031.354617:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.354734:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010213888:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343031.354768:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae461c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:3.0:1763343031.355108:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993391744 00000100:00100000:3.0:1763343031.355119:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993391744 00010000:00010000:3.0:1763343031.355165:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae45f9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac878f expref: 229 pid: 28422 timeout: 1325 lvb_type: 0 00000100:00100000:3.0:1763343031.355727:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2919 00000100:00100000:3.0:1763343031.355742:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:2430:x1848997993391744:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343031.355761:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343031.355769:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae45f9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac878f expref: 229 pid: 28422 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343031.355784:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae45f9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac878f expref: 229 pid: 28422 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343031.355811:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae45f9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac878f expref: 229 pid: 28422 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343031.355831:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c0:0x0].0x0 (ffff9a35167a9400) 00010000:00010000:3.0:1763343031.355837:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae461c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.355849:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae461c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.355857:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae461c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.357245:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343031.358680:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:2430:x1848997993391744:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 2940us (4076us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.358691:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2919 00000100:00100000:0.0:1763343031.361757:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.362406:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993391872 00000100:00100000:3.0:1763343031.362423:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993391872 00000100:00100000:3.0:1763343031.362504:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6180 00000100:00100000:3.0:1763343031.362516:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993391872:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.362539:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.362568:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae4631 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac87ab expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343031.362601:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x277:0x0] initial LVB size: 5, mtime: 0x691a7ab7, atime: 0x0, ctime: 0x691a7ab7, blocks: 0x8 00010000:00010000:3.0:1763343031.362647:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.362650:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.362665:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae4631 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87ab expref: 21 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343031.362687:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae4631 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87ab expref: 21 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343031.362702:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343031.363332:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993391872:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 814us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.363340:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6180 00000100:00100000:1.0:1763343031.364039:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993392128 00000100:00100000:1.0:1763343031.364049:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993392128 00000100:00100000:1.0:1763343031.364105:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3016 00000100:00100000:1.0:1763343031.364115:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56811:x1848997993392128:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343031.364497:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56811:x1848997993392128:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 381us (988us total) trans 8589939589 rc 0/0 00000100:00100000:1.0:1763343031.364505:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3016 00000100:00100000:3.0:1763343031.371903:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993392384 00000100:00100000:3.0:1763343031.371918:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993392384 00000100:00100000:1.0:1763343031.372172:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3017 00000100:00100000:1.0:1763343031.372189:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56811:x1848997993392384:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343031.373382:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56811:x1848997993392384:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1189us (1701us total) trans 8589939590 rc 0/0 00000100:00100000:1.0:1763343031.373395:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3017 00000100:00100000:0.0:1763343031.385526:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.390825:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.395545:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.395921:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993393024 00000100:00100000:0.0:1763343031.395935:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993393024 00000100:00100000:0.0:1763343031.396545:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8887 00000100:00100000:0.0:1763343031.396561:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:55941:x1848997993393024:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343031.396682:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343031.396720:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae464d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87b2 expref: 232 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.396746:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c0:0x0].0x0 (ffff9a35167a9f00) 00010000:00010000:0.0:1763343031.396752:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343031.397020:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4669 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.397038:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4669 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.397050:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4669 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000001:00080000:0.0:1763343031.397105:0:6523:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939592 00000004:00010000:0.0:1763343031.397130:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005e9db8f1 reply state 0000000072ba733f transno 8589939593 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4669 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.397143:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4669 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.397150:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c0:0x0].0x0 (ffff9a35167a9f00) 00010000:00010000:0.0:1763343031.397153:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343031.397156:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343031.397295:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:55941:x1848997993393024:12345-192.168.204.21@tcp:36:bash.0 Request processed in 737us (1764us total) trans 8589939593 rc 0/0 00000100:00100000:0.0:1763343031.397308:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8887 00000020:00080000:0.0:1763343031.397316:0:6523:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343031.404322:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.404501:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993393152 00000100:00100000:1.0:1763343031.404516:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993393152 00000100:00100000:1.0:1763343031.404592:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8888 00000100:00100000:1.0:1763343031.404602:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:55941:x1848997993393152:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343031.404669:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.404699:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae4670 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac87c0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.404772:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae4670 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87c0 expref: 235 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.404788:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae4670 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87c0 expref: 235 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.404807:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c0:0x0].0x0 (ffff9a35167a9f00) 00010000:00010000:1.0:1763343031.404810:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343031.404815:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:1.0:1763343031.404877:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:55941:x1848997993393152:12345-192.168.204.21@tcp:101:bash.0 Request processed in 277us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.404884:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8888 00000100:00100000:1.0:1763343031.407348:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.407577:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.407729:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993393280 00000100:00100000:3.0:1763343031.407736:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993393280 00000100:00100000:3.0:1763343031.407787:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6181 00000100:00100000:3.0:1763343031.407798:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2431:x1848997993393280:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:3.0:1763343031.407925:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2431:x1848997993393280:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 129us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.407935:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6181 00000100:00100000:3.0:1763343031.411932:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.412577:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993393664 00000100:00100000:0.0:1763343031.412593:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993393664 00000100:00100000:0.0:1763343031.412690:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6182 00000100:00100000:0.0:1763343031.412702:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993393664:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:0.0:1763343031.413057:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993393664:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 355us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.413066:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6182 00000100:00100000:1.0:1763343031.413901:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343031.413924:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010214016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343031.413944:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010214144:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763343031.414124:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae45f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.414134:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae45f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.414142:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae45f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.414149:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d171200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.414154:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae45f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.414163:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae45f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.414175:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a35167a9700) 00010000:00010000:0.0:1763343031.414178:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.414183:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae45f2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.414510:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae45f2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.414547:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4669 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.414558:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4669 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.414564:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4669 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00000100:00100000:1.0:1763343031.414590:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.414650:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343031.414689:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010214016 00000100:00100000:3.0:1763343031.414697:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010214144 00000100:00100000:1.0:1763343031.414699:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010214016 00000100:00100000:3.0:1763343031.414704:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010214144 00000100:00100000:1.0:1763343031.414752:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6183 00000100:00100000:3.0:1763343031.414761:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6184 00000100:00100000:1.0:1763343031.414764:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3659:x1848998010214016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343031.414773:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3657:x1848998010214144:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763343031.414853:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.414856:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4669 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.414863:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4669 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.414874:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c0:0x0].0x0 (ffff9a35167a9f00) 00010000:00010000:0.0:1763343031.414876:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.414880:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4669 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.414885:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4669 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1c0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:3.0:1763343031.415003:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3657:x1848998010214144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 222us (343us total) trans 17179871445 rc 0/0 00000100:00100000:3.0:1763343031.415010:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6184 00000004:00080000:3.0:1763343031.415061:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035e8380/2, rc 0, transno 17179871445 00000100:00100000:3.0:1763343031.415068:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010214144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343031.415792:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a354134e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010214272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.415840:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343031.416518:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010214016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1756us (1927us total) trans 17179871446 rc 0/0 00000100:00100000:1.0:1763343031.416526:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6183 00000004:00080000:1.0:1763343031.416581:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035eb100/2, rc 0, transno 17179871446 00000100:00100000:1.0:1763343031.416588:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010214016:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343031.416972:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a354134e300/2, rc 0, transno 21474838743 00000100:00100000:3.0:1763343031.416978:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a354134e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010214272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.417006:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343031.417018:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a354134df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010214400:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.417055:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.417098:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010214400 00000100:00100000:3.0:1763343031.417104:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010214400 00000100:00100000:3.0:1763343031.417146:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6186 00000100:00100000:3.0:1763343031.417154:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3660:x1848998010214400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.417264:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3660:x1848998010214400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (208us total) trans 21474838744 rc 0/0 00000100:00100000:3.0:1763343031.417272:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6186 00000004:00080000:3.0:1763343031.417296:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a354134df80/2, rc 0, transno 21474838744 00000100:00100000:3.0:1763343031.417301:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a354134df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010214400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343031.421910:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.422031:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.422729:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993393920 00000100:00100000:1.0:1763343031.422735:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993393920 00000100:00100000:1.0:1763343031.422801:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1524 00000100:00100000:1.0:1763343031.422810:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2431:x1848997993393920:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:1.0:1763343031.422839:0:24024:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176e00/0x607405d401ae468c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.422849:0:24024:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.422851:0:24024:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.422855:0:24024:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176e00/0x607405d401ae468c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.422866:0:24024:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176e00/0x607405d401ae468c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.422982:0:24024:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176e00/0x607405d401ae468c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.423004:0:24024:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176e00/0x607405d401ae468c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.423012:0:24024:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d176e00/0x607405d401ae468c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.423020:0:24024:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.423025:0:24024:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176e00/0x607405d401ae468c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.423036:0:24024:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176e00/0x607405d401ae468c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.423054:0:24024:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d176e00/0x607405d401ae468c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.423061:0:24024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176e00/0x607405d401ae468c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343031.423109:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2431:x1848997993393920:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 301us (1078us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763343031.423119:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1524 00000100:00100000:1.0:1763343031.426154:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.426251:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993394048 00000100:00100000:0.0:1763343031.426264:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993394048 00000100:00100000:0.0:1763343031.426336:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6188 00000100:00100000:0.0:1763343031.426348:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:55941:x1848997993394048:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343031.426371:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.426397:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae4693 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac87d5 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343031.426426:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x279:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343031.426452:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.426454:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.426464:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae4693 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87d5 expref: 22 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.426481:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae4693 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87d5 expref: 22 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.426495:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665cc00, rc 0) 00000100:00100000:0.0:1763343031.426567:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:55941:x1848997993394048:12345-192.168.204.21@tcp:101:bash.0 Request processed in 220us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.426575:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6188 00000100:00100000:1.0:1763343031.427961:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.428050:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993394176 00000100:00100000:3.0:1763343031.428061:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993394176 00000100:00100000:3.0:1763343031.428132:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8890 00000100:00100000:3.0:1763343031.428145:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56809:x1848997993394176:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.428179:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.428210:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae469a lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac87dc expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.428263:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae46a1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.428284:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae46a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.428297:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae46a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.428476:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae469a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87dc expref: 228 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.428498:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92800/0x607405d401ae46a1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87dc expref: 227 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.428509:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:3.0:1763343031.428514:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343031.428519:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92800, rc 0) 00000100:00100000:3.0:1763343031.429912:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56809:x1848997993394176:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1755us (1945us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.429927:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8890 00000100:00100000:1.0:1763343031.433261:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.435690:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.436224:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.436497:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1526 00000100:00100000:0.0:1763343031.436508:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2431:x1848997993394432:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343031.436761:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x279:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343031.436765:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x279:0x0] updating lvb mtime from disk: 0 -> 1763343031 00002000:00010000:0.0:1763343031.436768:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x279:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343031.436771:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x279:0x0] updating lvb ctime from disk: 0 -> 1763343031 00002000:00010000:0.0:1763343031.436774:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x279:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343031.436842:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2431:x1848997993394432:12345-192.168.204.21@tcp:10:bash.0 Request processed in 335us (1155us total) trans 21474838745 rc 0/0 00000100:00100000:0.0:1763343031.436851:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1526 00002000:00010000:0.0:1763343031.436856:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/633 (0->18446744073709551615) 00002000:00100000:0.0:1763343031.436859:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340c3bf100 with x1848997993394432 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343031.436864:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340c3bf100. 00000100:00100000:0.0:1763343031.442288:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.442366:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993394816 00000100:00100000:1.0:1763343031.442388:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993394816 00000100:00100000:1.0:1763343031.442459:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3018 00000100:00100000:1.0:1763343031.442471:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:55941:x1848997993394816:12345-192.168.204.21@tcp:35:bash.0 00000001:00080000:0.0:1763343031.442679:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871448 is committed 00000001:00080000:0.0:1763343031.442694:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871446 is committed 00000100:00100000:1.0:1763343031.443345:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:55941:x1848997993394816:12345-192.168.204.21@tcp:35:bash.0 Request processed in 876us (1070us total) trans 8589939595 rc 0/0 00000100:00100000:1.0:1763343031.443355:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3018 00000100:00100000:0.0:1763343031.450929:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.451122:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993394944 00000100:00100000:3.0:1763343031.451137:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993394944 00000100:00100000:3.0:1763343031.451219:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8891 00000100:00100000:3.0:1763343031.451232:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56812:x1848997993394944:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:3.0:1763343031.451266:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.451300:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae46af lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac87e3 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.451405:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae46b6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451422:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae46b6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451437:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae46b6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451451:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae46bd lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451458:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae46bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451464:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae46bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451587:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae46c4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451599:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae46c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451611:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae46c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343031.451722:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c0:0x0]: returning size 5 00000004:00200000:3.0:1763343031.451728:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343031.451758:0:10042:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae46c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451775:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae46c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451785:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae46b6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451792:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae46b6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451799:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae46b6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451806:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae46b6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451811:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.451816:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae46b6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451825:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae46b6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451839:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdc00) 00010000:00010000:3.0:1763343031.451843:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.451850:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae46b6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451857:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae46b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451874:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae46bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451881:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae46bd lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451886:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae46bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451891:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.451893:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae46bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451900:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae46bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451907:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bdb00) 00010000:00010000:3.0:1763343031.451910:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.451913:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae46bd lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451918:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae46bd lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.451956:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae46af lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87e3 expref: 230 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.451978:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae46c4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87e3 expref: 229 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.451985:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c0:0x0].0x0 (ffff9a35167a9f00) 00010000:00010000:3.0:1763343031.451987:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343031.452003:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92c00, rc 0) 00000100:00100000:0.0:1763343031.452186:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56812:x1848997993394944:12345-192.168.204.21@tcp:101:rm.0 Request processed in 954us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.452194:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8891 00000100:00100000:3.0:1763343031.462343:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.462392:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.462516:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993395200 00000100:00100000:0.0:1763343031.462531:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993395200 00000100:00100000:0.0:1763343031.462706:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993395456 00000100:00100000:0.0:1763343031.462710:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993395456 00000100:00100000:1.0:1763343031.462801:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8892 00000100:00100000:1.0:1763343031.462816:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56812:x1848997993395200:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:1.0:1763343031.462885:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343031.462918:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae467e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87c7 expref: 230 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.462944:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae46c4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87e3 expref: 229 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.462956:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae4662 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87b9 expref: 228 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.462966:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c0:0x0].0x0 (ffff9a35167a9f00) 00010000:00010000:1.0:1763343031.462981:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343031.463024:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae46cb lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.463038:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae46cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.463048:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae46cb lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.463058:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae46d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.463064:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae46d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.463069:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae46d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.463171:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae46d9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.463177:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae46d9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.463183:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae46d9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343031.463352:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8893 00000100:00100000:0.0:1763343031.463363:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56809:x1848997993395456:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343031.463397:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343031.463417:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4623 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1be:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87a4 expref: 227 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.463430:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:0.0:1763343031.463434:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343031.463486:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae46e0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.463496:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae46e0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.463504:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae46e0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00010000:0.0:1763343031.463797:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000158d13c4 reply state 000000001b4a7eb2 transno 8589939596 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae46e0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.463812:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae46e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.463818:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:0.0:1763343031.463821:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343031.463823:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343031.463938:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56809:x1848997993395456:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 577us (1544us total) trans 8589939596 rc 0/0 00000100:00100000:0.0:1763343031.463947:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8893 00000040:00080000:1.0:1763343031.465140:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1312, 64 off111488 00000004:00080000:1.0:1763343031.465154:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1225132532878ns, next at 1226132529377ns, rc = 0 00000040:00080000:1.0:1763343031.465179:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1311, 64 off111488 00000004:00080000:1.0:1763343031.465183:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1225132562181ns, next at 1226132560989ns, rc = 0 00000040:00080000:1.0:1763343031.465191:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1312, 64 off111552 00000040:00080000:1.0:1763343031.465198:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1313, 64 off111552 00010000:00010000:1.0:1763343031.465313:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae46e7 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.465329:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae46e7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.465339:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae46e7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.465349:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae46e7 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.465355:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae46e7 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.465361:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae46e7 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.465388:0:6523:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343031.465409:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae46d9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.465414:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae46d9 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.465419:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae46d9 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.465424:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.465428:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae46d9 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.465435:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae46d9 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.465446:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c0:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:1.0:1763343031.465449:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343031.465454:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae46d9 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.465463:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae46d9 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.466372:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae46cb lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.466389:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae46cb lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.466395:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae46cb lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.466401:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae46cb lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.466407:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.466411:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae46cb lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.466418:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae46cb lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.466431:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc600) 00010000:00010000:1.0:1763343031.466434:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.466438:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae46cb lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.466444:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae46cb lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:1.0:1763343031.466469:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000060e5e73d reply state 0000000000caacc5 transno 8589939597 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae46d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.466482:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae46d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.466499:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcb00) 00010000:00010000:1.0:1763343031.466501:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343031.466505:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343031.467693:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56812:x1848997993395200:12345-192.168.204.21@tcp:36:rm.0 Request processed in 4868us (5413us total) trans 8589939597 rc 0/0 00000100:00100000:1.0:1763343031.467705:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8892 00000100:00100000:3.0:1763343031.469232:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.470655:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993395584 00000100:00100000:0.0:1763343031.470673:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993395584 00000100:00100000:0.0:1763343031.470753:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6189 00000100:00100000:0.0:1763343031.470764:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:56809:x1848997993395584:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.470791:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.470820:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665c000/0x607405d401ae46ee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac87ea expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343031.470855:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x27a:0x0] initial LVB size: 4096, mtime: 0x691a7ab7, atime: 0x0, ctime: 0x691a7ab7, blocks: 0x8 00010000:00010000:0.0:1763343031.470886:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.470888:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.470899:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c000/0x607405d401ae46ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87ea expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.470924:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c000/0x607405d401ae46ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87ea expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.470939:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c000, rc 0) 00000100:00100000:0.0:1763343031.471041:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:56809:x1848997993395584:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 277us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.471049:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6189 00000100:00100000:0.0:1763343031.478042:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.478147:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993395712 00000100:00100000:1.0:1763343031.478160:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993395712 00000100:00100000:1.0:1763343031.478235:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6190 00000100:00100000:1.0:1763343031.478246:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:56809:x1848997993395712:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.478272:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.478300:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae46f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac87f1 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343031.478332:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x278:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343031.478359:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.478362:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.478372:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae46f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87f1 expref: 24 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.478392:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae46f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87f1 expref: 24 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.478409:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177a00, rc 0) 00000100:00100000:1.0:1763343031.478488:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:56809:x1848997993395712:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 244us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.478495:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6190 00000100:00100000:1.0:1763343031.480953:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993395840 00000100:00100000:1.0:1763343031.480965:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993395840 00002000:00010000:1.0:1763343031.481026:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/634 (5->18446744073709551615) 00002000:00100000:1.0:1763343031.481031:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060a8700 with x1848997993395840 ext(5->18446744073709551615) 00002000:00010000:1.0:1763343031.481047:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34060a8700. 00000100:00100000:1.0:1763343031.481082:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993395968 00000100:00100000:1.0:1763343031.481085:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993395968 00002000:00010000:1.0:1763343031.481100:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/632 (0->18446744073709551615) 00002000:00100000:1.0:1763343031.481103:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060a8a80 with x1848997993395968 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343031.481110:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34060a8a80. 00000100:00100000:1.0:1763343031.481133:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1528 00000100:00100000:1.0:1763343031.481143:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2432:x1848997993395840:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:1.0:1763343031.481591:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x27a:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:1.0:1763343031.481597:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x27a:0x0] updating lvb mtime from disk: 1763343031 -> 1763343031 00002000:00010000:1.0:1763343031.481599:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x27a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.481602:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x27a:0x0] updating lvb ctime from disk: 1763343031 -> 1763343031 00002000:00010000:1.0:1763343031.481605:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x27a:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343031.481697:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2432:x1848997993395840:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 554us (901us total) trans 17179871449 rc 0/0 00000100:00100000:1.0:1763343031.481706:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1528 00002000:00010000:1.0:1763343031.481711:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/634 (5->18446744073709551615) 00002000:00100000:1.0:1763343031.481714:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060a8700 with x1848997993395840 ext(5->18446744073709551615) 00002000:00010000:1.0:1763343031.481719:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34060a8700. 00000100:00100000:1.0:1763343031.481743:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1529 00000100:00100000:1.0:1763343031.481750:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2432:x1848997993395968:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:1.0:1763343031.481877:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x278:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343031.481880:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x278:0x0] updating lvb mtime from disk: 0 -> 1763343031 00002000:00010000:1.0:1763343031.481883:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x278:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.481885:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x278:0x0] updating lvb ctime from disk: 0 -> 1763343031 00002000:00010000:1.0:1763343031.481887:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x278:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343031.481908:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2432:x1848997993395968:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 159us (1047us total) trans 21474838746 rc 0/0 00000100:00100000:1.0:1763343031.481915:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1529 00002000:00010000:1.0:1763343031.481918:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/632 (0->18446744073709551615) 00002000:00100000:1.0:1763343031.481920:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060a8a80 with x1848997993395968 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343031.481925:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34060a8a80. 00000100:00100000:3.0:1763343031.484332:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.484937:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993396096 00000100:00100000:1.0:1763343031.484951:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993396096 00000100:00100000:0.0:1763343031.486843:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8894 00000100:00100000:0.0:1763343031.486870:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d13ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56813:x1848997993396096:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.486905:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.486935:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae46fc lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac87f8 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.487032:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4703 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487049:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4703 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487063:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4703 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487077:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae470a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487086:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae470a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487097:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae470a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487156:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4703 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487163:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4703 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487170:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4703 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487178:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4703 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487185:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.487190:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4703 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487198:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4703 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487212:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141500) 00010000:00010000:0.0:1763343031.487215:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.487221:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4703 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487228:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4703 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487243:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae470a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487249:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae470a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487256:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae470a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487261:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ca00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.487263:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae470a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487268:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae470a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487275:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcb00) 00010000:00010000:0.0:1763343031.487278:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.487280:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae470a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487286:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae470a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.487314:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae46fc lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87f8 expref: 230 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.487324:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141500) 00010000:00010000:0.0:1763343031.487327:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.487331:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae46fc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87f8 expref: 230 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.487344:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d000, rc 0) 00000100:00100000:3.0:1763343031.490149:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993396352 00000100:00100000:3.0:1763343031.490163:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993396352 00000100:00100000:3.0:1763343031.491133:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8895 00000100:00100000:3.0:1763343031.491151:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56809:x1848997993396352:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:3.0:1763343031.491274:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4711 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.491299:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4711 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.491313:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4711 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00010000:3.0:1763343031.491473:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000038df090a reply state 000000007c043108 transno 8589939598 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4711 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.491488:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4711 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.491503:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:3.0:1763343031.491507:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343031.491512:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343031.491665:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56809:x1848997993396352:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 520us (1800us total) trans 8589939598 rc 0/0 00000100:00100000:3.0:1763343031.491673:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8895 00000100:00100000:0.0:1763343031.492012:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d13ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56813:x1848997993396096:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 5150us (7690us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343031.492020:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8894 00000100:00100000:0.0:1763343031.495606:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993396480 00000100:00100000:0.0:1763343031.499244:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993396480 00000100:00100000:0.0:1763343031.499346:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8896 00000100:00100000:0.0:1763343031.499356:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56813:x1848997993396480:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.499383:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.499414:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4718 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac87ff expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.499498:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae471f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499515:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae471f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499528:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae471f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499538:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4726 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499544:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4726 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499550:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4726 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499597:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae471f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499605:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae471f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499611:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae471f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499634:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae471f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499641:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.499645:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae471f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499654:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae471f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499668:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141b00) 00010000:00010000:0.0:1763343031.499672:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.499678:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae471f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499685:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae471f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499704:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4726 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499710:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4726 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499715:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4726 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499720:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.499722:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4726 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499728:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4726 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499740:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcb00) 00010000:00010000:0.0:1763343031.499743:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.499746:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4726 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499751:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4726 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.499779:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4718 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87ff expref: 232 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.499791:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141b00) 00010000:00010000:0.0:1763343031.499793:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.499796:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4718 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87ff expref: 232 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.499810:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665dc00, rc 0) 00000100:00100000:0.0:1763343031.499895:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56813:x1848997993396480:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 540us (4668us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343031.499904:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8896 00000100:00100000:1.0:1763343031.500201:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.500262:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993396608 00000100:00100000:3.0:1763343031.500273:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993396608 00000100:00100000:3.0:1763343031.500318:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6191 00000100:00100000:3.0:1763343031.500328:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2429:x1848997993396608:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:3.0:1763343031.500518:0:28996:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343031.500521:0:28996:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb mtime from disk: 1763343031 -> 1763343031 00002000:00010000:3.0:1763343031.500525:0:28996:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb atime from disk: 0 -> 1763343031 00002000:00010000:3.0:1763343031.500527:0:28996:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb ctime from disk: 1763343031 -> 1763343031 00002000:00010000:3.0:1763343031.500530:0:28996:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343031.500896:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2429:x1848997993396608:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 568us (695us total) trans 21474838747 rc 0/0 00000100:00100000:3.0:1763343031.500905:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6191 00000100:00100000:1.0:1763343031.503057:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.503150:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993396864 00000100:00100000:0.0:1763343031.503164:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993396864 00000100:00100000:0.0:1763343031.503230:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3019 00000100:00100000:0.0:1763343031.503243:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56809:x1848997993396864:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:0.0:1763343031.503329:0:6526:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1be:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae457b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac876c expref: 231 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.503393:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343031.503411:0:6526:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae4607 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8796 expref: 231 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.503423:0:6526:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343031.503468:0:6526:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae4607 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8796 expref: 231 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.503483:0:6526:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae4607 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8796 expref: 231 pid: 10041 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1763343031.503500:0:6526:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a354134dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1848998010214528:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343031.503611:0:6526:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34050d56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343031.503822:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.505117:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993396992 00000100:00100000:0.0:1763343031.505129:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993396992 00000100:00100000:0.0:1763343031.505198:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8897 00000100:00100000:0.0:1763343031.505208:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56813:x1848997993396992:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.505227:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.505252:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4734 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8806 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.505326:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae473b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.505339:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae473b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.505353:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae473b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:0.0:1763343031.505411:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343031.505418:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343031.505459:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4734 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8806 expref: 234 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.505480:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae473b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8806 expref: 233 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.505490:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141500) 00010000:00010000:0.0:1763343031.505493:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343031.505497:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c200, rc 0) 00000100:00100000:0.0:1763343031.505578:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56813:x1848997993396992:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 371us (1755us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.505587:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8897 00000100:00100000:1.0:1763343031.509488:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.509541:0:6526:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a354134dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1848998010214528:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343031.509656:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993397120 00000100:00100000:3.0:1763343031.509665:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993397120 00010000:00010000:3.0:1763343031.509712:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae4607 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8796 expref: 233 pid: 10041 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343031.509818:0:6526:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00000100:00100000:3.0:1763343031.509851:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2920 00000100:00100000:3.0:1763343031.509861:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:2429:x1848997993397120:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343031.509879:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343031.509887:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae4607 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8796 expref: 233 pid: 10041 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343031.509899:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae4607 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8796 expref: 233 pid: 10041 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343031.509924:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae4607 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8796 expref: 233 pid: 10041 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343031.509940:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:3.0:1763343031.509945:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343031.509956:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343031.509962:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343031.509997:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343031.510298:0:6526:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343031.510307:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00000100:00100000:3.0:1763343031.510471:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:2429:x1848997993397120:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 609us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.510480:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2920 00000040:00080000:0.0:1763343031.513535:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1313, 88 off111640 00000004:00080000:0.0:1763343031.513572:0:6526:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1225180940769ns, next at 1226132560989ns, rc = 0 00000040:00080000:0.0:1763343031.513665:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1314, 88 off111640 00000100:00100000:3.0:1763343031.513669:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000004:00080000:0.0:1763343031.513674:0:6526:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1225181052420ns, next at 1226132529377ns, rc = 0 00000040:00080000:0.0:1763343031.513716:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1315, 88 off111728 00000004:00080000:0.0:1763343031.513722:0:6526:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1225181101426ns, next at 1226132529377ns, rc = 0 00000100:00100000:3.0:1763343031.513723:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993397248 00000100:00100000:3.0:1763343031.513735:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993397248 00000040:00080000:0.0:1763343031.513744:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1314, 88 off111728 00000004:00080000:0.0:1763343031.513750:0:6526:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1225181129235ns, next at 1226132560989ns, rc = 0 00000100:00100000:3.0:1763343031.513821:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8898 00000100:00100000:3.0:1763343031.513832:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d13aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56813:x1848997993397248:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.513858:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.513884:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4742 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac880d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.513965:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4749 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.513981:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4749 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514006:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4749 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514018:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4750 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514026:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4750 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514032:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4750 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514071:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4749 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514078:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4749 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514085:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4749 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514092:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4749 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514098:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.514103:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4749 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514114:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4749 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514128:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141500) 00010000:00010000:3.0:1763343031.514131:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.514138:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4749 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514144:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4749 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514159:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4750 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514165:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4750 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514172:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4750 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514177:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.514180:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4750 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514186:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4750 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514194:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcb00) 00010000:00010000:3.0:1763343031.514196:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.514199:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4750 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514205:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4750 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.514237:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4742 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac880d expref: 234 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.514248:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141500) 00010000:00010000:3.0:1763343031.514250:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.514254:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4742 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac880d expref: 234 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.514279:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343031.514360:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d13aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56813:x1848997993397248:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 529us (697us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343031.514368:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8898 00000001:00080000:1.0:1763343031.521820:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939599 is committed 00000004:00080000:1.0:1763343031.521831:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 868 committed 00000004:00080000:1.0:1763343031.521847:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 867 committed 00000004:00080000:1.0:1763343031.521860:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 866 committed 00000004:00080000:1.0:1763343031.521862:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 867 committed 00000004:00080000:1.0:1763343031.521874:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 866 committed 00000004:00080000:1.0:1763343031.521876:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 865 committed 00000100:00100000:1.0:1763343031.522036:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010215040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343031.522123:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343031.522169:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343031.522176:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010214656:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343031.522201:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343031.522237:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010214784:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343031.522263:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343031.522281:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343031.522287:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010214912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343031.522309:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343031.522340:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010215040 00000100:00100000:1.0:1763343031.522346:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010215040 00000100:00100000:1.0:1763343031.522384:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010214656 00000100:00100000:1.0:1763343031.522387:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010214656 00000100:00100000:1.0:1763343031.522413:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010214784 00000100:00100000:1.0:1763343031.522416:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010214784 00000100:00100000:1.0:1763343031.522445:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6192 00000100:00100000:1.0:1763343031.522456:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3659:x1848998010215040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763343031.522586:0:28648:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x27a:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343031.522592:0:28648:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x27a:0x0] updating lvb mtime from disk: 1763343031 -> 1763343031 00002000:00010000:1.0:1763343031.522597:0:28648:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x27a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.522603:0:28648:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x27a:0x0] updating lvb ctime from disk: 1763343031 -> 1763343031 00002000:00010000:1.0:1763343031.522608:0:28648:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x27a:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343031.522685:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3659:x1848998010215040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 231us (561us total) trans 17179871450 rc 0/0 00000100:00100000:1.0:1763343031.522694:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6192 00000100:00100000:1.0:1763343031.522715:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6194 00000100:00100000:1.0:1763343031.522721:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3657:x1848998010214784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763343031.522735:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:636 count 1 00002000:00010000:1.0:1763343031.522757:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x27c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343031.522765:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177200/0x607405d401ae4773 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.522777:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.522780:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.522786:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177200/0x607405d401ae4773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.522803:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177200/0x607405d401ae4773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.522813:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177200/0x607405d401ae4773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.522821:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177200/0x607405d401ae4773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.522842:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343031.523028:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010214784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 306us (762us total) trans 17179871452 rc 0/0 00000100:00100000:1.0:1763343031.523042:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6194 00010000:00010000:1.0:1763343031.523079:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343031.523087:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340d177200/0x607405d401ae4773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.523097:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.523103:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177200/0x607405d401ae4773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.523118:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177200/0x607405d401ae4773 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.523147:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340d177200/0x607405d401ae4773 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.523160:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177200/0x607405d401ae4773 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.523184:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.523188:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.523192:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343031.523227:0:3657:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871446 gen 2 00000004:00080000:1.0:1763343031.523235:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b8700, transno 17179871434 00000004:00080000:1.0:1763343031.523246:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095ba680, transno 17179871435 00000004:00080000:1.0:1763343031.523252:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095bb100, transno 17179871436 00000004:00080000:1.0:1763343031.523258:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b9500, transno 17179871437 00000004:00080000:1.0:1763343031.523264:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035e9880, transno 17179871438 00000004:00080000:1.0:1763343031.523269:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34060a9f80, transno 17179871439 00000004:00080000:1.0:1763343031.523272:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035ea300, transno 17179871440 00000004:00080000:1.0:1763343031.523274:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035e8a80, transno 17179871441 00000004:00080000:1.0:1763343031.523277:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b9180, transno 17179871443 00000004:00080000:1.0:1763343031.523280:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095bb800, transno 17179871444 00000004:00080000:1.0:1763343031.523283:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035e8380, transno 17179871445 00000004:00080000:1.0:1763343031.523286:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035eb100, transno 17179871446 00000100:00100000:1.0:1763343031.523293:0:3657:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a340c3bd180 x1848998010214912/t17179871451(17179871451) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343047 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1763343031.523309:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c3bd180/2, rc 0, transno 17179871451 00000100:00100000:1.0:1763343031.523317:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010214912:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763343031.523331:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c3bc380/2, rc 0, transno 17179871452 00000100:00100000:1.0:1763343031.523337:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010214784:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1763343031.523473:0:32357:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 4 in progress, 2 in flight, 12 done 00000004:00080000:1.0:1763343031.523498:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340ccc0000/2, rc 0, transno 17179871450 00000100:00100000:1.0:1763343031.523502:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010215040:0@lo:2:osp-syn-1-0.0 00000004:00010000:1.0:1763343031.523540:0:6526:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000057cfd08c reply state 00000000b2752e9a transno 8589939599 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343031.523555:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343031.523563:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:1.0:1763343031.523565:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763343031.523568:0:6526:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343031.523573:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:1.0:1763343031.523576:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343031.523581:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae457b lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac876c expref: 229 pid: 28422 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1763343031.523672:0:6526:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763343031.523688:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56809:x1848997993396864:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 20448us (20644us total) trans 8589939599 rc 0/0 00000100:00100000:1.0:1763343031.523697:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3019 00010000:00010000:1.0:1763343031.523752:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343031.523765:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343031.523771:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343031.523777:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.523781:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343031.523788:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343031.523798:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:1.0:1763343031.523801:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343031.523804:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343031.523812:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae472d lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 00000100:00100000:3.0:1763343031.523920:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d13bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010215552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.523960:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.523984:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343031.524002:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010215424:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.524024:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.524052:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010215552 00000100:00100000:3.0:1763343031.524057:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010215552 00000100:00100000:3.0:1763343031.524086:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010215424 00000100:00100000:3.0:1763343031.524089:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010215424 00000100:00100000:3.0:1763343031.524107:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6196 00000100:00100000:3.0:1763343031.524113:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d13a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3658:x1848998010215552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343031.524222:0:27833:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343031.524225:0:27833:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb mtime from disk: 1763343031 -> 1763343031 00002000:00010000:3.0:1763343031.524227:0:27833:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb atime from disk: 1763343031 -> 1763343031 00002000:00010000:3.0:1763343031.524230:0:27833:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb ctime from disk: 1763343031 -> 1763343031 00002000:00010000:3.0:1763343031.524233:0:27833:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x277:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343031.524264:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d13a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3658:x1848998010215552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 150us (303us total) trans 21474838748 rc 0/0 00000100:00100000:3.0:1763343031.524271:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6196 00000100:00100000:3.0:1763343031.524285:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6197 00000100:00100000:3.0:1763343031.524292:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3658:x1848998010215424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343031.524305:0:27833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:634 count 1 00002000:00010000:3.0:1763343031.524327:0:27833:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x27a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343031.524333:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae4788 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.524343:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.524345:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.524349:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae4788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.524359:0:27833:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae4788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.524366:0:27833:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae4788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.524373:0:27833:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae4788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.524391:0:27833:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343031.524519:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3658:x1848998010215424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 226us (493us total) trans 21474838749 rc 0/0 00000100:00100000:3.0:1763343031.524526:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6197 00010000:00010000:3.0:1763343031.524544:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343031.524549:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae4788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.524557:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343031.524560:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae4788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.524567:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae4788 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.524580:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae4788 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.524587:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae4788 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.524601:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343031.524603:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343031.524605:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343031.524658:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d139180/2, rc 0, transno 21474838749 00000100:00100000:3.0:1763343031.524664:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010215424:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763343031.524675:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d13bb80/2, rc 0, transno 21474838748 00000100:00100000:3.0:1763343031.524678:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d13bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010215552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.524696:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010215680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.524724:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.524743:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343031.524749:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010215296:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.524770:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.524790:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010215680 00000100:00100000:3.0:1763343031.524795:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010215680 00000100:00100000:3.0:1763343031.524825:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010215296 00000100:00100000:3.0:1763343031.524828:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010215296 00000100:00100000:3.0:1763343031.524847:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6198 00000100:00100000:3.0:1763343031.524853:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3659:x1848998010215680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343031.524919:0:28995:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x278:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343031.524922:0:28995:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x278:0x0] updating lvb mtime from disk: 1763343031 -> 1763343031 00002000:00010000:3.0:1763343031.524924:0:28995:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x278:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343031.524927:0:28995:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x278:0x0] updating lvb ctime from disk: 1763343031 -> 1763343031 00002000:00010000:3.0:1763343031.524929:0:28995:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x278:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343031.524959:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3659:x1848998010215680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (234us total) trans 21474838750 rc 0/0 00000100:00100000:3.0:1763343031.524966:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6198 00000100:00100000:3.0:1763343031.524979:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6199 00000100:00100000:3.0:1763343031.524985:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3659:x1848998010215296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343031.525010:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:633 count 1 00010000:00010000:3.0:1763343031.525021:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae478f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.525034:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae4693 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87d5 expref: 25 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.525048:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343031.525050:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343031.525053:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae478f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.525084:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae4693 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87d5 expref: 25 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.525098:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae4693 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87d5 expref: 25 pid: 28648 timeout: 1325 lvb_type: 0 00000100:00100000:3.0:1763343031.525110:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d138e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010215808:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343031.525155:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108cf00 going to sleep for 11 seconds 00000004:00080000:3.0:1763343031.525182:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d139f80/2, rc 0, transno 21474838750 00000100:00100000:3.0:1763343031.525187:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010215680:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763343031.526146:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae46e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.526161:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae46e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.526168:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae46e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.526174:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.526179:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae46e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.526186:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae46e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.526204:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:0.0:1763343031.526207:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.526212:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae46e0 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.526219:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae46e0 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.526238:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae46d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.526243:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae46d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.526253:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae46d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.526258:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.526260:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae46d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.526265:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae46d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.526271:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcb00) 00010000:00010000:0.0:1763343031.526273:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.526275:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae46d2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.526280:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae46d2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.526292:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4711 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.526297:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4711 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.526302:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4711 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.526307:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.526309:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4711 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.526313:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4711 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.526320:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:0.0:1763343031.526322:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.526325:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4711 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.526329:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4711 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1be:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343031.530913:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.531009:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.531205:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010215168:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343031.531245:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3404b76800/0x607405d401ae476c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343031.531646:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d138e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010215808:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343031.531669:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae478f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343031.531700:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993397888 00000100:00100000:3.0:1763343031.531708:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993397888 00000100:00100000:1.0:1763343031.532338:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993398016 00000100:00100000:1.0:1763343031.532345:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993398016 00010000:00010000:3.0:1763343031.532437:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3404b76e00/0x607405d401ae4685 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87ce expref: 15 pid: 28996 timeout: 1325 lvb_type: 0 00000100:00100000:3.0:1763343031.532602:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2921 00000100:00100000:3.0:1763343031.532616:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993397888:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343031.532660:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343031.532667:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3404b76e00/0x607405d401ae4685 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87ce expref: 15 pid: 28996 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.532678:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae4693 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87d5 expref: 26 pid: 28648 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343031.532686:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3404b76e00/0x607405d401ae4685 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87ce expref: 15 pid: 28996 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1763343031.532747:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2922 00000100:00100000:0.0:1763343031.532757:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350921ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2431:x1848997993398016:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343031.532768:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343031.532773:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae4693 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87d5 expref: 26 pid: 28648 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343031.532783:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae4693 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87d5 expref: 26 pid: 28648 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343031.532810:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae4693 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x279:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87d5 expref: 26 pid: 28648 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343031.532827:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.532829:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.532835:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae478f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.532845:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae478f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.532874:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343031.532939:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350921ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2431:x1848997993398016:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 183us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.532947:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2922 00010000:00010000:3.0:1763343031.533865:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3404b76e00/0x607405d401ae4685 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87ce expref: 15 pid: 28996 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343031.533879:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.533881:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.533884:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3404b76800/0x607405d401ae476c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.533892:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3404b76800/0x607405d401ae476c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.533925:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343031.533951:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993397888:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1338us (2941us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.533958:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2921 00010000:00010000:3.0:1763343031.534038:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae478f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.534047:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae478f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.534063:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae478f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.534070:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae478f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.534088:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343031.534379:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3659:x1848998010215296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9392us (9606us total) trans 21474838751 rc 0/0 00000100:00100000:3.0:1763343031.534389:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6199 00000004:00080000:3.0:1763343031.534451:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d139c00/2, rc 0, transno 21474838751 00000100:00100000:3.0:1763343031.534458:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010215296:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1763343031.536370:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343031.536385:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae478f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.536396:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343031.536401:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae478f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.536412:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae478f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.536428:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343031.536440:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae478f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.536441:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3404b76800/0x607405d401ae476c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.536462:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae478f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.536463:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3404b76800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.536469:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3404b76800/0x607405d401ae476c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.536483:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3404b76800/0x607405d401ae476c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.536495:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.536498:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3404b76800/0x607405d401ae476c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.536499:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343031.536503:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.536510:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3404b76800/0x607405d401ae476c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.536529:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.536531:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.536533:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343031.537744:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c3bf480/2, rc 0, transno 17179871453 00000100:00100000:1.0:1763343031.537757:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010214656:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343031.538714:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.538760:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.538796:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993398272 00000100:00100000:1.0:1763343031.538807:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993398272 00010000:00010000:1.0:1763343031.538854:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae477a lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8814 expref: 228 pid: 6523 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343031.538893:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2923 00000100:00100000:1.0:1763343031.538904:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:2430:x1848997993398272:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.538926:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.538934:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae477a lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8814 expref: 228 pid: 6523 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.538947:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae477a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8814 expref: 228 pid: 6523 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.538976:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3538bf7000) 00010000:00010000:1.0:1763343031.538982:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae479d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.539003:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae479d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.539013:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae479d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.539044:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.539107:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:2430:x1848997993398272:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 203us (400us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343031.540015:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae477a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8814 expref: 229 pid: 6523 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343031.540018:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2923 00000100:00100000:0.0:1763343031.540042:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010215936:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343031.540051:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343031.540060:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae47ab lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343031.540065:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae479d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.540070:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d171600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343031.540076:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae479d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.540077:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae47ab lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343031.540095:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae479d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.540098:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae47ab lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 00000004:00200000:0.0:1763343031.540123:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c2:0x0]: returning size 0 00010000:00010000:1.0:1763343031.540131:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1be:0x0].0x0 (ffff9a35167a9a00) 00010000:00010000:1.0:1763343031.540135:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343031.540140:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae47ab lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343031.540146:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae47ab lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1be:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343031.540157:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.540160:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.540162:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343031.540288:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x27b:0x0], index 0: 0 00000004:00080000:0.0:1763343031.540295:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x27d:0x0], index 1: 0 00000004:00080000:0.0:1763343031.540300:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x27e:0x0], index 1: 0 00000004:00080000:0.0:1763343031.540304:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x27c:0x0], index 0: 0 00010000:00010000:0.0:1763343031.540392:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae479d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.540400:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae479d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.540405:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae479d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.540410:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d171000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.540414:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae479d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.540419:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae479d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.540431:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3538bf7000) 00010000:00010000:0.0:1763343031.540434:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343031.540437:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae479d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.540442:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae479d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.540483:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae4796 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac881b expref: 228 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.540494:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3538bf7000) 00010000:00010000:0.0:1763343031.540496:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343031.540500:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae4796 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac881b expref: 228 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.540516:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d170600, rc 0) 00000100:00100000:0.0:1763343031.540568:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56813:x1848997993397760:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 7349us (9671us total) trans 8589939602 rc 301/301 00000100:00100000:0.0:1763343031.540575:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8900 00000100:00100000:1.0:1763343031.546912:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.546942:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.549765:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993399040 00000100:00100000:0.0:1763343031.549785:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993399040 00000100:00100000:0.0:1763343031.549864:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8902 00000100:00100000:0.0:1763343031.549888:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56809:x1848997993399040:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.549920:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.549954:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae47b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8829 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.550078:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae47c0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550094:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae47c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550107:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae47c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550117:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae47c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550124:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae47c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550129:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae47c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550263:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae47ce lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550271:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae47ce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550279:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae47ce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343031.550291:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c2:0x0]: returning size 0 00010000:00010000:0.0:1763343031.550396:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae47c0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550405:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae47c0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550416:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae47c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550424:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae47c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550430:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.550435:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae47c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550443:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae47c0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550458:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141b00) 00010000:00010000:0.0:1763343031.550462:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.550467:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae47c0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550473:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae47c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550486:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae47c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550493:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae47c7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550498:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae47c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550503:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.550506:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae47c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550516:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae47c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550524:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcb00) 00010000:00010000:0.0:1763343031.550527:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.550530:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae47c7 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550536:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae47c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343031.550579:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae47b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8829 expref: 231 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.550599:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae47ce lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8829 expref: 230 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.550607:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:0.0:1763343031.550609:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343031.550612:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665ce00, rc 0) 00000100:00100000:0.0:1763343031.550743:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56809:x1848997993399040:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 857us (3801us total) trans 8589939604 rc 0/0 00000100:00100000:0.0:1763343031.550751:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8902 00000100:00100000:3.0:1763343031.551603:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.558856:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.558907:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.559039:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993399424 00000100:00100000:0.0:1763343031.559052:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993399424 00000100:00100000:0.0:1763343031.559126:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993399552 00000100:00100000:0.0:1763343031.559130:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993399552 00000100:00100000:0.0:1763343031.559166:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6200 00000100:00100000:0.0:1763343031.559178:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2431:x1848997993399424:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:1.0:1763343031.559197:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6201 00010000:00010000:0.0:1763343031.559202:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763343031.559212:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2429:x1848997993399552:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.559224:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.559230:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae47dc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8830 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.559241:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae47e3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8837 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343031.559262:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x27c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1763343031.559262:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x27e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343031.559294:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.559294:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.559298:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.559299:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.559312:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae47e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8837 expref: 26 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343031.559312:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae47dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8830 expref: 15 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343031.559350:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae47e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8837 expref: 26 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343031.559350:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae47dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8830 expref: 15 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343031.559377:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00010000:00010000:0.0:1763343031.559377:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665cc00, rc 0) 00000100:00100000:1.0:1763343031.559447:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2429:x1848997993399552:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 240us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.559456:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6201 00000100:00100000:0.0:1763343031.561091:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2431:x1848997993399424:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1904us (2240us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.561102:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6200 00000100:00100000:0.0:1763343031.565570:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.565879:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.566349:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8904 00000100:00100000:3.0:1763343031.566361:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:55941:x1848997993399808:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343031.566371:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.566374:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343031.566407:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae47ce lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8829 expref: 233 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.566431:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:3.0:1763343031.566438:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343031.566447:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae47f1 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac883e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.566599:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae47f8 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.566615:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae47f8 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.566676:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae47f8 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:3.0:1763343031.566693:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c2:0x0]: returning size 0 00010000:00010000:3.0:1763343031.566846:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae47f1 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac883e expref: 235 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.568507:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae47f8 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac883e expref: 233 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.568519:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:3.0:1763343031.568522:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1763343031.568526:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93600, rc 0) 00000100:00100000:3.0:1763343031.571228:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.571666:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993400192 00000100:00100000:1.0:1763343031.571679:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993400192 00000100:00100000:1.0:1763343031.571753:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3023 00000100:00100000:1.0:1763343031.571766:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56809:x1848997993400192:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343031.572099:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56809:x1848997993400192:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 334us (875us total) trans 8589939607 rc 0/0 00000100:00100000:1.0:1763343031.572107:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3023 00000100:00100000:3.0:1763343031.576391:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.576437:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.576660:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8905 00000100:00100000:3.0:1763343031.576673:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56809:x1848997993400448:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.576708:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.576739:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4806 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac884c expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.576838:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae480d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.576855:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae480d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.576868:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae480d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.576879:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4814 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.576887:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4814 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.576894:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4814 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577032:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4829 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577043:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4829 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577050:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4829 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577057:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4829 lrc: 3/0,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577062:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.577068:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4829 lrc: 3/0,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577076:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4829 lrc: 4/0,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577087:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:3.0:1763343031.577093:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4829 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577099:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4829 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343031.577117:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c2:0x0]: returning size 0 00010000:00010000:3.0:1763343031.577213:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae480d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577220:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae480d lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577225:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae480d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577230:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.577232:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae480d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577237:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae480d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577244:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdc00) 00010000:00010000:3.0:1763343031.577246:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.577248:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae480d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577257:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae480d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577266:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4814 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577273:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4814 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577278:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4814 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577283:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.577285:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4814 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577291:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4814 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577298:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcb00) 00010000:00010000:3.0:1763343031.577301:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.577304:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4814 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577309:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4814 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.577338:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4806 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac884c expref: 238 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.577349:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdc00) 00010000:00010000:3.0:1763343031.577351:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343031.577355:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4806 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac884c expref: 238 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.577369:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343031.577447:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56809:x1848997993400448:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 777us (1069us total) trans 8589939608 rc 301/301 00000100:00100000:3.0:1763343031.577455:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8905 00000100:00100000:3.0:1763343031.582021:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.588254:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.588382:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.588685:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993401088 00000100:00100000:3.0:1763343031.588700:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993401088 00000100:00100000:3.0:1763343031.588773:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3025 00000100:00100000:3.0:1763343031.588786:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56809:x1848997993401088:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:3.0:1763343031.589008:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56809:x1848997993401088:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 225us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.589018:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3025 00000100:00100000:1.0:1763343031.599168:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.611261:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.611377:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993401728 00000100:00100000:1.0:1763343031.611390:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993401728 00000100:00100000:1.0:1763343031.611472:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8909 00000100:00100000:1.0:1763343031.611484:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56814:x1848997993401728:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.611516:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.611548:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae484c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8861 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.611925:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4853 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612123:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4853 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612140:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4853 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612155:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae485a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612162:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae485a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612168:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae485a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612327:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4861 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612337:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4861 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612344:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4861 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343031.612356:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c2:0x0]: returning size 2 00010000:00010000:1.0:1763343031.612476:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4861 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612484:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4861 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612491:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4861 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612497:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.612501:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4861 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612508:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4861 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612522:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:1.0:1763343031.612525:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1763343031.612532:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4861 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612538:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4861 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612559:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4853 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612564:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4853 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612569:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4853 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612574:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4853 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612579:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.612582:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4853 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612588:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4853 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612595:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdcc00) 00010000:00010000:1.0:1763343031.612598:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.612600:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4853 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612605:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4853 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.612614:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae485a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00000001:00080000:0.0:1763343031.613776:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939612 is committed 00000004:00080000:0.0:1763343031.613788:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 870 committed 00000004:00080000:0.0:1763343031.613806:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 869 committed 00000004:00080000:0.0:1763343031.613822:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 868 committed 00000004:00080000:0.0:1763343031.613825:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 869 committed 00010000:00010000:1.0:1763343031.614328:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae485a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.614339:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae485a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.614344:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.614349:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae485a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.614357:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae485a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.614378:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcb00) 00010000:00010000:1.0:1763343031.614381:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.614387:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae485a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.614393:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae485a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000100:00100000:1.0:1763343031.614515:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010216576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343031.614545:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010216064:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.614651:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.615010:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010216320:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.615044:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.615063:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010216832:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.615088:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.615104:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010216960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343031.615124:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.615150:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010216832 00000100:00100000:3.0:1763343031.615154:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010216832 00000100:00100000:3.0:1763343031.615176:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6202 00000100:00100000:3.0:1763343031.615185:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3660:x1848998010216064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343031.615213:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:633 count 1 00010000:00010000:3.0:1763343031.615239:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae4876 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.615259:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae4520 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8750 expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.615269:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343031.615271:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343031.615275:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae4876 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.615305:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae4520 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8750 expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343031.615687:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343031.615728:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010216576 00000100:00100000:1.0:1763343031.615733:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010216576 00000100:00100000:1.0:1763343031.615760:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6204 00000100:00100000:1.0:1763343031.615766:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3657:x1848998010216320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343031.615781:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:632 count 1 00010000:00010000:1.0:1763343031.615800:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae487d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x278:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.615812:0:28993:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae46f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87f1 expref: 25 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.615818:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343031.615820:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343031.615823:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae487d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x278:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.615843:0:28993:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae46f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87f1 expref: 25 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343031.616022:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010216192:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343031.616055:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343031.616161:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010216704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.616188:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343031.616219:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010216192 00000100:00100000:0.0:1763343031.616223:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010216192 00000100:00100000:0.0:1763343031.616240:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010216704 00000100:00100000:0.0:1763343031.616243:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010216704 00000100:00100000:0.0:1763343031.616253:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6205 00000100:00100000:0.0:1763343031.616259:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3657:x1848998010216832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343031.616425:0:28995:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x27c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343031.616428:0:28995:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x27c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343031.616431:0:28995:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x27c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343031.616434:0:28995:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x27c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343031.616436:0:28995:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x27c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343031.616478:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3657:x1848998010216832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 218us (1387us total) trans 21474838752 rc 0/0 00000100:00100000:0.0:1763343031.616485:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6205 00000100:00100000:0.0:1763343031.616502:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6206 00000100:00100000:0.0:1763343031.616509:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3657:x1848998010216960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343031.616596:0:28995:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343031.616600:0:28995:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343031.616602:0:28995:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343031.616604:0:28995:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343031.616606:0:28995:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343031.616654:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3657:x1848998010216960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (1528us total) trans 17179871454 rc 0/0 00000100:00100000:0.0:1763343031.616661:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6206 00000100:00100000:0.0:1763343031.616677:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6207 00000100:00100000:0.0:1763343031.616683:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3659:x1848998010216576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343031.616760:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3659:x1848998010216576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (1073us total) trans 21474838753 rc 0/0 00000100:00100000:0.0:1763343031.616766:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6207 00000100:00100000:0.0:1763343031.616782:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6208 00000100:00100000:0.0:1763343031.616788:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3660:x1848998010216192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343031.616799:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:631 count 1 00010000:00010000:0.0:1763343031.616814:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae4884 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.616828:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae4631 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87ab expref: 25 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343031.616835:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.616836:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.616839:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae4884 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.616866:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae4631 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87ab expref: 25 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343031.618005:0:28993:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae46f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87f1 expref: 25 pid: 28648 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343031.618026:0:28993:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010217344:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343031.618086:0:28993:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35011ca840 going to sleep for 11 seconds 00000004:00080000:1.0:1763343031.618141:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b91180/2, rc 0, transno 21474838753 00000100:00100000:1.0:1763343031.618147:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010216576:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343031.618226:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae484c lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8861 expref: 227 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.618242:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdcc00) 00010000:00010000:1.0:1763343031.618245:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343031.618250:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae484c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8861 expref: 227 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.618279:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:1.0:1763343031.618316:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56814:x1848997993401728:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6835us (7071us total) trans 8589939613 rc 301/301 00000100:00100000:1.0:1763343031.618323:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8909 00010000:00010000:0.0:1763343031.619273:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae4631 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac87ab expref: 25 pid: 28993 timeout: 1325 lvb_type: 1 00000100:00100000:0.0:1763343031.619299:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010217472:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343031.619375:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34050d56c0 going to sleep for 11 seconds 00010000:00010000:3.0:1763343031.619511:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae4520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8750 expref: 14 pid: 28996 timeout: 1325 lvb_type: 0 00000100:00100000:3.0:1763343031.619527:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010217088:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343031.619561:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c300 going to sleep for 11 seconds 00000004:00080000:3.0:1763343031.619659:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c250380/2, rc 0, transno 21474838752 00000100:00100000:3.0:1763343031.619666:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010216832:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343031.619685:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b9500/2, rc 0, transno 17179871454 00000100:00100000:3.0:1763343031.619691:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010216960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.622856:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.622906:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993401856 00000100:00100000:1.0:1763343031.622919:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993401856 00000100:00100000:1.0:1763343031.623233:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8910 00000100:00100000:1.0:1763343031.623245:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56814:x1848997993401856:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.623324:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.623397:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae488b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8868 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.624180:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4892 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.624201:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4892 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.624214:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4892 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343031.624249:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c2:0x0]: returning size 2 00000004:00200000:1.0:1763343031.624255:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343031.624290:0:10042:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4892 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.624325:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae488b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8868 expref: 228 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343031.624326:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:1.0:1763343031.624349:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4892 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8868 expref: 227 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.624358:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:1.0:1763343031.624361:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343031.624366:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:1.0:1763343031.624451:0:28993:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010217344:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343031.624480:0:28993:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae487d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x278:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343031.624526:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56814:x1848997993401856:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1282us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.624544:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993401984 00000100:00100000:0.0:1763343031.624551:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993401984 00000100:00100000:0.0:1763343031.624597:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6210 00000100:00100000:0.0:1763343031.624605:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:55941:x1848997993401984:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343031.624643:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.624660:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4899 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac886f expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343031.624685:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x27b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343031.624705:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.624708:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.624718:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4899 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac886f expref: 27 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.624731:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4899 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac886f expref: 27 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.625355:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665dc00, rc 0) 00000100:00100000:1.0:1763343031.625380:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8910 00000100:00100000:0.0:1763343031.625409:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:55941:x1848997993401984:12345-192.168.204.21@tcp:101:bash.0 Request processed in 804us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.625417:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6210 00000100:00100000:3.0:1763343031.627408:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.627460:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.627915:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.628234:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340664a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010217088:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343031.631144:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae4876 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343031.631248:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.631279:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993402496 00000100:00100000:3.0:1763343031.631288:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993402496 00010000:00010000:3.0:1763343031.631328:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae4520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8750 expref: 14 pid: 28996 timeout: 1325 lvb_type: 0 00000100:00100000:3.0:1763343031.631359:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2927 00000100:00100000:3.0:1763343031.631368:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993402496:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343031.631385:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343031.631390:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae4520 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8750 expref: 14 pid: 28996 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343031.631403:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae4520 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8750 expref: 14 pid: 28996 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343031.631424:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae4520 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8750 expref: 14 pid: 28996 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343031.631440:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.631442:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.631447:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae4876 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.631457:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae4876 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.631477:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343031.631530:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993402496:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 163us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.631537:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2927 00000100:00100000:3.0:1763343031.632340:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.632369:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.632397:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993402624 00000100:00100000:3.0:1763343031.632404:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993402624 00000100:00100000:3.0:1763343031.632438:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6211 00000100:00100000:3.0:1763343031.632446:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:55941:x1848997993402624:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343031.632466:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.632488:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae48a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8876 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343031.632515:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x27d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343031.632533:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.632535:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.632543:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae48a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8876 expref: 14 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.632557:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae48a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8876 expref: 14 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.632569:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343031.632607:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:55941:x1848997993402624:12345-192.168.204.21@tcp:101:bash.0 Request processed in 162us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.632617:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6211 00010000:00010000:1.0:1763343031.633050:0:28993:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae487d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.633062:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae487d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.633074:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae487d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.633082:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae487d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.633102:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343031.633401:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3657:x1848998010216320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17632us (18353us total) trans 21474838755 rc 0/0 00000100:00100000:1.0:1763343031.633409:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6204 00010000:00010000:1.0:1763343031.633434:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343031.633441:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae487d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.633450:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.633454:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae487d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.633464:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae487d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.633480:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae487d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.633488:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae487d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.633508:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.633511:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.633513:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343031.633556:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406ab0000/2, rc 0, transno 21474838755 00000100:00100000:1.0:1763343031.633563:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010216320:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.634139:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.634164:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.635593:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993402880 00000100:00100000:3.0:1763343031.635607:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993402880 00000100:00100000:3.0:1763343031.635689:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3026 00000100:00100000:3.0:1763343031.635700:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56814:x1848997993402880:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343031.636005:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56814:x1848997993402880:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 307us (3633us total) trans 8589939614 rc 0/0 00000100:00100000:3.0:1763343031.636014:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3026 00000100:00100000:1.0:1763343031.636392:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993403008 00000100:00100000:1.0:1763343031.636399:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993403008 00002000:00010000:1.0:1763343031.636427:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/635 (0->18446744073709551615) 00002000:00100000:1.0:1763343031.636433:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406649500 with x1848997993403008 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343031.636446:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406649500. 00000100:00100000:1.0:1763343031.636464:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993403136 00000100:00100000:1.0:1763343031.636468:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993403136 00002000:00010000:1.0:1763343031.636483:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/637 (0->18446744073709551615) 00002000:00100000:1.0:1763343031.636486:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406648700 with x1848997993403136 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343031.636493:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3406648700. 00000100:00100000:1.0:1763343031.636510:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1530 00000100:00100000:1.0:1763343031.636518:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2430:x1848997993403008:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:1.0:1763343031.636713:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x27b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343031.636717:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x27b:0x0] updating lvb mtime from disk: 0 -> 1763343031 00002000:00010000:1.0:1763343031.636720:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x27b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.636722:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x27b:0x0] updating lvb ctime from disk: 0 -> 1763343031 00002000:00010000:1.0:1763343031.636724:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x27b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343031.636756:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2430:x1848997993403008:12345-192.168.204.21@tcp:10:bash.0 Request processed in 239us (2620us total) trans 21474838756 rc 0/0 00000100:00100000:1.0:1763343031.636763:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1530 00002000:00010000:1.0:1763343031.636766:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/635 (0->18446744073709551615) 00002000:00100000:1.0:1763343031.636769:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406649500 with x1848997993403008 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343031.636774:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406649500. 00000100:00100000:1.0:1763343031.636793:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1531 00000100:00100000:1.0:1763343031.636799:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993403136:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:1.0:1763343031.636900:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x27d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343031.636903:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x27d:0x0] updating lvb mtime from disk: 0 -> 1763343031 00002000:00010000:1.0:1763343031.636905:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x27d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.636908:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x27d:0x0] updating lvb ctime from disk: 0 -> 1763343031 00002000:00010000:1.0:1763343031.636910:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x27d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343031.636932:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993403136:12345-192.168.204.21@tcp:10:bash.0 Request processed in 133us (2766us total) trans 17179871457 rc 0/0 00000100:00100000:1.0:1763343031.636938:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1531 00002000:00010000:1.0:1763343031.636940:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/637 (0->18446744073709551615) 00002000:00100000:1.0:1763343031.636943:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406648700 with x1848997993403136 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343031.636947:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3406648700. 00010000:00010000:1.0:1763343031.637442:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343031.637451:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae4876 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.637460:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.637465:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae4876 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.637475:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae4876 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343031.637546:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b8700/2, rc 0, transno 17179871458 00000100:00100000:3.0:1763343031.637555:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010216064:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763343031.638035:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae4876 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.638043:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae4876 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.638064:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.638066:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.638068:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343031.638266:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.638616:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993403264 00000100:00100000:1.0:1763343031.638649:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993403264 00000100:00100000:1.0:1763343031.638695:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8911 00000100:00100000:1.0:1763343031.638701:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56814:x1848997993403264:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.638728:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.638753:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae48a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac887d expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.638863:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae48ae lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.638878:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae48ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.638890:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae48ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.638904:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae48b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.638910:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae48b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.638916:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae48b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639006:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae48bc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639017:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae48bc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639024:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae48bc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343031.639076:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c2:0x0]: returning size 2 00000004:00200000:1.0:1763343031.639081:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343031.639103:0:10042:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae48bc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639114:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae48bc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639124:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae48ae lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639129:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae48ae lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639135:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae48ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639141:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae48ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639146:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.639150:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae48ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639155:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae48ae lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639164:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc800) 00010000:00010000:1.0:1763343031.639167:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.639170:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae48ae lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639176:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae48ae lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639188:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae48b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639193:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae48b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639198:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae48b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639203:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.639206:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae48b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639211:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae48b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639217:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcc00) 00010000:00010000:1.0:1763343031.639220:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.639222:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae48b5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639228:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae48b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.639263:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae48a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac887d expref: 230 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.639277:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae48bc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac887d expref: 229 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.639283:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:1.0:1763343031.639286:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343031.639289:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176800, rc 0) 00000100:00100000:1.0:1763343031.639352:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56814:x1848997993403264:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 649us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.639359:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8911 00000100:00100000:3.0:1763343031.640754:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.641071:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993403520 00000100:00100000:0.0:1763343031.641082:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993403520 00000100:00100000:0.0:1763343031.641146:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3027 00000100:00100000:0.0:1763343031.641157:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:55941:x1848997993403520:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343031.641540:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:55941:x1848997993403520:12345-192.168.204.21@tcp:35:bash.0 Request processed in 383us (793us total) trans 8589939615 rc 0/0 00000100:00100000:0.0:1763343031.641550:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3027 00000100:00100000:0.0:1763343031.642873:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.643046:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993403648 00000100:00100000:1.0:1763343031.643058:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993403648 00000100:00100000:1.0:1763343031.643231:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 405 00000100:00100000:1.0:1763343031.643243:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:2430:x1848997993403648:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.643264:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.643299:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae48bc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac887d expref: 230 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.643322:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:1.0:1763343031.643328:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.643395:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:2430:x1848997993403648:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 154us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.643403:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 405 00000100:00100000:1.0:1763343031.647914:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.653112:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010217600:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343031.653155:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae48ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:1.0:1763343031.655459:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.656046:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993404160 00000100:00100000:0.0:1763343031.656062:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993404160 00000100:00100000:0.0:1763343031.656149:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8913 00000100:00100000:0.0:1763343031.656161:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56815:x1848997993404160:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:0.0:1763343031.656242:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1763343031.656285:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae4845 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac885a expref: 231 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.656311:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae4822 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8853 expref: 230 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.656322:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:0.0:1763343031.656328:0:10042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae48ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.656338:0:10042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae48ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.656345:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343031.656381:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae48d1 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.656395:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae48d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.656405:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae48d1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.656421:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae48d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.656427:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae48d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.656433:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae48d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.656537:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.656546:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae48ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.656553:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.656572:0:10042:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae48ca lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.656582:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:1.0:1763343031.657607:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.657836:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993404288 00000100:00100000:0.0:1763343031.657847:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993404288 00010000:00010000:0.0:1763343031.657889:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4892 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8868 expref: 230 pid: 10042 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1763343031.657969:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2928 00000100:00100000:0.0:1763343031.657979:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:2430:x1848997993404288:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343031.658005:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343031.658013:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4892 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8868 expref: 230 pid: 10042 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343031.658026:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4892 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8868 expref: 230 pid: 10042 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343031.658045:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4892 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8868 expref: 230 pid: 10042 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343031.658062:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:0.0:1763343031.658068:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae48ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.658077:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae48ca lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.658084:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae48ca lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.658092:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.658099:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.658354:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343031.659114:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:2430:x1848997993404288:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1131us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.659125:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2928 00000100:00100000:3.0:1763343031.664231:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.664321:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.664441:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993404416 00000100:00100000:0.0:1763343031.664454:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993404416 00000100:00100000:0.0:1763343031.664525:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8914 00000100:00100000:0.0:1763343031.664535:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56814:x1848997993404416:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.664565:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.664589:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae48ed lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac888b expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.664732:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae48f4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.664747:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.664755:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae48f4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.664774:0:28422:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.664785:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae48f4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343031.664846:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993404544 00000100:00100000:1.0:1763343031.664850:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993404544 00010000:00010000:1.0:1763343031.664873:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae48ca lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8884 expref: 231 pid: 6523 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343031.664906:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2929 00000100:00100000:1.0:1763343031.664913:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:2432:x1848997993404544:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.664924:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.664930:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae48ca lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8884 expref: 231 pid: 6523 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.664944:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae48ca lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8884 expref: 231 pid: 6523 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.664966:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae48ca lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1c2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8884 expref: 231 pid: 6523 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.664985:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:1.0:1763343031.665001:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.665012:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.665019:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343031.665028:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae48f4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.665034:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae48f4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.665039:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae48f4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.665056:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.665120:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:2432:x1848997993404544:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 207us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.665131:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2929 00010000:00010000:0.0:1763343031.665805:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.665814:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10042 initiator: MDT0 00000004:00080000:0.0:1763343031.666147:0:10042:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1c2:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763343031.666247:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666254:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666261:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666275:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.666279:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666287:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666298:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:0.0:1763343031.666301:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343031.666304:0:10042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae48f4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.666312:0:10042:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae48f4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.666317:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae48f4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.666349:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666356:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae48df lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666373:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae48d1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666377:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae48d1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666383:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae48d1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666388:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae48d1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666393:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.666396:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae48d1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666402:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae48d1 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666408:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bf300) 00010000:00010000:0.0:1763343031.666410:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.666412:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae48d1 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666417:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae48d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:0.0:1763343031.666432:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f4d9e04a reply state 0000000052171488 transno 8589939617 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae48d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666444:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae48d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.666450:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bfb00) 00010000:00010000:0.0:1763343031.666452:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343031.666454:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343031.666517:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56815:x1848997993404160:12345-192.168.204.21@tcp:36:rm.0 Request processed in 10357us (11070us total) trans 8589939617 rc 0/0 00000100:00100000:0.0:1763343031.666524:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8913 00000100:00100000:3.0:1763343031.683289:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.683333:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.683675:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8915 00000100:00100000:1.0:1763343031.683689:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56814:x1848997993404800:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.683720:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.683749:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae48fb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8892 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.683876:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4910 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.683890:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4910 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343031.683904:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4910 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343031.683924:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c2:0x0]: returning size 5 00010000:00010000:1.0:1763343031.684095:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae48fb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8892 expref: 235 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.684126:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4910 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8892 expref: 234 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.684136:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:1.0:1763343031.684140:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343031.684145:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00000100:00100000:1.0:1763343031.684238:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56814:x1848997993404800:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 551us (973us total) trans 8589939618 rc 0/0 00000100:00100000:1.0:1763343031.684247:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8915 00000100:00100000:1.0:1763343031.686824:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.689702:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.692779:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.692873:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993405312 00000100:00100000:0.0:1763343031.692885:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993405312 00002000:00100000:0.0:1763343031.692948:0:24021:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x27b:0x0] (0->4) req@ffff9a34095b8000 x1848997993405312/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:527/0 lens 496/0 e 0 to 0 dl 1763343042 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343031.692966:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b8000 with x1848997993405312 ext(0->4) 00010000:00010000:0.0:1763343031.692977:0:24021:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4899 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac886f expref: 27 pid: 28996 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343031.693004:0:24021:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4899 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac886f expref: 27 pid: 28996 timeout: 1325 lvb_type: 0 00002000:00010000:0.0:1763343031.693012:0:24021:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a34095b8000 00000100:00100000:0.0:1763343031.693047:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 100 00000100:00100000:0.0:1763343031.693057:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2430:x1848997993405312:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:3.0:1763343031.693700:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010217728:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343031.693729:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76800/0x607405d401ae4925 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343031.698514:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2430:x1848997993405312:12345-192.168.204.21@tcp:4:bash.0 Request processed in 5439us (5725us total) trans 21474838757 rc 0/0 00000100:00100000:0.0:1763343031.698535:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 100 00002000:00100000:0.0:1763343031.698555:0:24021:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x27b:0x0] (0->4) req@ffff9a34095b8000 x1848997993405312/t21474838757(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:527/0 lens 496/448 e 0 to 0 dl 1763343042 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343031.698567:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b8000 with x1848997993405312 ext(0->4) 00010000:00010000:0.0:1763343031.698580:0:24021:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4899 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac886f expref: 29 pid: 28996 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343031.698607:0:24021:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4899 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac886f expref: 29 pid: 28996 timeout: 1325 lvb_type: 0 00002000:00010000:0.0:1763343031.698616:0:24021:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a34095b8000 00000100:00100000:1.0:1763343031.701513:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.701611:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993405440 00000100:00100000:3.0:1763343031.701657:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993405440 00000100:00100000:3.0:1763343031.701724:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8918 00000100:00100000:3.0:1763343031.701735:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56816:x1848997993405440:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.701762:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.701791:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4941 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac88a7 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.701875:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4948 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.701893:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4948 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.701907:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4948 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343031.701971:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343031.701978:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343031.702028:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4941 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88a7 expref: 234 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.702047:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4948 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88a7 expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.702056:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdf00) 00010000:00010000:3.0:1763343031.702059:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343031.702064:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343031.702267:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56816:x1848997993405440:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 533us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.702276:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8918 00000100:00100000:3.0:1763343031.703273:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.703353:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993405568 00000100:00100000:0.0:1763343031.703363:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993405568 00010000:00010000:0.0:1763343031.703398:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4899 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac886f expref: 29 pid: 28996 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1763343031.703435:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2930 00000100:00100000:0.0:1763343031.703442:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2432:x1848997993405568:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343031.703456:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1763343031.703476:0:6510:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x27b:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1763343031.703480:0:6510:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x27b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763343031.703486:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4899 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac886f expref: 29 pid: 28996 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343031.703499:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4899 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac886f expref: 29 pid: 28996 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343031.703520:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4899 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac886f expref: 29 pid: 28996 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343031.703538:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.703540:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.703545:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76800/0x607405d401ae4925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.703556:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76800/0x607405d401ae4925 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.703588:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343031.703656:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2432:x1848997993405568:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 213us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.703664:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2930 00010000:00010000:3.0:1763343031.703721:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76800/0x607405d401ae4925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.703731:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76800/0x607405d401ae4925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.703754:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76800/0x607405d401ae4925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.703762:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76800/0x607405d401ae4925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.703770:0:28994:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76800/0x607405d401ae4925 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.703776:0:28994:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3404b76800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343031.703781:0:28994:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76800/0x607405d401ae4925 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.703789:0:28994:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76800/0x607405d401ae4925 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.703800:0:28994:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76800/0x607405d401ae4925 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.703811:0:28994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76800/0x607405d401ae4925 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343031.703863:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2429:x1848997993405056:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 13990us (17043us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.703871:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6212 00000100:00100000:1.0:1763343031.705323:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.705360:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.705419:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993405696 00000100:00100000:3.0:1763343031.705430:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993405696 00000100:00100000:3.0:1763343031.705481:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993405952 00000100:00100000:3.0:1763343031.705484:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993405952 00000100:00100000:3.0:1763343031.705503:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8919 00000100:00100000:3.0:1763343031.705511:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56816:x1848997993405696:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.705533:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.705555:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae494f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac88ae expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.705659:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4956 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705674:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4956 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705685:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4956 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705696:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae495d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705703:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae495d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705710:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae495d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705757:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4956 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705763:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4956 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705770:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4956 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705776:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.705781:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4956 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705788:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4956 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705799:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdf00) 00010000:00010000:3.0:1763343031.705803:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.705806:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4956 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705813:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4956 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705825:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae495d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705831:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae495d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705837:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae495d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705842:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.705845:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae495d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705851:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae495d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705858:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bfb00) 00010000:00010000:3.0:1763343031.705860:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.705863:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae495d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705867:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae495d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.705894:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae494f lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88ae expref: 235 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.705905:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdf00) 00010000:00010000:3.0:1763343031.705908:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.705911:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae494f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88ae expref: 235 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.705920:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:3.0:1763343031.705981:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56816:x1848997993405696:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 469us (666us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343031.705998:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8919 00000100:00100000:3.0:1763343031.706023:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8920 00000100:00100000:3.0:1763343031.706030:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56814:x1848997993405952:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:3.0:1763343031.706058:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343031.706072:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae48f4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac888b expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.706082:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:3.0:1763343031.706086:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343031.706104:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4964 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.706112:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4964 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.706119:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4964 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:0.0:1763343031.706427:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1319, 88 off112120 00000004:00080000:0.0:1763343031.706437:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1225373815337ns, next at 1226132560989ns, rc = 0 00000040:00080000:0.0:1763343031.706473:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1320, 88 off112120 00000004:00080000:0.0:1763343031.706478:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1225373857157ns, next at 1226132529377ns, rc = 0 00000040:00080000:0.0:1763343031.706503:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1321, 88 off112208 00000004:00080000:0.0:1763343031.706508:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1225373887400ns, next at 1226132529377ns, rc = 0 00000040:00080000:0.0:1763343031.706518:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1320, 88 off112208 00000004:00080000:0.0:1763343031.706523:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1225373901649ns, next at 1226132560989ns, rc = 0 00000001:00080000:1.0:1763343031.708891:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939619 is committed 00000004:00080000:1.0:1763343031.708903:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 872 committed 00000004:00080000:1.0:1763343031.708921:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 871 committed 00000004:00080000:1.0:1763343031.708936:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 870 committed 00000004:00080000:1.0:1763343031.708938:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 871 committed 00000100:00100000:0.0:1763343031.709149:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343031.709177:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010217856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.709265:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343031.709314:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010217984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.709339:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343031.709378:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010217856 00000100:00100000:0.0:1763343031.709388:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010217856 00000100:00100000:0.0:1763343031.709439:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010217984 00000100:00100000:0.0:1763343031.709443:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010217984 00000100:00100000:0.0:1763343031.709468:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6213 00000100:00100000:0.0:1763343031.709478:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3657:x1848998010217856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343031.709697:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x27d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343031.709701:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x27d:0x0] updating lvb mtime from disk: 1763343031 -> 1763343031 00002000:00010000:0.0:1763343031.709704:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x27d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343031.709706:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x27d:0x0] updating lvb ctime from disk: 1763343031 -> 1763343031 00002000:00010000:0.0:1763343031.709708:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x27d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343031.709748:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3657:x1848998010217856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 272us (482us total) trans 17179871459 rc 0/0 00000100:00100000:0.0:1763343031.709757:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6213 00000100:00100000:0.0:1763343031.709776:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6214 00000100:00100000:0.0:1763343031.709782:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3659:x1848998010217984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343031.709835:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343031.709838:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343031.709840:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343031.709842:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343031.709844:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343031.709873:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3659:x1848998010217984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (532us total) trans 17179871460 rc 0/0 00000100:00100000:0.0:1763343031.709879:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6214 00000004:00080000:0.0:1763343031.709923:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad1f80/2, rc 0, transno 17179871460 00000100:00100000:0.0:1763343031.709929:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010217984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343031.709948:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad0700/2, rc 0, transno 17179871459 00000100:00100000:0.0:1763343031.709951:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010217856:0@lo:2:osp-syn-1-0.0 00000004:00010000:0.0:1763343031.710009:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002565af47 reply state 0000000003c20954 transno 8589939619 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4964 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.710033:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4964 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.710043:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:0.0:1763343031.710046:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343031.710050:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1763343031.710140:0:28422:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343031.710155:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56814:x1848997993405952:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 4123us (4791us total) trans 8589939619 rc 0/0 00000100:00100000:0.0:1763343031.710167:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8920 00010000:00010000:3.0:1763343031.710529:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae48d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.710539:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae48d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.710548:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae48d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.710554:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.710560:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae48d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.710568:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae48d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.710583:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bfb00) 00010000:00010000:3.0:1763343031.710586:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.710590:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae48d8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343031.710596:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae48d8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000100:00100000:1.0:1763343031.713098:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.713755:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.714354:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993406208 00000100:00100000:1.0:1763343031.714367:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993406208 00000100:00100000:1.0:1763343031.714433:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993406336 00000100:00100000:1.0:1763343031.714436:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993406336 00000100:00100000:1.0:1763343031.714460:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8921 00000100:00100000:1.0:1763343031.714469:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56816:x1848997993406208:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.714495:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.714499:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343031.714534:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4948 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88a7 expref: 226 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.714561:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdf00) 00010000:00010000:1.0:1763343031.714574:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343031.714595:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae496b lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac88b5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.714768:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4972 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.714785:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4972 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.714796:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4972 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.714809:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4979 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.714816:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4979 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.714823:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4979 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.715344:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4980 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.715354:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4980 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.715363:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4980 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343031.715374:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c3:0x0]: returning size 0 00010000:00010000:1.0:1763343031.715405:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4972 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.715412:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4972 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.715419:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4972 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.715425:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4972 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.715432:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.715437:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4972 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.715446:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4972 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.715454:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde400) 00010000:00010000:1.0:1763343031.715458:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.715462:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4972 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.715468:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4972 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:1.0:1763343031.715480:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001ec2ea95 reply state 00000000478a0007 transno 8589939620 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4979 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.715491:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4979 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.715497:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdea00) 00010000:00010000:1.0:1763343031.715499:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343031.715502:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343031.715531:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae496b lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88b5 expref: 228 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.715549:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4980 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88b5 expref: 227 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.715555:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a3403bde900) 00010000:00010000:1.0:1763343031.715559:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343031.715561:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:1.0:1763343031.715678:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56816:x1848997993406208:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1208us (2589us total) trans 8589939620 rc 0/0 00000100:00100000:1.0:1763343031.715687:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8921 00000100:00100000:1.0:1763343031.715861:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8922 00000100:00100000:1.0:1763343031.715872:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56814:x1848997993406336:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.715887:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.715899:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae498e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac88bc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.715934:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae498e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88bc expref: 228 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.715946:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae498e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88bc expref: 228 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.715963:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:1.0:1763343031.715966:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343031.715969:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343031.716009:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56814:x1848997993406336:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 140us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.716015:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8922 00000100:00100000:0.0:1763343031.722479:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.723282:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.723426:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993406720 00000100:00100000:0.0:1763343031.723430:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993406720 00000100:00100000:0.0:1763343031.723462:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8923 00000100:00100000:0.0:1763343031.723473:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56814:x1848997993406464:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.723504:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.723533:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4995 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac88c3 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.723646:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae499c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.723664:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae499c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.723676:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae499c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343031.723739:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c2:0x0]: returning size 5 00000004:00200000:0.0:1763343031.723744:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343031.723765:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae499c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.723794:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4995 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88c3 expref: 231 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.723813:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae499c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88c3 expref: 230 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.723830:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:0.0:1763343031.723834:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763343031.723838:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d800, rc 0) 00000100:00100000:0.0:1763343031.723902:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56814:x1848997993406464:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 431us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.723910:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8923 00000100:00100000:0.0:1763343031.723932:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8924 00000100:00100000:0.0:1763343031.723939:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56816:x1848997993406720:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.723945:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.723954:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae49a3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac88ca expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.724027:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49aa lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.724038:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4980 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88b5 expref: 230 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.724047:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49aa lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.724084:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4980 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88b5 expref: 230 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.724098:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4980 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88b5 expref: 230 pid: 6523 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1763343031.724119:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010218368:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343031.724184:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3507845240 going to sleep for 11 seconds 00000100:00100000:1.0:1763343031.728097:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.728237:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.728615:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993406976 00000100:00100000:3.0:1763343031.728645:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993406976 00000100:00100000:3.0:1763343031.728678:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6217 00000100:00100000:3.0:1763343031.728685:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2429:x1848997993406976:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.728705:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.728728:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae49b1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac88d1 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343031.728755:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x27b:0x0] initial LVB size: 5, mtime: 0x691a7ab7, atime: 0x0, ctime: 0x691a7ab7, blocks: 0x8 00010000:00010000:3.0:1763343031.728776:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.728778:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.728791:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae49b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88d1 expref: 28 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343031.728808:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae49b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88d1 expref: 28 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343031.728823:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92a00, rc 0) 00010000:00010000:0.0:1763343031.729024:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4980 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88b5 expref: 230 pid: 6523 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1763343031.729048:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010218368:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343031.729079:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49aa lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.729089:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49aa lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.729095:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49aa lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343031.729126:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c3:0x0]: returning size 0 00000100:00100000:3.0:1763343031.729153:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2429:x1848997993406976:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 466us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.729160:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6217 00000004:00080000:0.0:1763343031.729384:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x27f:0x0], index 1: 0 00000004:00080000:0.0:1763343031.729392:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x27d:0x0], index 0: 0 00000004:00080000:0.0:1763343031.729397:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x27e:0x0], index 0: 0 00000004:00080000:0.0:1763343031.729400:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x280:0x0], index 1: 0 00010000:00010000:0.0:1763343031.729542:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49aa lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.729551:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49aa lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.729558:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49aa lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.729568:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.729572:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49aa lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.729581:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49aa lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.729595:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a3403bde900) 00010000:00010000:0.0:1763343031.729598:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343031.729602:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49aa lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.729608:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49aa lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.729680:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae49a3 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88ca expref: 230 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.729690:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a3403bde900) 00010000:00010000:0.0:1763343031.729693:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343031.729697:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae49a3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88ca expref: 230 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.730787:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d600, rc 0) 00000100:00100000:0.0:1763343031.730878:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56816:x1848997993406720:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6934us (7592us total) trans 8589939621 rc 301/301 00000100:00100000:0.0:1763343031.730887:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8924 00000100:00100000:1.0:1763343031.733058:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.733146:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993407232 00000100:00100000:3.0:1763343031.733159:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993407232 00000100:00100000:3.0:1763343031.733226:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3028 00000100:00100000:3.0:1763343031.733236:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56816:x1848997993407232:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343031.733830:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56816:x1848997993407232:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 591us (782us total) trans 8589939622 rc 0/0 00000100:00100000:3.0:1763343031.733840:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3028 00000100:00100000:1.0:1763343031.735698:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.737185:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993407488 00000100:00100000:0.0:1763343031.737205:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993407488 00000100:00100000:0.0:1763343031.737300:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3029 00000100:00100000:0.0:1763343031.737312:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56816:x1848997993407488:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343031.737656:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56816:x1848997993407488:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 346us (1969us total) trans 8589939623 rc 0/0 00000100:00100000:0.0:1763343031.737665:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3029 00000100:00100000:0.0:1763343031.743609:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993407744 00000100:00100000:0.0:1763343031.743673:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993407744 00000100:00100000:0.0:1763343031.743752:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8925 00000100:00100000:0.0:1763343031.743763:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:55941:x1848997993407744:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343031.743795:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.743827:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae49bf lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac88d8 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.744035:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744054:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744069:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744082:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49cd lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744091:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744098:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744175:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae49d4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744183:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae49d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744190:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae49d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343031.744203:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c3:0x0]: returning size 0 00010000:00010000:0.0:1763343031.744465:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744474:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49c6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744481:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744487:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.744492:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744500:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49c6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744515:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bf300) 00010000:00010000:0.0:1763343031.744518:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.744524:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744531:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae49c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744552:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744559:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744565:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744569:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.744571:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744576:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744584:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdea00) 00010000:00010000:0.0:1763343031.744586:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.744590:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49cd lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.744595:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49cd lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.745011:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae49bf lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88d8 expref: 234 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.745035:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae49d4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88d8 expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.745042:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a34037bfe00) 00010000:00010000:0.0:1763343031.745045:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343031.745048:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665ca00, rc 0) 00000100:00100000:0.0:1763343031.745251:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:55941:x1848997993407744:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1486us (1936us total) trans 8589939624 rc 0/0 00000100:00100000:0.0:1763343031.745261:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8925 00000100:00100000:1.0:1763343031.752216:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.752399:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993407872 00000100:00100000:0.0:1763343031.752415:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993407872 00000100:00100000:0.0:1763343031.752510:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8926 00000100:00100000:0.0:1763343031.752523:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:55941:x1848997993407872:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343031.752557:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.752588:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae49e2 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac88df expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.752873:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae49e9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.752891:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae49e9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.752907:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae49e9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.753083:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae49e2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88df expref: 235 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.753105:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae49e9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88df expref: 234 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.753116:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a34037bfe00) 00010000:00010000:0.0:1763343031.753121:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343031.753126:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665ce00, rc 0) 00000100:00100000:0.0:1763343031.754410:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:55941:x1848997993407872:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1873us (2194us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.754426:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8926 00000100:00100000:1.0:1763343031.761140:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.761194:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.761720:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993408000 00000100:00100000:3.0:1763343031.761735:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993408000 00000100:00100000:3.0:1763343031.761810:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6218 00000100:00100000:3.0:1763343031.761823:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2429:x1848997993408000:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:3.0:1763343031.761964:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2429:x1848997993408000:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 143us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.761971:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6218 00000100:00100000:0.0:1763343031.762073:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993408256 00000100:00100000:0.0:1763343031.762078:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993408256 00000100:00100000:0.0:1763343031.762133:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8927 00000100:00100000:0.0:1763343031.762141:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:55941:x1848997993408256:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343031.762195:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343031.762230:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae49d4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88d8 expref: 234 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.762253:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a34037bfe00) 00010000:00010000:0.0:1763343031.762259:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343031.762513:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49f0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.762529:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49f0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.762540:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49f0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000001:00080000:0.0:1763343031.762596:0:28422:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939625 00000004:00010000:0.0:1763343031.762647:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009e8a085a reply state 0000000047b11c07 transno 8589939626 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49f0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.762661:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.762667:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a34037bfe00) 00010000:00010000:0.0:1763343031.762670:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343031.762673:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343031.762747:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:55941:x1848997993408256:12345-192.168.204.21@tcp:36:bash.0 Request processed in 607us (1552us total) trans 8589939626 rc 0/0 00000100:00100000:0.0:1763343031.762754:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8927 00000020:00080000:0.0:1763343031.762759:0:28422:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343031.765078:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.766093:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993408384 00000100:00100000:3.0:1763343031.766108:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993408384 00000100:00100000:3.0:1763343031.766661:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8928 00000100:00100000:1.0:1763343031.766661:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.766674:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:55941:x1848997993408384:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343031.767024:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.767052:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae49f7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac88e6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.767118:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae49f7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88e6 expref: 237 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.767135:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae49f7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88e6 expref: 237 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.767163:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a34037bfe00) 00010000:00010000:3.0:1763343031.767167:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343031.767172:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:3.0:1763343031.767213:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:55941:x1848997993408384:12345-192.168.204.21@tcp:101:bash.0 Request processed in 542us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.767220:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8928 00000100:00100000:1.0:1763343031.770482:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.770545:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.770715:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993408896 00000100:00100000:3.0:1763343031.770729:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993408896 00000100:00100000:3.0:1763343031.770813:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8929 00000100:00100000:3.0:1763343031.770827:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:55941:x1848997993408896:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343031.770854:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.770859:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343031.770894:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae49f7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88e6 expref: 237 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.770917:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a34037bfe00) 00010000:00010000:3.0:1763343031.770924:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343031.770941:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae49fe lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac88ed expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.771014:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4a05 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.771031:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4a05 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.771042:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4a05 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:3.0:1763343031.771369:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1322, 88 off112296 00000004:00080000:3.0:1763343031.771379:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1225438757161ns, next at 1226132529377ns, rc = 0 00000040:00080000:3.0:1763343031.771425:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1321, 88 off112296 00000004:00080000:3.0:1763343031.771431:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1225438809757ns, next at 1226132560989ns, rc = 0 00000040:00080000:3.0:1763343031.771447:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1322, 88 off112384 00000004:00080000:3.0:1763343031.771452:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1225438830782ns, next at 1226132560989ns, rc = 0 00000040:00080000:3.0:1763343031.771462:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1323, 88 off112384 00000004:00080000:3.0:1763343031.771465:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1225438844831ns, next at 1226132529377ns, rc = 0 00000100:00100000:0.0:1763343031.771548:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993408768 00000100:00100000:0.0:1763343031.771555:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993408768 00000100:00100000:0.0:1763343031.771646:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1532 00000100:00100000:0.0:1763343031.771658:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2431:x1848997993408768:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:0.0:1763343031.771700:0:24021:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4a0c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.771713:0:24021:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.771716:0:24021:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.771723:0:24021:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4a0c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.771735:0:24021:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4a0c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.771868:0:24021:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4a0c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.771878:0:24021:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4a0c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.771886:0:24021:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4a0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.771899:0:24021:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343031.771905:0:24021:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4a0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.771914:0:24021:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4a0c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.771931:0:24021:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4a0c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.771939:0:24021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4a0c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343031.772052:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2431:x1848997993408768:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 396us (1583us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763343031.772060:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1532 00000001:00080000:1.0:1763343031.774793:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939627 is committed 00000004:00080000:1.0:1763343031.774808:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 873 committed 00000004:00080000:1.0:1763343031.774819:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 874 committed 00000004:00080000:1.0:1763343031.774833:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 873 committed 00000004:00080000:1.0:1763343031.774836:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 872 committed 00010000:00010000:3.0:1763343031.775524:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4a05 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88ed expref: 231 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.775541:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a34037bfe00) 00010000:00010000:3.0:1763343031.775544:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343031.775564:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae49fe lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88ed expref: 231 pid: 6523 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763343031.775587:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4a05 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88ed expref: 230 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.775642:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a34037bfe00) 00010000:00010000:3.0:1763343031.775645:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343031.775649:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343031.775715:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:55941:x1848997993408896:12345-192.168.204.21@tcp:101:bash.0 Request processed in 4890us (5168us total) trans 8589939627 rc 0/0 00000100:00100000:3.0:1763343031.775726:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8929 00010000:00010000:0.0:1763343031.775838:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4979 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.775849:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4979 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.775856:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4979 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.775863:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.775868:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4979 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.775882:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4979 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.775894:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdea00) 00010000:00010000:0.0:1763343031.775897:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.775901:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4979 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.775908:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4979 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.775932:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.775938:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.775943:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.775949:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.775952:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.775957:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.775965:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a34037bfe00) 00010000:00010000:0.0:1763343031.775968:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.775971:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49f0 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.775976:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae49f0 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1c3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:0.0:1763343031.776152:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010218752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343031.776186:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343031.776236:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343031.776247:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010218880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343031.776644:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010218496 00000100:00100000:0.0:1763343031.776656:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010218496 00000100:00100000:0.0:1763343031.776711:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010218624 00000100:00100000:0.0:1763343031.776715:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010218624 00000100:00100000:0.0:1763343031.776737:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010218752 00000100:00100000:0.0:1763343031.776740:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010218752 00000100:00100000:0.0:1763343031.776761:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6220 00000100:00100000:0.0:1763343031.776769:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3657:x1848998010218496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.776975:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3657:x1848998010218496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 205us (1823us total) trans 17179871461 rc 0/0 00000100:00100000:0.0:1763343031.776981:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6220 00000100:00100000:0.0:1763343031.777005:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6221 00000100:00100000:0.0:1763343031.777011:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3659:x1848998010218624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.777070:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010218624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (1837us total) trans 17179871462 rc 0/0 00000100:00100000:0.0:1763343031.777076:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6221 00000100:00100000:0.0:1763343031.777086:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6222 00000100:00100000:0.0:1763343031.777091:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3660:x1848998010218752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343031.777178:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3660:x1848998010218752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (991us total) trans 21474838760 rc 0/0 00000100:00100000:0.0:1763343031.777183:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6222 00000004:00080000:0.0:1763343031.777230:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3403ad6a00/2, rc 0, transno 21474838760 00000100:00100000:0.0:1763343031.777236:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010218752:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343031.777294:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34060a9c00/2, rc 0, transno 17179871462 00000100:00100000:0.0:1763343031.777300:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010218624:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343031.777318:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34060aaa00/2, rc 0, transno 17179871461 00000100:00100000:0.0:1763343031.777322:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010218496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343031.777428:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343031.781805:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.784199:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.784609:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993409152 00000100:00100000:0.0:1763343031.784654:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993409152 00000100:00100000:0.0:1763343031.784738:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6224 00000100:00100000:0.0:1763343031.784751:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:55941:x1848997993409152:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343031.784777:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.784806:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae4a13 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac88fb expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343031.784837:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x27f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343031.784868:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.784870:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.784882:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae4a13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88fb expref: 16 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.784901:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae4a13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88fb expref: 16 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.784915:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665ca00, rc 0) 00000100:00100000:0.0:1763343031.784980:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:55941:x1848997993409152:12345-192.168.204.21@tcp:101:bash.0 Request processed in 232us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.785002:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6224 00000100:00100000:3.0:1763343031.787252:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993409024 00000100:00100000:3.0:1763343031.787369:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993409024 00000100:00100000:1.0:1763343031.790683:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.792189:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.792244:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993409408 00000100:00100000:0.0:1763343031.792252:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993409408 00000100:00100000:0.0:1763343031.792307:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1533 00000100:00100000:0.0:1763343031.792316:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993409408:12345-192.168.204.21@tcp:4:lfs.0 00010000:00010000:0.0:1763343031.792346:0:28425:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae4a2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.792362:0:28425:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae47dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8830 expref: 16 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343031.792370:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.792372:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.792374:0:28425:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae4a2f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.792413:0:28425:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae47dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8830 expref: 16 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343031.792429:0:28425:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae47dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8830 expref: 16 pid: 28995 timeout: 1325 lvb_type: 1 00000100:00100000:0.0:1763343031.792446:0:28425:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:28425:1848998010219008:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343031.792523:0:28425:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3507845240 going to sleep for 11 seconds 00000100:00100000:1.0:1763343031.795932:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.795977:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.796141:0:28425:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:28425:1848998010219008:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343031.796175:0:28425:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae4a2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343031.796581:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993409536 00000100:00100000:3.0:1763343031.796591:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993409536 00002000:00010000:3.0:1763343031.796675:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/639 (0->18446744073709551615) 00002000:00100000:3.0:1763343031.796681:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34035e8a80 with x1848997993409536 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343031.796696:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34035e8a80. 00000100:00100000:3.0:1763343031.796733:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993409664 00000100:00100000:3.0:1763343031.796737:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993409664 00002000:00010000:3.0:1763343031.796754:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/637 (0->18446744073709551615) 00002000:00100000:3.0:1763343031.796757:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34035e8380 with x1848997993409664 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343031.796766:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34035e8380. 00000100:00100000:3.0:1763343031.796786:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1534 00000100:00100000:3.0:1763343031.796796:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993409536:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343031.797067:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x27f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343031.797071:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x27f:0x0] updating lvb mtime from disk: 0 -> 1763343031 00002000:00010000:3.0:1763343031.797074:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x27f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343031.797076:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x27f:0x0] updating lvb ctime from disk: 0 -> 1763343031 00002000:00010000:3.0:1763343031.797078:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x27f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343031.797153:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993409536:12345-192.168.204.21@tcp:10:bash.0 Request processed in 357us (1234us total) trans 17179871463 rc 0/0 00000100:00100000:3.0:1763343031.797162:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1534 00002000:00010000:3.0:1763343031.797167:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/639 (0->18446744073709551615) 00002000:00100000:3.0:1763343031.797170:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34035e8a80 with x1848997993409536 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343031.797175:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34035e8a80. 00000100:00100000:3.0:1763343031.797200:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1535 00000100:00100000:3.0:1763343031.797207:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2430:x1848997993409664:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343031.797316:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x27d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343031.797319:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x27d:0x0] updating lvb mtime from disk: 0 -> 1763343031 00002000:00010000:3.0:1763343031.797321:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x27d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343031.797324:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x27d:0x0] updating lvb ctime from disk: 0 -> 1763343031 00002000:00010000:3.0:1763343031.797326:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x27d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343031.797348:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2430:x1848997993409664:12345-192.168.204.21@tcp:10:bash.0 Request processed in 142us (1371us total) trans 21474838762 rc 0/0 00000100:00100000:3.0:1763343031.797355:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1535 00002000:00010000:3.0:1763343031.797357:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/637 (0->18446744073709551615) 00002000:00100000:3.0:1763343031.797360:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34035e8380 with x1848997993409664 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343031.797364:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34035e8380. 00000100:00100000:3.0:1763343031.797517:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.798037:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993409792 00000100:00100000:0.0:1763343031.798045:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993409792 00010000:00010000:0.0:1763343031.798077:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae47dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8830 expref: 18 pid: 28995 timeout: 1325 lvb_type: 1 00000100:00100000:0.0:1763343031.798119:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2932 00000100:00100000:0.0:1763343031.798128:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993409792:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343031.798142:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343031.798158:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae47dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x27e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8830 expref: 18 pid: 28995 timeout: 1325 lvb_type: 1 00010000:00010000:0.0:1763343031.798172:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae47dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x27e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8830 expref: 18 pid: 28995 timeout: 1325 lvb_type: 1 00010000:00010000:0.0:1763343031.798202:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae47dc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x27e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8830 expref: 18 pid: 28995 timeout: 1325 lvb_type: 1 00010000:00010000:0.0:1763343031.798222:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.798224:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.798230:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae4a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.798240:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae4a2f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.798279:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343031.798315:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993409792:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 189us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.798322:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2932 00010000:00010000:1.0:1763343031.798432:0:28425:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae4a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.798443:0:28425:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae4a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1763343031.804047:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871464 is committed 00000001:00080000:0.0:1763343031.804071:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871462 is committed 00000100:00100000:3.0:1763343031.804724:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00002000:00010000:1.0:1763343031.805238:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1763343031.805244:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb mtime from disk: 0 -> 1763343031 00002000:00010000:1.0:1763343031.805247:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb ctime from disk: 0 -> 1763343031 00002000:00010000:1.0:1763343031.805250:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763343031.805267:0:28425:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae4a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.805281:0:28425:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae4a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.805290:0:28425:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae4a2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.805431:0:28425:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.805437:0:28425:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae4a2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.805447:0:28425:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae4a2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.805472:0:28425:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae4a2f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.805480:0:28425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae4a2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343031.805588:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993409408:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 13269us (13397us total) trans 17179871464 rc 0/0 00000100:00100000:1.0:1763343031.805602:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1533 00000100:00100000:1.0:1763343031.821669:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.821798:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993410176 00000100:00100000:0.0:1763343031.821813:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993410176 00000100:00100000:0.0:1763343031.822012:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8931 00000100:00100000:0.0:1763343031.822025:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56817:x1848997993410176:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:0.0:1763343031.822055:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.822087:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4a36 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8909 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.822181:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a3d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822198:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a3d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822211:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a3d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822225:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4a44 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822232:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4a44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822238:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4a44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822329:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4a4b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822339:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4a4b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822350:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4a4b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343031.822401:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c3:0x0]: returning size 5 00000004:00200000:0.0:1763343031.822407:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343031.822430:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4a4b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822443:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4a4b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822453:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a3d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822459:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a3d lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822466:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a3d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822473:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.822477:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a3d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822486:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a3d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822499:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141800) 00010000:00010000:0.0:1763343031.822503:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.822508:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a3d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822515:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a3d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822530:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4a44 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822536:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4a44 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822541:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4a44 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822545:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.822549:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4a44 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822554:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4a44 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822561:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3541141400) 00010000:00010000:0.0:1763343031.822564:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.822566:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4a44 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822572:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4a44 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.822604:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4a36 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8909 expref: 232 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.826115:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4a4b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8909 expref: 231 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.826138:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a34037bfe00) 00010000:00010000:0.0:1763343031.826143:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343031.826149:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c000, rc 0) 00000100:00100000:1.0:1763343031.826508:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56817:x1848997993410176:12345-192.168.204.21@tcp:101:rm.0 Request processed in 4478us (4892us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.826524:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8931 00000100:00100000:1.0:1763343031.827782:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993410432 00000100:00100000:1.0:1763343031.827796:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993410432 00000100:00100000:1.0:1763343031.828263:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8932 00000100:00100000:1.0:1763343031.828275:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56814:x1848997993410432:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:1.0:1763343031.828391:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.828425:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae499c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c2:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88c3 expref: 231 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.828445:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:1.0:1763343031.828450:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343031.828697:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4a52 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.828715:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4a52 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.828726:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4a52 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00010000:1.0:1763343031.828965:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006b0a9211 reply state 000000002411dc36 transno 8589939629 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4a52 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.828980:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4a52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.828997:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:1.0:1763343031.829000:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343031.829003:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343031.829128:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56814:x1848997993410432:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 854us (2534us total) trans 8589939629 rc 0/0 00000100:00100000:1.0:1763343031.829138:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8932 00000100:00100000:3.0:1763343031.838265:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993410560 00000100:00100000:3.0:1763343031.838289:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993410560 00000100:00100000:3.0:1763343031.838384:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6226 00000100:00100000:3.0:1763343031.838395:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:56814:x1848997993410560:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.838418:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.838446:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae4a59 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8910 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343031.838473:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x27e:0x0] initial LVB size: 4096, mtime: 0x691a7ab7, atime: 0x0, ctime: 0x691a7ab7, blocks: 0x8 00010000:00010000:3.0:1763343031.838500:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.838503:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.838512:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae4a59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8910 expref: 14 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.838535:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae4a59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8910 expref: 14 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.838549:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343031.838648:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:56814:x1848997993410560:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 254us (3078us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.838655:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6226 00000100:00100000:0.0:1763343031.840133:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993410816 00000100:00100000:0.0:1763343031.840148:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993410816 00000100:00100000:0.0:1763343031.840486:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8933 00000100:00100000:0.0:1763343031.840499:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56817:x1848997993410816:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:0.0:1763343031.840573:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763343031.840607:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4a05 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88ed expref: 232 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.840671:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4a4b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8909 expref: 231 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.840685:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae49e9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88df expref: 230 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.840696:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a34037bfe00) 00010000:00010000:0.0:1763343031.840709:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343031.840739:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4a60 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.840753:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4a60 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.840764:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4a60 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.840776:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4a67 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.840782:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4a67 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.840789:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4a67 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.840889:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a6e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.840897:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a6e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.840910:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a6e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:0.0:1763343031.841237:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1324, 64 off112448 00000040:00080000:0.0:1763343031.841262:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1323, 64 off112448 00000040:00080000:0.0:1763343031.841272:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1324, 64 off112512 00000040:00080000:0.0:1763343031.841280:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1325, 64 off112512 00010000:00010000:0.0:1763343031.841344:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4a75 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.841354:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4a75 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.841363:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4a75 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.841371:0:28422:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4a75 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1c3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.841377:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4a75 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1c3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.841384:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4a75 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.841424:0:28422:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343031.841449:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a6e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.841456:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a6e lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.841459:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343031.841462:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a6e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.841469:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4a75 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1c3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.841471:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.841479:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a6e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.841481:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.841487:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4a75 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1c3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.841493:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a6e lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.841496:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4a75 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.841513:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a3541141500) 00010000:00010000:0.0:1763343031.841519:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343031.842267:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a6e lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.842276:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4a6e lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.842441:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4a60 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.842448:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4a60 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.842455:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4a60 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.842464:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343031.842468:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4a60 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.842474:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4a60 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.842485:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141800) 00010000:00010000:0.0:1763343031.842488:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343031.842491:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4a60 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.842497:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4a60 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343031.842513:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000058ca1ab4 reply state 00000000fde878c2 transno 8589939630 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4a67 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.842525:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4a67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343031.842532:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3541141400) 00010000:00010000:0.0:1763343031.842535:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343031.842538:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343031.842804:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c3:0x0].0x0 (ffff9a3541141500) 00010000:00010000:1.0:1763343031.842809:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343031.842813:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4a75 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1c3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.842819:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4a75 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1c3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343031.842846:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.842848:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.842851:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343031.842870:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993410944 00000100:00100000:1.0:1763343031.842879:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993410944 00000100:00100000:1.0:1763343031.842943:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6227 00000100:00100000:1.0:1763343031.842954:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:56814:x1848997993410944:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.842972:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.843000:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae4a7c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8917 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.843037:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae47e3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8837 expref: 31 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343031.843046:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.843048:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.843067:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae4a7c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8917 expref: 31 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.843110:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae47e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8837 expref: 31 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343031.843126:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae47e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8837 expref: 31 pid: 28648 timeout: 1325 lvb_type: 1 00000100:00100000:1.0:1763343031.843141:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010219136:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343031.843345:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56817:x1848997993410816:12345-192.168.204.21@tcp:36:rm.0 Request processed in 2847us (4431us total) trans 8589939630 rc 0/0 00000100:00100000:0.0:1763343031.843355:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8933 00000100:00100000:1.0:1763343031.843774:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343031.850424:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010219136:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343031.850484:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae4a7c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8917 expref: 31 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.850512:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:1.0:1763343031.850608:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:56814:x1848997993410944:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 7654us (8497us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.850641:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6227 00000100:00100000:3.0:1763343031.850857:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.851236:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993411072 00000100:00100000:1.0:1763343031.851246:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993411072 00010000:00010000:1.0:1763343031.851286:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae47e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8837 expref: 31 pid: 28648 timeout: 1325 lvb_type: 1 00000100:00100000:1.0:1763343031.851333:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2933 00000100:00100000:1.0:1763343031.851344:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2429:x1848997993411072:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.851361:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.851389:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae47e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x27c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8837 expref: 31 pid: 28648 timeout: 1325 lvb_type: 1 00010000:00010000:1.0:1763343031.851403:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae47e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8837 expref: 31 pid: 28648 timeout: 1325 lvb_type: 1 00010000:00010000:1.0:1763343031.851434:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae47e3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x27c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8837 expref: 31 pid: 28648 timeout: 1325 lvb_type: 1 00010000:00010000:1.0:1763343031.851452:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.851454:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.851462:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae4a7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8917 expref: 30 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.851473:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae4a7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8917 expref: 30 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.851516:0:27834:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae4a7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8917 expref: 30 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343031.851540:0:27834:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:27834:1848998010219264:192.168.204.21@tcp:105: 00000100:00100000:1.0:1763343031.854276:0:27834:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343031.858499:0:27834:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:27834:1848998010219264:192.168.204.21@tcp:105: 00010000:00010000:1.0:1763343031.858542:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.860398:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2429:x1848997993411072:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 9044us (9529us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.860416:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2933 00000100:00100000:3.0:1763343031.864355:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993411456 00000100:00100000:3.0:1763343031.864370:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993411456 00000100:00100000:3.0:1763343031.864488:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8934 00000100:00100000:3.0:1763343031.864502:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56818:x1848997993411456:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.864535:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.864568:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4a83 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac891e expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.864701:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4a8a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864720:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4a8a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864734:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4a8a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864748:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4a91 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864761:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4a91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864768:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4a91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864820:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4a8a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864828:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4a8a lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864835:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4a8a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864842:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.864847:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4a8a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864856:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4a8a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864871:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdf00) 00010000:00010000:3.0:1763343031.864875:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.864880:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4a8a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864887:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4a8a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864902:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4a91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864907:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4a91 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864914:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4a91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864919:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.864922:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4a91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864928:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4a91 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864936:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3541141400) 00010000:00010000:3.0:1763343031.864939:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.864942:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4a91 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864947:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4a91 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.864978:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4a83 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac891e expref: 232 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.865003:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdf00) 00010000:00010000:3.0:1763343031.865006:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.865011:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4a83 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac891e expref: 232 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.865027:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:3.0:1763343031.865108:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56818:x1848997993411456:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 609us (889us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343031.865117:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8934 00000100:00100000:1.0:1763343031.865284:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993411200 00000100:00100000:1.0:1763343031.865292:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993411200 00002000:00010000:1.0:1763343031.865328:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/638 (5->18446744073709551615) 00002000:00100000:1.0:1763343031.865333:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060aa680 with x1848997993411200 ext(5->18446744073709551615) 00002000:00010000:1.0:1763343031.865344:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34060aa680. 00000100:00100000:1.0:1763343031.865827:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993411328 00000100:00100000:1.0:1763343031.865832:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993411328 00002000:00010000:1.0:1763343031.865850:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/636 (0->18446744073709551615) 00002000:00100000:1.0:1763343031.865853:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060a9880 with x1848997993411328 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343031.865861:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34060a9880. 00000100:00100000:1.0:1763343031.869380:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1537 00000100:00100000:1.0:1763343031.869406:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2430:x1848997993411328:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:1.0:1763343031.869669:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x27c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343031.869675:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x27c:0x0] updating lvb mtime from disk: 0 -> 1763343031 00002000:00010000:1.0:1763343031.869680:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x27c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.869684:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x27c:0x0] updating lvb ctime from disk: 0 -> 1763343031 00002000:00010000:1.0:1763343031.869688:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x27c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343031.870088:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993411328:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 691us (8135us total) trans 21474838763 rc 0/0 00000100:00100000:1.0:1763343031.870096:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1537 00002000:00010000:1.0:1763343031.870099:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/636 (0->18446744073709551615) 00002000:00100000:1.0:1763343031.870102:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060a9880 with x1848997993411328 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343031.870108:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34060a9880. 00000100:00100000:3.0:1763343031.876652:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993411584 00000100:00100000:3.0:1763343031.876666:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993411584 00000100:00100000:3.0:1763343031.876738:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8935 00000100:00100000:3.0:1763343031.876748:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56818:x1848997993411584:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.876774:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.876803:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4a98 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8925 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.876889:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4a9f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.876906:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4a9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.876920:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4a9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.876931:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4aa6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.876937:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.876942:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.877001:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4a9f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.877007:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4a9f lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.877013:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4a9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.877019:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.877023:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4a9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.877030:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4a9f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.877042:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdf00) 00010000:00010000:3.0:1763343031.877045:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.877049:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4a9f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.877053:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4a9f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.877064:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.877069:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4aa6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.877074:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.877078:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.877080:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.877084:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4aa6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.877088:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3541141400) 00010000:00010000:3.0:1763343031.877090:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.877093:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4aa6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.877098:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4aa6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.877123:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4a98 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8925 expref: 232 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.877132:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bdf00) 00010000:00010000:3.0:1763343031.877134:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.877137:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4a98 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8925 expref: 232 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.877149:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93c00, rc 0) 00000100:00100000:3.0:1763343031.877219:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56818:x1848997993411584:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 471us (1039us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343031.877227:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8935 00000100:00100000:0.0:1763343031.879364:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.887260:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993412096 00000100:00100000:1.0:1763343031.887274:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993412096 00000100:00100000:1.0:1763343031.887682:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6228 00000100:00100000:1.0:1763343031.887694:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2429:x1848997993412096:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:1.0:1763343031.887886:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x27b:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343031.887890:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x27b:0x0] updating lvb mtime from disk: 1763343031 -> 1763343031 00002000:00010000:1.0:1763343031.887893:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x27b:0x0] updating lvb atime from disk: 0 -> 1763343031 00002000:00010000:1.0:1763343031.887895:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x27b:0x0] updating lvb ctime from disk: 1763343031 -> 1763343031 00002000:00010000:1.0:1763343031.887897:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x27b:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343031.888974:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2429:x1848997993412096:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 1272us (1865us total) trans 21474838764 rc 0/0 00000100:00100000:1.0:1763343031.888997:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6228 00000100:00100000:1.0:1763343031.892887:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.893609:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993412224 00000100:00100000:3.0:1763343031.893669:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993412224 00000100:00100000:3.0:1763343031.893751:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8938 00000100:00100000:3.0:1763343031.893763:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56818:x1848997993412224:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.893797:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.893826:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4ac2 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8933 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.893918:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4ac9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.893936:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.893950:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.893961:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ad0 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.893967:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.893972:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.894029:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.894037:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4ac9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.894044:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4ac9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.894050:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.894055:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4ac9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.894063:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4ac9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.894078:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:3.0:1763343031.894081:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.894087:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4ac9 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.894093:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4ac9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.894107:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.894113:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ad0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.894119:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.894123:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.894126:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.894132:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ad0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.894139:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3541141400) 00010000:00010000:3.0:1763343031.894142:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.894145:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ad0 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.894151:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ad0 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343031.894180:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4ac2 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8933 expref: 235 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.894191:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:3.0:1763343031.894193:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343031.894197:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4ac2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8933 expref: 235 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.894211:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93c00, rc 0) 00000100:00100000:3.0:1763343031.894296:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56818:x1848997993412224:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 534us (1425us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343031.894305:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8938 00000100:00100000:0.0:1763343031.898809:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.898862:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.898962:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993412480 00000100:00100000:1.0:1763343031.898978:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993412480 00000100:00100000:1.0:1763343031.899061:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3031 00000100:00100000:1.0:1763343031.899073:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56814:x1848997993412480:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:1.0:1763343031.899153:0:14879:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1c2:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4910 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8892 expref: 234 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.899224:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4ad7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.899239:0:14879:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae498e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88bc expref: 234 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.899251:0:14879:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4ad7 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.900245:0:14879:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae498e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88bc expref: 235 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.900260:0:14879:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae498e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88bc expref: 235 pid: 6523 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343031.900276:0:14879:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ae680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010219392:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343031.900383:0:14879:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1763343031.902456:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae4af3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.902482:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae4af3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.902495:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae4af3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343031.902509:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c5:0x0]: returning size 0 00010000:00010000:1.0:1763343031.902544:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae4ae5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.902552:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae4ae5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.902559:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae4ae5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.902567:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae4ae5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.902573:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3404b76e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.902578:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae4ae5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.902587:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae4ae5 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.902600:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7500) 00010000:00010000:1.0:1763343031.902604:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.902610:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae4ae5 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.902617:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae4ae5 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:1.0:1763343031.903679:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a703c372 reply state 00000000d9f95aac transno 8589939632 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae4aec lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.903696:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae4aec lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.903703:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3541141400) 00010000:00010000:1.0:1763343031.903706:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343031.903710:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343031.903760:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae4ade lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac893a expref: 237 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.903789:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae4af3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac893a expref: 236 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.903796:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3403bdc000) 00010000:00010000:1.0:1763343031.903798:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343031.903802:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343031.903880:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56818:x1848997993412736:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4184us (5016us total) trans 8589939632 rc 0/0 00000100:00100000:1.0:1763343031.903890:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8939 00000100:00100000:0.0:1763343031.904797:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.905236:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993412864 00000100:00100000:1.0:1763343031.905248:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993412864 00010000:00010000:1.0:1763343031.905296:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae498e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88bc expref: 237 pid: 6523 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343031.905655:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2934 00000100:00100000:1.0:1763343031.905667:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:2430:x1848997993412864:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.905685:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.905692:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae498e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88bc expref: 237 pid: 6523 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.905706:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae498e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88bc expref: 237 pid: 6523 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.905730:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae498e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88bc expref: 237 pid: 6523 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.905753:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:1.0:1763343031.905758:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4ad7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.905770:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4ad7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.905778:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4ad7 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.905815:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.905886:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:2430:x1848997993412864:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 220us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.905894:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2934 00000100:00100000:0.0:1763343031.909073:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.910262:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993413120 00000100:00100000:1.0:1763343031.910278:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993413120 00000100:00100000:1.0:1763343031.910351:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8940 00000100:00100000:1.0:1763343031.910363:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56818:x1848997993413120:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.910391:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.910419:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4b01 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8941 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.910560:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4b08 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.910579:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae4af3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac893a expref: 238 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.910589:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4b08 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.910664:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae4af3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac893a expref: 238 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.910680:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae4af3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac893a expref: 238 pid: 6523 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343031.910695:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010219520:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343031.910797:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406a47c00 going to sleep for 11 seconds 00000001:00080000:1.0:1763343031.911706:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939633 is committed 00000004:00080000:1.0:1763343031.911715:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 876 committed 00000004:00080000:1.0:1763343031.911733:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 875 committed 00000100:00100000:3.0:1763343031.912238:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010220032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.912317:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.912356:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343031.912361:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010219648:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.912382:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.912409:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010219776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.912429:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.912445:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343031.912450:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010219904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.912468:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763343031.912711:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 874 committed 00000100:00100000:0.0:1763343031.916304:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010220544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.916376:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343031.916416:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763343031.916423:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010220416:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.916444:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343031.916509:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010220544 00000100:00100000:0.0:1763343031.916517:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010220544 00000100:00100000:0.0:1763343031.916563:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010220416 00000100:00100000:0.0:1763343031.916566:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010220416 00000100:00100000:0.0:1763343031.916584:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6233 00000100:00100000:0.0:1763343031.916592:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3660:x1848998010220544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343031.916789:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x27d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343031.916794:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x27d:0x0] updating lvb mtime from disk: 1763343031 -> 1763343031 00002000:00010000:0.0:1763343031.916797:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x27d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343031.916799:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x27d:0x0] updating lvb ctime from disk: 1763343031 -> 1763343031 00002000:00010000:0.0:1763343031.916802:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x27d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343031.916841:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3660:x1848998010220544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 248us (465us total) trans 17179871466 rc 0/0 00000100:00100000:0.0:1763343031.916849:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6233 00000100:00100000:0.0:1763343031.916867:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6234 00000100:00100000:0.0:1763343031.916873:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3660:x1848998010220416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343031.916887:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:640 count 1 00002000:00010000:0.0:1763343031.916913:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x280:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343031.916921:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4b1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.916942:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.916945:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.916951:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4b1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.916965:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4b1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.916976:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4b1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.916996:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4b1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.917018:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763343031.917189:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3660:x1848998010220416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 316us (743us total) trans 17179871467 rc 0/0 00000100:00100000:0.0:1763343031.917196:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6234 00000100:00100000:0.0:1763343031.917237:0:3660:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871462 gen 2 00000004:00080000:0.0:1763343031.917243:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340ccc0000, transno 17179871450 00000004:00080000:0.0:1763343031.917252:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c3bd180, transno 17179871451 00000004:00080000:0.0:1763343031.917255:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c3bc380, transno 17179871452 00000004:00080000:0.0:1763343031.917258:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c3bf480, transno 17179871453 00000004:00080000:0.0:1763343031.917261:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b9500, transno 17179871454 00000004:00080000:0.0:1763343031.917264:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095bb100, transno 17179871455 00000004:00080000:0.0:1763343031.917266:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095ba680, transno 17179871456 00000004:00080000:0.0:1763343031.917269:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b8700, transno 17179871458 00000004:00080000:0.0:1763343031.917273:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad0700, transno 17179871459 00000004:00080000:0.0:1763343031.917276:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad1f80, transno 17179871460 00000004:00080000:0.0:1763343031.917279:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34060aaa00, transno 17179871461 00000004:00080000:0.0:1763343031.917282:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34060a9c00, transno 17179871462 00000100:00100000:0.0:1763343031.917289:0:3660:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a3535ad3b80 x1848998010220416/t17179871467(17179871467) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763343047 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1763343031.918145:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 875 committed 00010000:00010000:1.0:1763343031.918200:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763343031.918210:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae4b16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.918221:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.918226:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae4b16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.918236:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae4b16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.918259:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae4b16 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.918273:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae4b16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.918296:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343031.918300:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4b1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.918306:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343031.918309:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4b1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.918316:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4b1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.918326:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4b1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.918332:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4b1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.918345:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.918347:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.918349:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343031.918357:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1763343031.918413:0:14879:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001449d638 reply state 000000001a33c881 transno 8589939633 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4ad7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.918435:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4ad7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.918446:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:1.0:1763343031.918450:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763343031.918454:0:14879:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343031.918462:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:1.0:1763343031.918464:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343031.918473:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4910 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8892 expref: 228 pid: 10041 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1763343031.918599:0:14879:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763343031.918615:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56814:x1848997993412480:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 19544us (19823us total) trans 8589939633 rc 0/0 00000100:00100000:1.0:1763343031.918646:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3031 00010000:00010000:1.0:1763343031.918719:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4ad7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.918727:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4ad7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.918733:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4ad7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.918738:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.918743:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4ad7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.918749:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4ad7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.918761:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:1.0:1763343031.918764:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343031.918767:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4ad7 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343031.918773:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4ad7 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00000004:00080000:0.0:1763343031.918878:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad3b80/2, rc 0, transno 17179871467 00000100:00100000:0.0:1763343031.918884:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010220416:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343031.918947:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010220672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343031.919015:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.919061:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343031.919068:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010220288:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343031.919087:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.919116:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010220672 00000100:00100000:3.0:1763343031.919125:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010220672 00000100:00100000:3.0:1763343031.919160:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010220288 00000100:00100000:3.0:1763343031.919163:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010220288 00000100:00100000:3.0:1763343031.919182:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6235 00000100:00100000:3.0:1763343031.919190:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3657:x1848998010220672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343031.919355:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343031.919359:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb mtime from disk: 1763343031 -> 1763343031 00002000:00010000:3.0:1763343031.919362:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343031.919364:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb ctime from disk: 1763343031 -> 1763343031 00002000:00010000:3.0:1763343031.919367:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x27e:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343031.919399:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010220672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (384us total) trans 17179871468 rc 0/0 00000100:00100000:3.0:1763343031.919406:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6235 00000100:00100000:3.0:1763343031.919420:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6236 00000100:00100000:3.0:1763343031.919426:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3657:x1848998010220288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343031.919439:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:639 count 1 00010000:00010000:3.0:1763343031.919457:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae4b24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.919476:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae4a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88fb expref: 14 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.919485:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343031.919487:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343031.919491:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae4b24 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.919526:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae4a13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88fb expref: 14 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.919541:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae4a13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88fb expref: 14 pid: 27835 timeout: 1325 lvb_type: 0 00000100:00100000:3.0:1763343031.919560:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340465e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010220800:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343031.919612:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c300 going to sleep for 11 seconds 00000004:00080000:3.0:1763343031.919675:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406649180/2, rc 0, transno 17179871468 00000100:00100000:3.0:1763343031.919681:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010220672:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763343031.919979:0:32357:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 4 in progress, 2 in flight, 12 done 00000100:00100000:1.0:1763343031.920214:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.920235:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993413248 00000100:00100000:1.0:1763343031.920240:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993413248 00010000:00010000:1.0:1763343031.920265:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae4af3 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac893a expref: 228 pid: 6523 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343031.920293:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2935 00000100:00100000:1.0:1763343031.920300:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:2430:x1848997993413248:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.920312:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.920320:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae4af3 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac893a expref: 228 pid: 6523 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.920331:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae4af3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac893a expref: 228 pid: 6523 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.920352:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3403bdc000) 00010000:00010000:1.0:1763343031.920357:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4b08 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.920367:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4b08 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.920375:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4b08 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.920390:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.920413:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:2430:x1848997993413248:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 114us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.920419:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2935 00000100:00100000:1.0:1763343031.920542:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.920556:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993413376 00000100:00100000:1.0:1763343031.920560:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993413376 00010000:00010000:1.0:1763343031.920576:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae4a28 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8902 expref: 32 pid: 28995 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343031.920594:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2936 00000100:00100000:1.0:1763343031.920600:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2430:x1848997993413376:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.920608:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.920612:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae4a28 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8902 expref: 32 pid: 28995 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.920652:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae4a28 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8902 expref: 32 pid: 28995 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.920669:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.920672:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.920675:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76c00/0x607405d401ae4b0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.920685:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76c00/0x607405d401ae4b0f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.920699:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.920719:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2430:x1848997993413376:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 118us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.920726:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2936 00000004:00080000:0.0:1763343031.921093:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340664aa00/2, rc 0, transno 17179871466 00000100:00100000:0.0:1763343031.921099:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340664aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010220544:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763343031.922467:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343031.922475:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76c00/0x607405d401ae4b0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.922484:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3404b76c00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343031.922489:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76c00/0x607405d401ae4b0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.922500:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76c00/0x607405d401ae4b0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.922519:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76c00/0x607405d401ae4b0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.922526:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76c00/0x607405d401ae4b0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.922552:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343031.922554:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343031.922555:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343031.922707:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae4af3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac893a expref: 226 pid: 6523 timeout: 1325 lvb_type: 0 00000100:00100000:3.0:1763343031.922723:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010219520:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343031.922741:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4b08 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.922749:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4b08 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.922754:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4b08 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:3.0:1763343031.922779:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c5:0x0]: returning size 0 00000004:00080000:3.0:1763343031.922962:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x27f:0x0], index 0: 0 00000004:00080000:3.0:1763343031.922968:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x281:0x0], index 1: 0 00000004:00080000:3.0:1763343031.922972:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x282:0x0], index 1: 0 00000004:00080000:3.0:1763343031.922975:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x280:0x0], index 0: 0 00010000:00010000:3.0:1763343031.923096:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4b08 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.923104:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4b08 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.923115:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4b08 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.923120:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343031.923125:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4b08 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.923131:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4b08 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.923144:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3403bdc000) 00010000:00010000:3.0:1763343031.923147:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343031.923152:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4b08 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.923157:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4b08 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.923211:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4b01 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8941 expref: 226 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.923221:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3403bdc000) 00010000:00010000:3.0:1763343031.923223:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343031.923226:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4b01 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8941 expref: 226 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.923241:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:3.0:1763343031.923299:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:56818:x1848997993413120:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 12939us (14241us total) trans 8589939634 rc 301/301 00000100:00100000:3.0:1763343031.923307:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8940 00000004:00080000:1.0:1763343031.923573:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3403ad5500/2, rc 0, transno 21474838768 00000100:00100000:1.0:1763343031.923579:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010219648:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343031.929344:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340465e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010220800:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343031.929382:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae4b24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343031.929480:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993413504 00000100:00100000:3.0:1763343031.929490:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993413504 00000100:00100000:3.0:1763343031.929565:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8941 00000100:00100000:3.0:1763343031.929577:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+225:56814:x1848997993413504:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343031.929608:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.929676:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4b32 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8948 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.929749:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4b32 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8948 expref: 226 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.929767:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93c00/0x607405d401ae4b32 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8948 expref: 226 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.929789:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:3.0:1763343031.929793:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343031.929797:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93c00, rc 0) 00000100:00100000:3.0:1763343031.931078:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56814:x1848997993413504:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1496us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343031.931091:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8941 00000100:00100000:1.0:1763343031.932476:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993413632 00000100:00100000:1.0:1763343031.932490:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993413632 00010000:00010000:1.0:1763343031.932535:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae4a13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88fb expref: 15 pid: 27835 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343031.932577:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2937 00000100:00100000:1.0:1763343031.932587:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993413632:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.932606:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.932613:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae4a13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88fb expref: 15 pid: 27835 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.932670:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae4a13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88fb expref: 15 pid: 27835 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.932700:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae4a13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88fb expref: 15 pid: 27835 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.932718:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.932721:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343031.932728:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae4b24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.932739:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae4b24 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.932770:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.932832:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993413632:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 245us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.932839:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2937 00000100:00100000:3.0:1763343031.933015:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993413888 00000100:00100000:3.0:1763343031.933021:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993413888 00000100:00100000:3.0:1763343031.933063:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3032 00000100:00100000:3.0:1763343031.933071:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+226:56818:x1848997993413888:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343031.933416:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56818:x1848997993413888:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 344us (1011us total) trans 8589939635 rc 0/0 00000100:00100000:3.0:1763343031.933424:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3032 00000004:00080000:1.0:1763343031.934688:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad3800/2, rc 0, transno 17179871469 00000100:00100000:1.0:1763343031.934697:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010220288:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763343031.935474:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343031.935486:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae4b24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.935498:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343031.935503:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae4b24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.935514:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae4b24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.935536:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae4b24 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.935543:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae4b24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.935566:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343031.935567:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343031.935569:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343031.935886:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.935965:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993414144 00000100:00100000:3.0:1763343031.935976:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993414144 00000100:00100000:3.0:1763343031.936049:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3033 00000100:00100000:3.0:1763343031.936059:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+227:56814:x1848997993414144:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:3.0:1763343031.936354:0:6526:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1c2:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763343031.936436:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1327, 64 off112752 00000040:00080000:3.0:1763343031.936461:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1328, 64 off112752 00000040:00080000:3.0:1763343031.936471:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1329, 64 off112816 00000040:00080000:3.0:1763343031.936480:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1328, 64 off112816 00010000:00010000:3.0:1763343031.936550:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4b39 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343031.936569:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4b39 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343031.936581:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4b39 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343031.936590:0:6526:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4b39 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343031.936596:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4b39 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343031.936601:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4b39 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343031.936661:0:6526:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343031.936877:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56814:x1848997993414144:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 817us (993us total) trans 8589939636 rc 0/0 00000100:00100000:3.0:1763343031.936886:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3033 00010000:00010000:0.0:1763343031.937786:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343031.937797:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4b39 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343031.937806:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343031.937810:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4b39 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343031.937819:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4b39 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343031.937836:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c2:0x0].0x0 (ffff9a3541141e00) 00010000:00010000:0.0:1763343031.937840:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343031.937844:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4b39 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343031.937850:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4b39 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1c2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343031.937864:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343031.937866:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343031.937869:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343031.938327:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.939329:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993414400 00000100:00100000:1.0:1763343031.939347:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993414400 00000100:00100000:1.0:1763343031.939659:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3034 00000100:00100000:1.0:1763343031.939671:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56818:x1848997993414400:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343031.939952:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56818:x1848997993414400:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 283us (1627us total) trans 8589939637 rc 0/0 00000100:00100000:1.0:1763343031.939961:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3034 00000100:00100000:1.0:1763343031.941946:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993414656 00000100:00100000:1.0:1763343031.941959:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993414656 00000100:00100000:1.0:1763343031.942037:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8942 00000100:00100000:1.0:1763343031.942049:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56814:x1848997993414656:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.942080:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.942110:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4b40 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac894f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.942213:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4b47 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942230:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4b47 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942243:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4b47 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942255:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4b4e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942262:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4b4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942268:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4b4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942416:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4b55 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942425:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4b55 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942432:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4b55 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343031.942443:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c5:0x0]: returning size 0 00010000:00010000:1.0:1763343031.942542:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4b47 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942550:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4b47 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942560:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4b47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942566:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4b47 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942572:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.942576:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4b47 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942585:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4b47 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942597:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc400) 00010000:00010000:1.0:1763343031.942600:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.942606:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4b47 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942612:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4b47 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942655:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4b4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942661:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4b4e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942666:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4b4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942672:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.942674:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4b4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942683:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4b4e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942690:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdcd00) 00010000:00010000:1.0:1763343031.942693:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.942695:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4b4e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942701:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4b4e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.942748:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4b40 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac894f expref: 232 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.942764:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae4b55 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac894f expref: 231 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.942772:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3403bdca00) 00010000:00010000:1.0:1763343031.942774:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343031.942777:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:1.0:1763343031.942846:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56814:x1848997993414656:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 798us (1045us total) trans 8589939638 rc 0/0 00000100:00100000:1.0:1763343031.942854:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8942 00000100:00100000:0.0:1763343031.951508:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.951673:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993414912 00000100:00100000:3.0:1763343031.951687:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993414912 00000100:00100000:3.0:1763343031.962238:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.962391:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993415040 00000100:00100000:1.0:1763343031.962405:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993415040 00000100:00100000:1.0:1763343031.962487:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8944 00000100:00100000:1.0:1763343031.962500:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56814:x1848997993415040:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.962528:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.962557:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4b78 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac895d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.962810:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4b7f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.962835:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4b6a lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1c5:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8956 expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.962845:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4b7f lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.962911:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4b6a lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1c5:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8956 expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.962926:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4b6a lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1c5:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8956 expref: 233 pid: 28422 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1763343031.962948:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010220928:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343031.963096:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3537999c00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343031.966938:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.966993:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.967092:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993415296 00000100:00100000:1.0:1763343031.967106:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993415296 00010000:00010000:1.0:1763343031.967160:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4b6a lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1c5:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8956 expref: 234 pid: 28422 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343031.968051:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2938 00000100:00100000:1.0:1763343031.968061:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:2429:x1848997993415296:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343031.968074:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343031.968080:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4b6a lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1c5:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8956 expref: 235 pid: 28422 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.968092:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4b6a lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1c5:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8956 expref: 235 pid: 28422 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343031.968108:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:1.0:1763343031.968112:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4b7f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.968121:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4b7f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.968128:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4b7f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.968148:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343031.968187:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:2429:x1848997993415296:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 128us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343031.968195:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2938 00010000:00010000:0.0:1763343031.968940:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4b6a lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1c5:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8956 expref: 234 pid: 28422 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1763343031.968960:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340664ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010220928:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343031.969005:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4b7f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.969015:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4b7f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.969020:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4b7f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343031.969076:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c5:0x0]: returning size 0 00000004:00200000:0.0:1763343031.969081:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343031.969104:0:6523:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4b7f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.969138:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4b78 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac895d expref: 234 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.969152:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4b7f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac895d expref: 233 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.969160:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:0.0:1763343031.969163:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763343031.969166:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665dc00, rc 0) 00000100:00100000:0.0:1763343031.969216:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56814:x1848997993415040:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6718us (6992us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.969223:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8944 00000100:00100000:3.0:1763343031.977834:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343031.977881:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343031.977961:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993415424 00000100:00100000:0.0:1763343031.977975:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993415424 00000100:00100000:0.0:1763343031.978055:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993415680 00000100:00100000:0.0:1763343031.978059:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993415680 00000100:00100000:0.0:1763343031.978083:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8946 00000100:00100000:0.0:1763343031.978093:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56814:x1848997993415424:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.978122:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.978150:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae4b94 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac896b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.978227:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae4b94 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac896b expref: 235 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.978247:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae4b94 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac896b expref: 235 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.978271:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:0.0:1763343031.978275:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343031.978280:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d600, rc 0) 00000100:00100000:0.0:1763343031.978354:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56814:x1848997993415424:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 262us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.978362:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8946 00000100:00100000:0.0:1763343031.978385:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8947 00000100:00100000:0.0:1763343031.978392:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:55941:x1848997993415680:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343031.978437:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343031.978458:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4b7f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac895d expref: 234 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.978475:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:0.0:1763343031.978479:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343031.978722:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4b9b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.978733:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4b9b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.978742:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4b9b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000001:00080000:0.0:1763343031.978798:0:6523:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939640 00000004:00010000:0.0:1763343031.978821:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bb895760 reply state 0000000072ba733f transno 8589939641 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4b9b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.978834:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4b9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343031.978841:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:0.0:1763343031.978844:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343031.978846:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343031.978904:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:55941:x1848997993415680:12345-192.168.204.21@tcp:36:bash.0 Request processed in 512us (1021us total) trans 8589939641 rc 0/0 00000100:00100000:0.0:1763343031.978912:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8947 00000020:00080000:0.0:1763343031.978916:0:6523:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343031.984016:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993416064 00000100:00100000:3.0:1763343031.984029:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993416064 00000100:00100000:3.0:1763343031.984108:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8948 00000100:00100000:3.0:1763343031.984120:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:55941:x1848997993416064:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343031.984153:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343031.984157:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343031.984196:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae4b94 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac896b expref: 236 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343031.984217:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993415808 00010000:00010000:3.0:1763343031.984223:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3538bf7300) 00000100:00100000:0.0:1763343031.984223:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993415808 00010000:00010000:3.0:1763343031.984229:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343031.984246:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4ba2 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8979 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343031.984269:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6237 00000100:00100000:0.0:1763343031.984277:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2429:x1848997993415808:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343031.984285:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343031.984301:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae4ba9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8972 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.984321:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae4bb0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00002000:00010000:0.0:1763343031.984323:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x27f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343031.984338:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae4bb0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.984341:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343031.984344:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343031.984349:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae4bb0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343031.984355:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae4ba9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8972 expref: 32 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343031.984370:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae4ba9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8972 expref: 32 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343031.984383:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665ce00, rc 0) 00000100:00100000:0.0:1763343031.984460:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2429:x1848997993415808:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 184us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343031.984467:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6237 00000040:00080000:3.0:1763343031.984659:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1329, 88 off112904 00000100:00100000:3.0:1763343031.987262:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343031.988097:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993416192 00000100:00100000:1.0:1763343031.988112:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993416192 00000100:00100000:1.0:1763343031.988186:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8949 00000100:00100000:1.0:1763343031.988197:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56814:x1848997993416192:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343031.988224:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343031.988254:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4bb7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8980 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763343031.988647:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1225656024657ns, next at 1226132560989ns, rc = 0 00000040:00080000:0.0:1763343031.988748:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1330, 88 off112904 00000004:00080000:0.0:1763343031.988757:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1225656135912ns, next at 1226132529377ns, rc = 0 00000040:00080000:0.0:1763343031.988788:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1331, 88 off112992 00000004:00080000:0.0:1763343031.988794:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1225656172772ns, next at 1226132529377ns, rc = 0 00000040:00080000:0.0:1763343031.988817:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1330, 88 off112992 00000004:00080000:0.0:1763343031.988820:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1225656199662ns, next at 1226132560989ns, rc = 0 00000001:00080000:3.0:1763343031.993805:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939642 is committed 00000004:00080000:3.0:1763343031.993825:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 878 committed 00000004:00080000:3.0:1763343031.993844:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 877 committed 00000004:00080000:3.0:1763343031.993865:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 876 committed 00000004:00080000:3.0:1763343031.993868:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 877 committed 00010000:00010000:1.0:1763343031.993873:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4b9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.993887:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4b9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.993894:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4b9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.993901:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343031.993906:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4b9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.993915:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4b9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.993937:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:1.0:1763343031.993940:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343031.993946:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4b9b lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343031.993952:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4b9b lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343031.993964:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae4bb0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8979 expref: 230 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.993978:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:3.0:1763343031.993989:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343031.993994:0:10042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4bb7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8980 expref: 229 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.994008:0:10042:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4bb7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8980 expref: 229 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343031.994016:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8980 expref: 229 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343031.994196:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010221312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343031.994242:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010221440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.994382:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343031.994429:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763343031.994435:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010221184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.994456:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343031.994494:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010221312 00000100:00100000:0.0:1763343031.994503:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010221312 00010000:00010000:1.0:1763343031.994790:0:10042:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8980 expref: 229 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343031.994805:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052af480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010221568:192.168.204.21@tcp:105: 00000100:00100000:1.0:1763343031.994880:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406a47c00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343031.995900:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010221184 00000100:00100000:3.0:1763343031.995914:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010221184 00000100:00100000:0.0:1763343031.995941:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010221056 00000100:00100000:0.0:1763343031.995946:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010221056 00000100:00100000:0.0:1763343031.996159:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6238 00000100:00100000:0.0:1763343031.996175:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3660:x1848998010221312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343031.996447:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3660:x1848998010221312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 277us (2065us total) trans 17179871470 rc 0/0 00000100:00100000:0.0:1763343031.996456:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6238 00000100:00100000:0.0:1763343031.996497:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010221824 00000100:00100000:0.0:1763343031.996501:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010221824 00000100:00100000:0.0:1763343031.996523:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6240 00000100:00100000:0.0:1763343031.996529:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3659:x1848998010221824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343031.996542:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:636 count 1 00010000:00010000:0.0:1763343031.996557:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4bc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.996570:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae4a7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8917 expref: 31 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.996577:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343031.996579:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343031.996581:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4bc5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.996601:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae4a7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8917 expref: 31 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343031.996610:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae4a7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8917 expref: 31 pid: 27835 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1763343031.996641:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010222336:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343031.996788:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6241 00000100:00100000:1.0:1763343031.996798:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3659:x1848998010221952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763343031.996881:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x27f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343031.996884:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x27f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.996886:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x27f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.996889:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x27f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343031.996891:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x27f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343031.996926:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3659:x1848998010221952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (394us total) trans 21474838769 rc 0/0 00000100:00100000:1.0:1763343031.996932:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6241 00000100:00100000:3.0:1763343031.997687:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343031.998028:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010222080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343031.998072:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763343031.998161:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d4a80/2, rc 0, transno 21474838769 00000100:00100000:1.0:1763343031.998169:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010221952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343031.998215:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6243 00000100:00100000:1.0:1763343031.998221:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3660:x1848998010221184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763343031.998236:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:638 count 1 00010000:00010000:1.0:1763343031.998258:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae4bcc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.998277:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae4a59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8910 expref: 13 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.998291:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343031.998293:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343031.998296:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae4bcc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.998328:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae4a59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8910 expref: 13 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.998340:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae4a59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8910 expref: 13 pid: 28995 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343031.998352:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010222464:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343031.998414:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406a47300 going to sleep for 11 seconds 00000100:00100000:1.0:1763343031.998442:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052af480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010221568:192.168.204.21@tcp:105: 00010000:00010000:1.0:1763343031.998483:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4ba2 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8979 expref: 229 pid: 10042 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343031.998504:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae4bb0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8979 expref: 228 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343031.998536:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92c00, rc 0) 00000100:00100000:1.0:1763343031.998579:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:55941:x1848997993416064:12345-192.168.204.21@tcp:101:bash.0 Request processed in 14462us (14771us total) trans 8589939642 rc 0/0 00000100:00100000:1.0:1763343031.998586:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8948 00000100:00100000:1.0:1763343031.998672:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010221696:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343031.999161:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3537999000 going to sleep for 11 seconds 00000100:00100000:0.0:1763343031.999507:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010222080 00000100:00100000:0.0:1763343031.999515:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010222080 00000100:00100000:0.0:1763343031.999555:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6244 00000100:00100000:0.0:1763343031.999562:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3657:x1848998010222080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343031.999762:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3657:x1848998010222080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 200us (1689us total) trans 21474838770 rc 0/0 00000100:00100000:0.0:1763343031.999773:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6244 00000004:00080000:0.0:1763343031.999813:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d5880/2, rc 0, transno 21474838770 00000100:00100000:0.0:1763343031.999820:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010222080:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343031.999839:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f38e00/2, rc 0, transno 17179871471 00000100:00100000:0.0:1763343031.999844:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010221440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343032.000671:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343032.000734:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010221696 00000100:00100000:1.0:1763343032.000741:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010221696 00000100:00100000:1.0:1763343032.000791:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6245 00000100:00100000:1.0:1763343032.000799:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3658:x1848998010221696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343032.000829:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:635 count 1 00010000:00010000:1.0:1763343032.001905:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae4bd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.001932:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae49b1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88d1 expref: 31 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343032.001942:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.001944:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.001949:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae4bd3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.002012:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae49b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88d1 expref: 31 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343032.002028:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae49b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88d1 expref: 31 pid: 28994 timeout: 1325 lvb_type: 1 00000100:00100000:1.0:1763343032.002047:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010222592:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343032.002443:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993416320 00000100:00100000:0.0:1763343032.002453:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993416320 00000100:00100000:0.0:1763343032.002516:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3035 00000100:00100000:0.0:1763343032.002526:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56814:x1848997993416320:12345-192.168.204.21@tcp:49:lfs.0 00000100:00100000:0.0:1763343032.002669:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56814:x1848997993416320:12345-192.168.204.21@tcp:49:lfs.0 Request processed in 143us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.002677:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3035 00000100:00100000:1.0:1763343032.003094:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406a47c00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343032.003328:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010222464:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343032.003521:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993416448 00000100:00100000:0.0:1763343032.003527:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993416448 00010000:00010000:0.0:1763343032.003555:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae4a59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8910 expref: 14 pid: 28995 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1763343032.003592:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2939 00000100:00100000:0.0:1763343032.003601:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993416448:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343032.003614:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343032.003640:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae4a59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8910 expref: 14 pid: 28995 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343032.003652:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae4a59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8910 expref: 14 pid: 28995 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343032.003679:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae4a59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8910 expref: 14 pid: 28995 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343032.003695:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.003698:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.003703:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae4bcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.003714:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae4bcc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.003735:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343032.003769:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993416448:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 169us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.003776:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2939 00010000:00010000:1.0:1763343032.003847:0:15756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae4bcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.003861:0:15756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae4bcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.003869:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae4bcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.003881:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae4bcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.003889:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae4bcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.003916:0:15756:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343032.004333:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3660:x1848998010221184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6110us (9874us total) trans 17179871472 rc 0/0 00000100:00100000:1.0:1763343032.004343:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6243 00000004:00080000:1.0:1763343032.004396:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340664a300/2, rc 0, transno 17179871472 00000100:00100000:1.0:1763343032.004403:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340664a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010221184:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343032.004438:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993416576 00000100:00100000:1.0:1763343032.004443:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993416576 00000100:00100000:1.0:1763343032.004475:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3036 00000100:00100000:1.0:1763343032.004483:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:55941:x1848997993416576:12345-192.168.204.21@tcp:49:bash.0 00000100:00100000:1.0:1763343032.004580:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:55941:x1848997993416576:12345-192.168.204.21@tcp:49:bash.0 Request processed in 97us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.004587:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3036 00010000:00010000:0.0:1763343032.007087:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343032.007109:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae4bcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.007125:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343032.007131:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae4bcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.007143:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae4bcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.007170:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae4bcc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.007179:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae4bcc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.007212:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.007214:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.007216:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343032.007770:0:28993:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:28993:1848998010222208:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343032.007808:0:28993:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4bbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343032.008331:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010222336:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343032.008351:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4bc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343032.008408:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993416704 00000100:00100000:1.0:1763343032.008417:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993416704 00010000:00010000:1.0:1763343032.008462:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae48a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8876 expref: 13 pid: 28995 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343032.008503:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993416832 00000100:00100000:1.0:1763343032.008506:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993416832 00010000:00010000:1.0:1763343032.008520:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae4a7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8917 expref: 32 pid: 27835 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343032.008545:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993416960 00000100:00100000:1.0:1763343032.008548:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993416960 00010000:00010000:1.0:1763343032.008560:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae49b1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88d1 expref: 33 pid: 28994 timeout: 1325 lvb_type: 1 00000100:00100000:1.0:1763343032.008576:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2940 00000100:00100000:1.0:1763343032.008585:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993416704:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343032.008603:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343032.008609:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae48a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8876 expref: 13 pid: 28995 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343032.008670:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae48a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8876 expref: 13 pid: 28995 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343032.008694:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae48a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8876 expref: 13 pid: 28995 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343032.008709:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.008712:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.008717:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4bbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.008728:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4bbe lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.008753:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343032.008807:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993416704:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 223us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.008814:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2940 00000100:00100000:1.0:1763343032.008837:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2941 00000100:00100000:1.0:1763343032.008843:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+33:2430:x1848997993416832:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343032.008853:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343032.008858:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae4a7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8917 expref: 33 pid: 27835 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343032.008867:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae4a7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8917 expref: 33 pid: 27835 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343032.008882:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae4a7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8917 expref: 33 pid: 27835 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343032.008892:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.008894:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.008897:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4bc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.008909:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4bc5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.008924:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343032.008944:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2430:x1848997993416832:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 101us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.008951:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2941 00000100:00100000:1.0:1763343032.008964:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2942 00000100:00100000:1.0:1763343032.008969:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993416960:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343032.008976:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343032.008990:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae49b1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88d1 expref: 31 pid: 28994 timeout: 1325 lvb_type: 1 00010000:00010000:1.0:1763343032.009000:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae49b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88d1 expref: 31 pid: 28994 timeout: 1325 lvb_type: 1 00010000:00010000:1.0:1763343032.009011:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.009013:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.009016:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae4bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.009023:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae4bd3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.009033:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343032.009052:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993416960:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 83us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.009059:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2942 00010000:00010000:1.0:1763343032.009123:0:28994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae49b1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac88d1 expref: 30 pid: 28994 timeout: 1325 lvb_type: 1 00000100:00100000:1.0:1763343032.009133:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010222592:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343032.009145:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae4bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.009154:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae4bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.009161:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae4bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.009171:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae4bd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.009178:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae4bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.009195:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343032.009585:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3658:x1848998010221696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8786us (8917us total) trans 21474838771 rc 0/0 00000100:00100000:1.0:1763343032.009593:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6245 00000004:00080000:1.0:1763343032.009669:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d4700/2, rc 0, transno 21474838771 00000100:00100000:1.0:1763343032.009675:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010221696:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763343032.009696:0:28993:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4bbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.009704:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4bbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.009711:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4bbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.009718:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4bbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.009732:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763343032.009882:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3658:x1848998010221056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13705us (15135us total) trans 17179871473 rc 0/0 00000100:00100000:1.0:1763343032.009890:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6239 00000004:00080000:1.0:1763343032.010069:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340664ad80/2, rc 0, transno 17179871473 00000100:00100000:1.0:1763343032.010075:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340664ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010221056:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343032.010097:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993417216 00000100:00100000:1.0:1763343032.010104:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993417216 00000100:00100000:1.0:1763343032.010140:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3037 00000100:00100000:1.0:1763343032.010147:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56814:x1848997993417216:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343032.010359:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56814:x1848997993417216:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 211us (2130us total) trans 8589939643 rc 0/0 00000100:00100000:1.0:1763343032.010367:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3037 00010000:00010000:0.0:1763343032.010483:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343032.010492:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae4bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.010502:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343032.010507:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae4bd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.010517:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae4bd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.010534:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae4bd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.010541:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae4bd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.010569:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343032.010573:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4bbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.010579:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343032.010582:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4bbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.010590:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4bbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.010601:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4bbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.010607:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4bbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.010645:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.010647:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.010649:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.010660:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4bc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.010669:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4bc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.010677:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4bc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.010685:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4bc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.010706:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343032.010864:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+54:3659:x1848998010221824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14334us (14384us total) trans 21474838772 rc 0/0 00000100:00100000:0.0:1763343032.010872:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6240 00000004:00080000:0.0:1763343032.010911:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d7b80/2, rc 0, transno 21474838772 00000100:00100000:0.0:1763343032.010916:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010221824:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1763343032.011394:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343032.011402:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4bc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.011410:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343032.011413:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4bc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.011422:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4bc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.011433:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4bc5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.011440:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae4bc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.011458:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343032.011460:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343032.011461:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343032.011602:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993417344 00000100:00100000:0.0:1763343032.011608:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993417344 00000100:00100000:0.0:1763343032.011679:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6246 00000100:00100000:0.0:1763343032.011687:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:55941:x1848997993417344:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343032.011702:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.011719:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae4bda lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8987 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.011745:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae4ba9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8972 expref: 31 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343032.011753:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.011755:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.011760:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae4bda lrc: 4/0,0 mode: --/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8987 expref: 31 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.011795:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae4ba9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8972 expref: 31 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343032.011809:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae4ba9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8972 expref: 31 pid: 27835 timeout: 1325 lvb_type: 1 00000100:00100000:0.0:1763343032.011825:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010222720:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343032.011904:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3538beac00 going to sleep for 11 seconds 00010000:00010000:1.0:1763343032.015086:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343032.015749:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010222720:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343032.015793:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae4bda lrc: 3/0,0 mode: --/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8987 expref: 31 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.015816:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d200, rc 0) 00000100:00100000:0.0:1763343032.015930:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:55941:x1848997993417344:12345-192.168.204.21@tcp:101:bash.0 Request processed in 4242us (4387us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.015941:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6246 00000100:00100000:3.0:1763343032.016849:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.020187:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993417728 00000100:00100000:3.0:1763343032.020199:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993417728 00000100:00100000:3.0:1763343032.020274:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8950 00000100:00100000:3.0:1763343032.020284:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56814:x1848997993417728:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343032.020314:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.020344:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4be1 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac898e expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.020446:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4be8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020464:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4be8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020477:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4be8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020492:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4bef lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020499:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4bef lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020506:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4bef lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020685:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4bf6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020697:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020704:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343032.020716:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c5:0x0]: returning size 2 00010000:00010000:3.0:1763343032.020816:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4be8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020824:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4be8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020830:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4be8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020836:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4be8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020842:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.020847:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4be8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020855:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4be8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020868:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3512906700) 00010000:00010000:3.0:1763343032.020871:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.020876:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4be8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020883:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4be8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020896:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4bef lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020902:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4bef lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020908:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4bef lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020913:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.020916:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4bef lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020922:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4bef lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020928:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3512906200) 00010000:00010000:3.0:1763343032.020931:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.020933:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4bef lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020939:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4bef lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.020997:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4be1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac898e expref: 232 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.021012:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac898e expref: 231 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.021019:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:3.0:1763343032.021022:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343032.021025:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93a00, rc 0) 00000100:00100000:3.0:1763343032.021108:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56814:x1848997993417728:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 825us (1208us total) trans 8589939644 rc 0/0 00000100:00100000:3.0:1763343032.021116:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8950 00000100:00100000:3.0:1763343032.025930:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.026669:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.026879:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993418112 00000100:00100000:1.0:1763343032.026889:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993418112 00000100:00100000:1.0:1763343032.026950:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3038 00000100:00100000:1.0:1763343032.026961:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56814:x1848997993418112:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343032.027230:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56814:x1848997993418112:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 271us (560us total) trans 8589939645 rc 0/0 00000100:00100000:1.0:1763343032.027239:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3038 00000100:00100000:0.0:1763343032.027521:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993417856 00000100:00100000:0.0:1763343032.027528:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993417856 00000100:00100000:0.0:1763343032.027575:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6247 00000100:00100000:0.0:1763343032.027583:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:55941:x1848997993417856:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343032.027595:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.027640:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4c04 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8995 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343032.027670:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x281:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343032.027693:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.027696:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.027708:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4c04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8995 expref: 13 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.027726:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4c04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8995 expref: 13 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.027739:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665da00, rc 0) 00000100:00100000:0.0:1763343032.027765:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:55941:x1848997993417856:12345-192.168.204.21@tcp:101:bash.0 Request processed in 183us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.027771:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6247 00000100:00100000:1.0:1763343032.030523:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.030566:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.030691:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993418240 00000100:00100000:0.0:1763343032.030704:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993418240 00002000:00010000:0.0:1763343032.030755:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/639 (0->18446744073709551615) 00002000:00100000:0.0:1763343032.030761:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34052aea00 with x1848997993418240 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343032.030774:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34052aea00. 00000100:00100000:0.0:1763343032.030798:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993418368 00000100:00100000:0.0:1763343032.030801:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993418368 00002000:00010000:0.0:1763343032.030813:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/641 (0->18446744073709551615) 00002000:00100000:0.0:1763343032.030816:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34052ad180 with x1848997993418368 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343032.030823:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34052ad180. 00000100:00100000:0.0:1763343032.030843:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1538 00000100:00100000:0.0:1763343032.030852:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2429:x1848997993418240:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343032.031090:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x27f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343032.031094:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x27f:0x0] updating lvb mtime from disk: 0 -> 1763343031 00002000:00010000:0.0:1763343032.031097:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x27f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.031100:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x27f:0x0] updating lvb ctime from disk: 0 -> 1763343031 00002000:00010000:0.0:1763343032.031102:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x27f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343032.031255:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1539 00000100:00100000:1.0:1763343032.031265:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993418368:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:1.0:1763343032.031365:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x281:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343032.031368:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x281:0x0] updating lvb mtime from disk: 0 -> 1763343031 00002000:00010000:1.0:1763343032.031370:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x281:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343032.031372:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x281:0x0] updating lvb ctime from disk: 0 -> 1763343031 00002000:00010000:1.0:1763343032.031375:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x281:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343032.031434:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993418368:12345-192.168.204.21@tcp:10:bash.0 Request processed in 171us (867us total) trans 17179871474 rc 0/0 00000100:00100000:1.0:1763343032.031441:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1539 00002000:00010000:1.0:1763343032.031445:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/641 (0->18446744073709551615) 00002000:00100000:1.0:1763343032.031449:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34052ad180 with x1848997993418368 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343032.031453:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34052ad180. 00000100:00100000:0.0:1763343032.032384:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2429:x1848997993418240:12345-192.168.204.21@tcp:10:bash.0 Request processed in 1529us (1870us total) trans 21474838773 rc 0/0 00000100:00100000:0.0:1763343032.032395:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1538 00002000:00010000:0.0:1763343032.032399:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/639 (0->18446744073709551615) 00002000:00100000:0.0:1763343032.032402:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34052aea00 with x1848997993418240 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343032.032409:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34052aea00. 00000100:00100000:3.0:1763343032.038795:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.051460:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.051905:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8951 00000100:00100000:3.0:1763343032.051918:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56814:x1848997993418752:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343032.051944:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.051970:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4c0b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac899c expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.052115:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4c12 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.052132:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4c12 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c5:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.052144:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4c12 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c5:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343032.052158:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c5:0x0]: returning size 2 00010000:00010000:3.0:1763343032.052297:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4c0b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac899c expref: 235 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.052316:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4c12 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c5:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac899c expref: 234 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.052326:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:3.0:1763343032.052329:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343032.052333:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343032.052413:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56814:x1848997993418752:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 499us (967us total) trans 8589939646 rc 0/0 00000100:00100000:3.0:1763343032.052421:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8951 00000100:00100000:1.0:1763343032.054994:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.055885:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.056030:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993419008 00000100:00100000:0.0:1763343032.056043:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993419008 00000100:00100000:0.0:1763343032.056114:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8952 00000100:00100000:0.0:1763343032.056124:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56819:x1848997993419008:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:0.0:1763343032.056196:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1763343032.056229:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae4bb0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8979 expref: 234 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.056253:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4bb7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8980 expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.058261:0:28422:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae4bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac898e expref: 233 pid: 10042 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343032.058300:0:28422:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae4b8d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8964 expref: 233 pid: 10042 timeout: 1325 lvb_type: 0 00010000:00010000:0.0:1763343032.058311:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:0.0:1763343032.058317:0:28422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae4c20 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343032.058330:0:28422:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae4c20 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343032.058338:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae4c20 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343032.058361:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343032.058395:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c27 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.058402:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.058409:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.058419:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4c2e lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.058425:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4c2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.058430:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4c2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.058528:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c35 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.058534:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c35 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.058540:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c35 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00080000:0.0:1763343032.058826:0:28422:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1c5:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1763343032.058926:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c35 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.058934:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c35 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.058941:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c35 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.058946:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.058950:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c35 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.058958:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c35 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.058966:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:0.0:1763343032.058969:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343032.058972:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c35 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.058989:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c35 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.059004:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c27 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.059010:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c27 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.059015:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c27 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.059023:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.059026:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c27 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.059032:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c27 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.059040:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bf300) 00010000:00010000:0.0:1763343032.059042:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.059045:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c27 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.059050:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c27 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343032.059063:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000036c3606d reply state 000000001b4a7eb2 transno 8589939647 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4c2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.059075:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4c2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.059081:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bfc00) 00010000:00010000:0.0:1763343032.059086:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343032.059090:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343032.059198:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56819:x1848997993419008:12345-192.168.204.21@tcp:36:rm.0 Request processed in 3074us (4225us total) trans 8589939647 rc 0/0 00000100:00100000:0.0:1763343032.059208:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8952 00000100:00100000:1.0:1763343032.064025:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.065326:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993419392 00000100:00100000:0.0:1763343032.065342:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993419392 00000100:00100000:0.0:1763343032.065430:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8953 00000100:00100000:0.0:1763343032.065440:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56814:x1848997993419392:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343032.065473:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.065503:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae4c3c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac89a3 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.065581:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae4c3c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89a3 expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.065597:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d600/0x607405d401ae4c3c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89a3 expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.065615:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a34037bfe00) 00010000:00010000:0.0:1763343032.065640:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343032.065645:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d600, rc 0) 00000100:00100000:0.0:1763343032.065717:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56814:x1848997993419392:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 278us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.065725:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8953 00000100:00100000:0.0:1763343032.071154:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:0.0:1763343032.075526:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343032.075534:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae4c43 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343032.075541:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343032.075546:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae4c43 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343032.075554:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae4c43 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343032.075574:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c5:0x0].0x0 (ffff9a34037bfe00) 00010000:00010000:0.0:1763343032.075578:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343032.075584:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae4c43 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343032.075594:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae4c43 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343032.075608:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.075610:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.075612:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343032.078537:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.078698:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993419776 00000100:00100000:3.0:1763343032.078712:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993419776 00000100:00100000:3.0:1763343032.078788:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8954 00000100:00100000:3.0:1763343032.078801:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56820:x1848997993419776:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343032.078828:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.078859:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4c4a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac89aa expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.078953:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4c51 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.078970:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4c51 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.078995:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4c51 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079009:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c58 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079018:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079024:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079073:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4c51 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079080:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4c51 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079088:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4c51 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079094:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4c51 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079100:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.079105:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4c51 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079114:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4c51 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079127:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3512906700) 00010000:00010000:3.0:1763343032.079130:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.079136:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4c51 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079142:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4c51 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079158:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079164:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c58 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079169:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079174:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.079177:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079183:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c58 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079190:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bfc00) 00010000:00010000:3.0:1763343032.079193:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.079196:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c58 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079202:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c58 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.079233:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4c4a lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89aa expref: 235 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.079244:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3512906700) 00010000:00010000:3.0:1763343032.079246:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.079250:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4c4a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89aa expref: 235 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.079271:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343032.079357:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56820:x1848997993419776:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 557us (835us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343032.079364:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8954 00000100:00100000:3.0:1763343032.090239:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.090412:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993419904 00000100:00100000:0.0:1763343032.090427:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993419904 00000100:00100000:0.0:1763343032.090508:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8955 00000100:00100000:0.0:1763343032.090521:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56820:x1848997993419904:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343032.090553:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.090585:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c5f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac89b1 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.090709:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c66 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090727:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090741:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090753:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c6d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090761:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090768:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090821:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090829:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c66 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090836:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c66 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090843:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.090848:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c66 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090857:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c66 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090870:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bf300) 00010000:00010000:0.0:1763343032.090874:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.090879:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c66 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090886:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c66 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090899:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090905:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c6d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090911:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090915:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.090919:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090925:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090932:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bfc00) 00010000:00010000:0.0:1763343032.090935:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.090938:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c6d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090943:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c6d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.090973:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c5f lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89b1 expref: 235 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.090996:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bf300) 00010000:00010000:0.0:1763343032.090999:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.091003:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c5f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89b1 expref: 235 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.091017:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d800, rc 0) 00000100:00100000:0.0:1763343032.091101:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56820:x1848997993419904:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 582us (879us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343032.091109:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8955 00000100:00100000:1.0:1763343032.093590:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993420160 00000100:00100000:1.0:1763343032.093604:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993420160 00000100:00100000:1.0:1763343032.093755:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8956 00000100:00100000:1.0:1763343032.093767:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56820:x1848997993420160:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.093795:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.093826:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae4c74 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac89b8 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.093912:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4c7b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.093928:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4c7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.093940:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4c7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343032.094015:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343032.094022:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343032.094065:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae4c74 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89b8 expref: 236 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.094088:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4c7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89b8 expref: 235 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.094099:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc400) 00010000:00010000:1.0:1763343032.094102:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343032.094106:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177600, rc 0) 00000100:00100000:1.0:1763343032.094185:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56820:x1848997993420160:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 420us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.094197:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8956 00000100:00100000:1.0:1763343032.097391:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.097455:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993420288 00000100:00100000:0.0:1763343032.097469:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993420288 00000100:00100000:0.0:1763343032.097547:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8957 00000100:00100000:0.0:1763343032.097559:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56821:x1848997993420288:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343032.097588:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.097615:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c82 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac89bf expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.097751:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c89 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097767:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c89 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097781:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c89 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097793:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c90 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097800:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097806:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097855:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c89 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097863:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c89 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097870:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c89 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097876:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.097881:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c89 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097892:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c89 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097905:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc400) 00010000:00010000:0.0:1763343032.097909:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.097914:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c89 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097921:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4c89 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097935:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097941:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c90 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097947:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097952:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.097955:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097961:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c90 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097969:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bfc00) 00010000:00010000:0.0:1763343032.097971:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.097975:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c90 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.097992:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4c90 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.098026:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c82 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89bf expref: 236 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.098037:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc400) 00010000:00010000:0.0:1763343032.098039:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343032.098043:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4c82 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89bf expref: 236 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.098052:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d800, rc 0) 00000100:00100000:0.0:1763343032.098117:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56821:x1848997993420288:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 561us (740us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343032.098127:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8957 00000100:00100000:1.0:1763343032.103068:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.104705:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993420416 00000100:00100000:3.0:1763343032.104725:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993420416 00000100:00100000:3.0:1763343032.104811:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8958 00000100:00100000:3.0:1763343032.104824:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56820:x1848997993420416:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343032.104852:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.104882:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4c97 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac89c6 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.104963:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c9e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.104993:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105008:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105019:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ca5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105026:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105033:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105080:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c9e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105087:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c9e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105094:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c9e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105100:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c9e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105106:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.105111:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c9e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105119:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c9e lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105132:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc400) 00010000:00010000:3.0:1763343032.105136:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.105141:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c9e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105147:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4c9e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105162:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105168:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ca5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105173:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105179:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.105181:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105188:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ca5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105194:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bfc00) 00010000:00010000:3.0:1763343032.105196:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.105200:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ca5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105205:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4ca5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.105234:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4c97 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89c6 expref: 236 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.105244:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc400) 00010000:00010000:3.0:1763343032.105246:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.105250:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4c97 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89c6 expref: 236 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.105260:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343032.105349:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56820:x1848997993420416:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 528us (2297us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343032.105356:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8958 00000100:00100000:0.0:1763343032.111753:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993420672 00000100:00100000:0.0:1763343032.111769:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993420672 00000100:00100000:0.0:1763343032.111845:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8959 00000100:00100000:0.0:1763343032.111858:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56820:x1848997993420672:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343032.111889:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.111892:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343032.111929:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae4c7b lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89b8 expref: 235 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.111953:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc400) 00010000:00010000:0.0:1763343032.111967:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343032.111997:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4cac lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac89cd expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.112139:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4cb3 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.112155:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4cb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.112167:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4cb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.112178:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4cba lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.112185:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4cba lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.112191:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4cba lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.113161:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4cc1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.113178:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.113188:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343032.113200:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c6:0x0]: returning size 0 00010000:00010000:0.0:1763343032.113232:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4cb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.113239:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4cb3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.113246:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4cb3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.113253:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.113260:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4cb3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.113561:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4cb3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.113574:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bf300) 00010000:00010000:0.0:1763343032.113578:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.113583:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4cb3 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.113591:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4cb3 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343032.113605:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004b34ff15 reply state 00000000c5d9e434 transno 8589939650 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4cba lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.114374:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4cba lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.114392:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bfc00) 00010000:00010000:0.0:1763343032.114395:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343032.114399:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343032.114450:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4cac lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89cd expref: 237 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.114474:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89cd expref: 236 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.114481:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a34037bf400) 00010000:00010000:0.0:1763343032.114483:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343032.114485:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c200, rc 0) 00000100:00100000:0.0:1763343032.114587:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56820:x1848997993420672:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2731us (2911us total) trans 8589939650 rc 0/0 00000100:00100000:0.0:1763343032.114597:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8959 00000100:00100000:1.0:1763343032.119191:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.120483:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993420928 00000100:00100000:0.0:1763343032.120502:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993420928 00000100:00100000:3.0:1763343032.120905:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8960 00000100:00100000:3.0:1763343032.125452:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.126278:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.126400:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c253800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010223232:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343032.126436:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae4cd6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:1.0:1763343032.127393:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993421312 00000100:00100000:1.0:1763343032.127400:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993421312 00010000:00010000:1.0:1763343032.127426:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89cd expref: 240 pid: 28422 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343032.127462:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2944 00000100:00100000:1.0:1763343032.127471:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:2429:x1848997993421312:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343032.127482:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343032.127487:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89cd expref: 240 pid: 28422 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343032.127499:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89cd expref: 240 pid: 28422 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343032.127513:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4cc1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89cd expref: 240 pid: 28422 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343032.127524:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a34037bf400) 00010000:00010000:1.0:1763343032.127528:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae4cd6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.127536:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae4cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.127548:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae4cd6 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.127569:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343032.127590:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:2429:x1848997993421312:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 121us (1317us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343032.127593:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae4cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:1.0:1763343032.127597:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2944 00010000:00010000:0.0:1763343032.127600:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae4cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:0.0:1763343032.127635:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c6:0x0]: returning size 0 00000004:00080000:1.0:1763343032.129697:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x283:0x0], index 1: 0 00000004:00080000:1.0:1763343032.129741:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x281:0x0], index 0: 0 00000004:00080000:1.0:1763343032.129749:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x282:0x0], index 0: 0 00000004:00080000:1.0:1763343032.129755:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x284:0x0], index 1: 0 00010000:00010000:1.0:1763343032.129944:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae4cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.129957:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae4cd6 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.129965:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae4cd6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.129971:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.129976:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae4cd6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.129997:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae4cd6 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.130015:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a34037bf400) 00010000:00010000:1.0:1763343032.130019:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343032.130025:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae4cd6 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.130033:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae4cd6 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.130109:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae4ccf lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89d4 expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.130121:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a34037bf400) 00010000:00010000:1.0:1763343032.130123:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343032.130127:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae4ccf lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89d4 expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.130144:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6600, rc 0) 00000100:00100000:1.0:1763343032.130245:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56820:x1848997993420928:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 9329us (11069us total) trans 8589939652 rc 301/301 00000100:00100000:1.0:1763343032.130257:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8960 00000100:00100000:1.0:1763343032.132339:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.133320:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.134023:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993421824 00000100:00100000:3.0:1763343032.134031:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993421824 00000100:00100000:3.0:1763343032.134230:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3043 00000100:00100000:3.0:1763343032.134238:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56820:x1848997993421824:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343032.134753:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56820:x1848997993421824:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 516us (1439us total) trans 8589939654 rc 0/0 00000100:00100000:3.0:1763343032.134760:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3043 00000100:00100000:1.0:1763343032.140217:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.140225:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.140902:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993422336 00000100:00100000:3.0:1763343032.140908:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993422336 00000100:00100000:3.0:1763343032.140949:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3044 00000100:00100000:3.0:1763343032.140957:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56820:x1848997993422336:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343032.141128:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56820:x1848997993422336:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 171us (903us total) trans 8589939656 rc 0/0 00000100:00100000:3.0:1763343032.141135:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3044 00000100:00100000:0.0:1763343032.144935:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.145295:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.146461:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.146835:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993422464 00000100:00100000:1.0:1763343032.146845:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993422464 00000100:00100000:1.0:1763343032.146895:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993422592 00000100:00100000:1.0:1763343032.146899:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993422592 00000100:00100000:1.0:1763343032.146925:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6248 00000100:00100000:1.0:1763343032.146933:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993422464:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.146950:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.146969:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae4d31 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac89e9 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343032.147011:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x282:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343032.147032:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.147034:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.147044:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae4d31 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89e9 expref: 32 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343032.147059:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae4d31 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89e9 expref: 32 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343032.147072:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:1.0:1763343032.147114:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2430:x1848997993422464:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 182us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.147121:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6248 00000100:00100000:1.0:1763343032.147140:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6249 00000100:00100000:1.0:1763343032.147147:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993422592:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.147155:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.147168:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae4d38 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac89f0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343032.147183:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x284:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343032.147193:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.147195:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.147199:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae4d38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89f0 expref: 15 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343032.147210:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae4d38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89f0 expref: 15 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343032.147219:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343032.147239:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993422592:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 93us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.147246:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6249 00000100:00100000:3.0:1763343032.153218:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.154090:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.154162:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993423232 00000100:00100000:1.0:1763343032.154169:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993423232 00000100:00100000:1.0:1763343032.154206:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3045 00000100:00100000:1.0:1763343032.154216:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56822:x1848997993423232:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343032.154438:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56822:x1848997993423232:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 223us (348us total) trans 8589939658 rc 0/0 00000100:00100000:1.0:1763343032.154445:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3045 00000100:00100000:1.0:1763343032.156180:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.156218:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993423488 00000100:00100000:1.0:1763343032.156229:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993423488 00000100:00100000:1.0:1763343032.156295:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8965 00000100:00100000:1.0:1763343032.156306:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:55941:x1848997993423488:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:1.0:1763343032.156375:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343032.156421:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae4d23 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89f7 expref: 246 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.156441:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:1.0:1763343032.156448:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343032.156728:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4d4d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.156753:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4d4d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.156764:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4d4d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000001:00080000:1.0:1763343032.156827:0:10041:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939659 00000004:00010000:1.0:1763343032.156851:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000067633908 reply state 000000008e4c806b transno 8589939660 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4d4d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.156866:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4d4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.156871:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:1.0:1763343032.156874:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343032.156877:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343032.156973:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:55941:x1848997993423488:12345-192.168.204.21@tcp:36:bash.0 Request processed in 668us (803us total) trans 8589939660 rc 0/0 00000100:00100000:1.0:1763343032.156991:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8965 00000020:00080000:1.0:1763343032.156997:0:10041:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343032.160675:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.160787:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993423872 00000100:00100000:1.0:1763343032.160801:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993423872 00000100:00100000:1.0:1763343032.160876:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8966 00000100:00100000:1.0:1763343032.160885:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56822:x1848997993423872:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.160915:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.160943:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4d54 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a0c expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.161051:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4d5b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161073:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4d5b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161086:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4d5b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161100:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4d62 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161107:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4d62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161114:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4d62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161258:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4d69 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161277:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4d69 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161284:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4d69 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343032.161297:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c6:0x0]: returning size 0 00010000:00010000:1.0:1763343032.161411:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4d5b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161418:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4d5b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161424:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4d5b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161431:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4d5b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161438:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.161443:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4d5b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161451:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4d5b lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161465:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:1.0:1763343032.161469:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.161474:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4d5b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000100:00100000:0.0:1763343032.161476:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993423616 00010000:00010000:1.0:1763343032.161480:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae4d5b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000100:00100000:0.0:1763343032.161480:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993423616 00010000:00010000:1.0:1763343032.161494:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4d62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161500:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4d62 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161505:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4d62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161511:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.161513:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4d62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00000100:00100000:0.0:1763343032.161518:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8967 00010000:00010000:1.0:1763343032.161519:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4d62 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.161526:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bfc00) 00000100:00100000:0.0:1763343032.161526:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:55941:x1848997993423616:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343032.161529:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.161533:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4d62 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.161534:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.161538:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4d62 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.161544:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae4d77 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a05 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.161573:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae4d77 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a05 expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.161577:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4d54 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a0c expref: 253 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.161592:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae4d77 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a05 expref: 252 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.161595:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4d69 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a0c expref: 252 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.161601:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:1.0:1763343032.161604:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343032.161607:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00010000:00010000:0.0:1763343032.161607:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:0.0:1763343032.161609:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343032.161611:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d000, rc 0) 00000100:00100000:0.0:1763343032.162053:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:55941:x1848997993423616:12345-192.168.204.21@tcp:101:bash.0 Request processed in 525us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.162062:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8967 00000100:00100000:1.0:1763343032.162418:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56822:x1848997993423872:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1532us (1757us total) trans 8589939661 rc 0/0 00000100:00100000:1.0:1763343032.162425:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8966 00000100:00100000:3.0:1763343032.165164:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.165217:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.165359:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993424128 00000100:00100000:1.0:1763343032.165373:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993424128 00000100:00100000:0.0:1763343032.165444:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993424384 00000100:00100000:0.0:1763343032.165450:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993424384 00000100:00100000:0.0:1763343032.165495:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8968 00000100:00100000:0.0:1763343032.165506:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:55941:x1848997993424384:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343032.165542:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.165547:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343032.165587:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae4d77 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a05 expref: 252 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.165611:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:0.0:1763343032.165617:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343032.165659:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4d7e lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a13 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.165714:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4d85 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.165728:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4d69 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a0c expref: 252 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.165738:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4d85 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.165777:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4d69 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a0c expref: 252 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.165791:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4d69 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a0c expref: 252 pid: 10041 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1763343032.165807:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010223360:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343032.165892:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3046 00000100:00100000:1.0:1763343032.165901:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56822:x1848997993424128:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343032.166351:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56822:x1848997993424128:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 449us (1202us total) trans 8589939662 rc 0/0 00000100:00100000:1.0:1763343032.166359:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3046 00000100:00100000:0.0:1763343032.166366:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3538beac00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343032.170498:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010223360:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343032.170537:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4d85 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:1.0:1763343032.170669:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993424512 00000100:00100000:1.0:1763343032.170679:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993424512 00000100:00100000:1.0:1763343032.170742:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3047 00000100:00100000:1.0:1763343032.170752:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56822:x1848997993424512:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:3.0:1763343032.170975:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993424640 00000100:00100000:3.0:1763343032.170989:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993424640 00000100:00100000:1.0:1763343032.171004:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56822:x1848997993424512:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 252us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.171012:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3047 00010000:00010000:3.0:1763343032.171016:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4d69 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a0c expref: 254 pid: 10041 timeout: 1325 lvb_type: 0 00000100:00100000:3.0:1763343032.171052:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2945 00000100:00100000:3.0:1763343032.171058:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:2429:x1848997993424640:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343032.171075:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343032.171083:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4d69 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a0c expref: 253 pid: 10041 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343032.171095:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4d69 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a0c expref: 253 pid: 10041 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343032.171136:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae4d69 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a0c expref: 253 pid: 10041 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343032.171156:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:3.0:1763343032.171162:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4d85 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.171174:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4d85 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.171182:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4d85 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.171205:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343032.171231:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:2429:x1848997993424640:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 172us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.171238:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2945 00010000:00010000:0.0:1763343032.171521:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4d85 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.171530:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4d85 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000040:00080000:0.0:1763343032.172325:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1334, 88 off113208 00000004:00080000:0.0:1763343032.172336:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1225839714796ns, next at 1226132529377ns, rc = 0 00000040:00080000:0.0:1763343032.172382:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1333, 88 off113208 00000004:00080000:0.0:1763343032.172387:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1225839766343ns, next at 1226132560989ns, rc = 0 00000040:00080000:0.0:1763343032.172414:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1334, 88 off113296 00000004:00080000:0.0:1763343032.172419:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1225839798061ns, next at 1226132560989ns, rc = 0 00000040:00080000:0.0:1763343032.172429:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1335, 88 off113296 00000004:00080000:0.0:1763343032.172435:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1225839813876ns, next at 1226132529377ns, rc = 0 00000001:00080000:3.0:1763343032.175367:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939663 is committed 00000004:00080000:3.0:1763343032.175386:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 879 committed 00000004:00080000:3.0:1763343032.175402:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 880 committed 00000004:00080000:3.0:1763343032.175414:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 879 committed 00000004:00080000:3.0:1763343032.175417:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 878 committed 00000100:00100000:1.0:1763343032.175711:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010223744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343032.175809:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343032.175868:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343032.175874:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010223616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343032.175897:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343032.175939:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010223744 00000100:00100000:1.0:1763343032.175949:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010223744 00000100:00100000:1.0:1763343032.176019:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010223616 00000100:00100000:1.0:1763343032.176023:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010223616 00000100:00100000:1.0:1763343032.176048:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6250 00000100:00100000:1.0:1763343032.176059:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3660:x1848998010223744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343032.176331:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3660:x1848998010223744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 271us (519us total) trans 21474838774 rc 0/0 00000100:00100000:1.0:1763343032.176340:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6250 00000100:00100000:1.0:1763343032.176362:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6251 00000100:00100000:1.0:1763343032.176369:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3660:x1848998010223616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343032.176387:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:640 count 1 00002000:00010000:1.0:1763343032.176429:0:15756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x280:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343032.176438:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae4d8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.176457:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.176460:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.176469:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae4d8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.176487:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae4d8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.176498:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae4d8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.176507:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae4d8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.176530:0:15756:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343032.176754:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3660:x1848998010223616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 385us (856us total) trans 21474838775 rc 0/0 00000100:00100000:1.0:1763343032.176761:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6251 00010000:00010000:1.0:1763343032.176794:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343032.176802:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae4d8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.176810:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343032.176815:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae4d8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.176825:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae4d8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.176846:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae4d8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.176855:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae4d8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.176876:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343032.176878:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343032.176880:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343032.176919:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052ac700/2, rc 0, transno 21474838775 00000100:00100000:1.0:1763343032.176925:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010223616:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1763343032.176934:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052afb80/2, rc 0, transno 21474838774 00000100:00100000:1.0:1763343032.176937:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010223744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.177334:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010223872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.177379:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.177419:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343032.177425:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010223488:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.177445:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.177549:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010224128:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.177574:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.177589:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343032.177594:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010224256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.177613:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.177663:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010224384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.177686:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.177703:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343032.177708:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010224000:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.177728:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.177756:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010223872 00000100:00100000:0.0:1763343032.177763:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010223872 00000100:00100000:0.0:1763343032.177797:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010223488 00000100:00100000:0.0:1763343032.177800:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010223488 00000100:00100000:0.0:1763343032.177813:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010224128 00000100:00100000:0.0:1763343032.177815:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010224128 00000100:00100000:0.0:1763343032.177829:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010224256 00000100:00100000:0.0:1763343032.177831:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010224256 00000100:00100000:0.0:1763343032.177842:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010224384 00000100:00100000:0.0:1763343032.177844:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010224384 00000100:00100000:0.0:1763343032.177856:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010224000 00000100:00100000:0.0:1763343032.177858:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010224000 00000100:00100000:0.0:1763343032.177873:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6252 00000100:00100000:0.0:1763343032.177883:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3657:x1848998010223872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343032.178038:0:28995:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343032.178042:0:28995:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.178045:0:28995:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.178047:0:28995:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.178050:0:28995:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343032.178090:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3657:x1848998010223872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (710us total) trans 21474838776 rc 0/0 00000100:00100000:0.0:1763343032.178097:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6252 00000100:00100000:0.0:1763343032.178114:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6253 00000100:00100000:0.0:1763343032.178121:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3657:x1848998010223488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343032.178136:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:639 count 1 00010000:00010000:0.0:1763343032.178152:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae4d93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.178174:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae4bda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8987 expref: 31 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.178184:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343032.178187:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343032.178191:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae4d93 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.178227:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae4bda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8987 expref: 31 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.178243:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae4bda lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8987 expref: 31 pid: 28996 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1763343032.178262:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010224512:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343032.178340:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3538bea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343032.178361:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6254 00000100:00100000:0.0:1763343032.178369:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3659:x1848998010224128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343032.178385:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:642 count 1 00002000:00010000:0.0:1763343032.178413:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x282:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343032.178419:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae4d9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.178428:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.178430:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.178436:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae4d9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.178448:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae4d9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.178457:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae4d9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.178465:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae4d9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.178487:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343032.178739:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010224128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 371us (1163us total) trans 17179871475 rc 0/0 00000100:00100000:0.0:1763343032.178750:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6254 00000100:00100000:0.0:1763343032.178766:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6255 00000100:00100000:0.0:1763343032.178773:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3659:x1848998010224256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.178849:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010224256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (1234us total) trans 17179871476 rc 0/0 00000100:00100000:0.0:1763343032.178856:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6255 00000100:00100000:0.0:1763343032.178868:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6256 00000100:00100000:0.0:1763343032.178875:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3657:x1848998010224384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343032.178925:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343032.178928:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.178930:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.178932:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.178935:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343032.178960:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3657:x1848998010224384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (1274us total) trans 17179871477 rc 0/0 00000100:00100000:0.0:1763343032.178966:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6256 00000100:00100000:0.0:1763343032.178991:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6257 00000100:00100000:0.0:1763343032.178998:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3657:x1848998010224000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343032.179010:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:641 count 1 00010000:00010000:0.0:1763343032.179022:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4da1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.179035:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4c04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8995 expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.179048:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343032.179050:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343032.179053:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4da1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.179078:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4c04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8995 expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.179088:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4c04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8995 expref: 14 pid: 28996 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1763343032.179101:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1848998010224640:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343032.179139:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406a47c00 going to sleep for 11 seconds 00010000:00010000:0.0:1763343032.179156:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343032.179164:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae4d9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.179173:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343032.179178:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae4d9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.179187:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae4d9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.179204:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae4d9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.179218:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae4d9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.179237:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.179239:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.179241:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343032.179278:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f39880/2, rc 0, transno 17179871476 00000100:00100000:0.0:1763343032.179284:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010224256:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343032.179296:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f39c00/2, rc 0, transno 17179871475 00000100:00100000:0.0:1763343032.179300:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010224128:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1763343032.179323:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f39f80/2, rc 0, transno 17179871477 00000100:00100000:0.0:1763343032.179327:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010224384:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343032.179341:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052ae680/2, rc 0, transno 21474838776 00000100:00100000:0.0:1763343032.179346:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010223872:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763343032.179409:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4d85 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a13 expref: 229 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.179420:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:0.0:1763343032.179423:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343032.179440:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4d7e lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a13 expref: 229 pid: 10041 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343032.179455:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4d85 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a13 expref: 228 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.179497:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:0.0:1763343032.179500:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343032.179502:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665dc00, rc 0) 00000100:00100000:0.0:1763343032.179529:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:55941:x1848997993424384:12345-192.168.204.21@tcp:101:bash.0 Request processed in 14025us (14312us total) trans 8589939663 rc 0/0 00000100:00100000:0.0:1763343032.179536:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8968 00000100:00100000:1.0:1763343032.186412:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.186465:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.186499:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993424768 00000100:00100000:1.0:1763343032.186514:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993424768 00010000:00010000:1.0:1763343032.186577:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae4bda lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8987 expref: 32 pid: 28996 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343032.186616:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993425152 00000100:00100000:1.0:1763343032.186638:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993425152 00010000:00010000:1.0:1763343032.186659:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4c04 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8995 expref: 15 pid: 28996 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343032.186687:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2946 00000100:00100000:1.0:1763343032.186698:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2429:x1848997993424768:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343032.186719:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343032.186726:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae4bda lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8987 expref: 32 pid: 28996 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343032.186741:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae4bda lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8987 expref: 32 pid: 28996 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343032.186775:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.186778:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.186784:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae4d93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.186796:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae4d93 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.186822:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343032.186890:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2429:x1848997993424768:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 193us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.186898:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2946 00000100:00100000:1.0:1763343032.186922:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2947 00000100:00100000:1.0:1763343032.186928:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993425152:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343032.186937:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343032.186941:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4c04 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8995 expref: 15 pid: 28996 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343032.186951:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4c04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8995 expref: 15 pid: 28996 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343032.186967:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.186969:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.186972:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4da1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.186993:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4da1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.187004:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343032.187023:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993425152:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 95us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.187028:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2947 00010000:00010000:0.0:1763343032.187350:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae4c04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8995 expref: 14 pid: 28996 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1763343032.187366:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1848998010224640:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343032.187394:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4da1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.187405:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4da1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.187412:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4da1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.187422:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4da1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.187430:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4da1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.187465:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343032.187793:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3657:x1848998010224000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8793us (10061us total) trans 17179871478 rc 0/0 00000100:00100000:0.0:1763343032.187804:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6257 00000004:00080000:0.0:1763343032.187850:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f39180/2, rc 0, transno 17179871478 00000100:00100000:0.0:1763343032.187856:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010224000:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.187880:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993425024 00000100:00100000:0.0:1763343032.187886:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993425024 00000100:00100000:0.0:1763343032.187927:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8969 00000100:00100000:0.0:1763343032.187934:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56823:x1848997993425024:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343032.187956:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.187993:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4da8 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a1a expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.188092:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4daf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188106:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4daf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188117:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4daf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188128:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4db6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188135:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4db6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188145:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4db6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188275:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4dbd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188285:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4dbd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188292:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4dbd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343032.188304:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c6:0x0]: returning size 2 00010000:00010000:0.0:1763343032.188392:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4daf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188399:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4daf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188405:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4daf lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188412:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4daf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188419:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.188424:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4daf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188432:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4daf lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188445:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bf300) 00010000:00010000:0.0:1763343032.188449:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.188454:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4daf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188460:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae4daf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188471:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4db6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188477:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4db6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188483:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4db6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188487:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.188489:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4db6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188495:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4db6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188501:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bf400) 00010000:00010000:0.0:1763343032.188504:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.188506:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4db6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188511:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4db6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.188555:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4da8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a1a expref: 231 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.188571:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4dbd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a1a expref: 230 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.188579:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:0.0:1763343032.188581:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343032.188584:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665cc00, rc 0) 00000100:00100000:0.0:1763343032.188681:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56823:x1848997993425024:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 747us (4272us total) trans 8589939664 rc 0/0 00000100:00100000:0.0:1763343032.188689:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8969 00000100:00100000:3.0:1763343032.188912:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343032.189341:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343032.189350:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4da1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.189358:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343032.189363:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4da1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.189370:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4da1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.189387:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4da1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.189395:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae4da1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.189420:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343032.189424:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae4d93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.189431:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343032.189434:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae4d93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.189440:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae4d93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.189455:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae4d93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.189461:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae4d93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.189473:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343032.189475:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343032.189477:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343032.189912:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343032.191112:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.192952:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993425664 00000100:00100000:3.0:1763343032.192964:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993425664 00000100:00100000:0.0:1763343032.193760:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3048 00000100:00100000:0.0:1763343032.193778:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56823:x1848997993425664:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343032.194133:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56823:x1848997993425664:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 360us (1256us total) trans 8589939665 rc 0/0 00000100:00100000:0.0:1763343032.194141:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3048 00000100:00100000:1.0:1763343032.200317:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.200360:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.200429:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993425920 00000100:00100000:0.0:1763343032.200442:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993425920 00002000:00010000:0.0:1763343032.200497:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/641 (0->18446744073709551615) 00002000:00100000:0.0:1763343032.200502:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34059d5500 with x1848997993425920 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343032.200517:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34059d5500. 00000100:00100000:0.0:1763343032.200552:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993425792 00000100:00100000:0.0:1763343032.200555:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993425792 00002000:00010000:0.0:1763343032.200569:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/643 (0->18446744073709551615) 00002000:00100000:0.0:1763343032.200573:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34059d7480 with x1848997993425792 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343032.200580:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34059d7480. 00000100:00100000:0.0:1763343032.200607:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1540 00000100:00100000:0.0:1763343032.200646:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2432:x1848997993425920:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343032.200884:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x281:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343032.200889:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x281:0x0] updating lvb mtime from disk: 0 -> 1763343032 00002000:00010000:0.0:1763343032.200892:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x281:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.200894:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x281:0x0] updating lvb ctime from disk: 0 -> 1763343032 00002000:00010000:0.0:1763343032.200897:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x281:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343032.200973:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+33:2432:x1848997993425920:12345-192.168.204.21@tcp:10:bash.0 Request processed in 355us (670us total) trans 21474838778 rc 0/0 00000100:00100000:0.0:1763343032.200991:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1540 00002000:00010000:0.0:1763343032.200996:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/641 (0->18446744073709551615) 00002000:00100000:0.0:1763343032.200999:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34059d5500 with x1848997993425920 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343032.201004:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34059d5500. 00000100:00100000:0.0:1763343032.201034:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1541 00000100:00100000:0.0:1763343032.201041:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2432:x1848997993425792:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343032.201141:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343032.201145:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb mtime from disk: 0 -> 1763343032 00002000:00010000:0.0:1763343032.201147:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.201150:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb ctime from disk: 0 -> 1763343032 00002000:00010000:0.0:1763343032.201156:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343032.201179:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993425792:12345-192.168.204.21@tcp:10:bash.0 Request processed in 140us (818us total) trans 17179871479 rc 0/0 00000100:00100000:0.0:1763343032.201186:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1541 00002000:00010000:0.0:1763343032.201190:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/643 (0->18446744073709551615) 00002000:00100000:0.0:1763343032.201192:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34059d7480 with x1848997993425792 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343032.201196:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34059d7480. 00000100:00100000:0.0:1763343032.209357:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.213762:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993426432 00000100:00100000:0.0:1763343032.213776:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993426432 00000100:00100000:0.0:1763343032.214060:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8970 00000100:00100000:0.0:1763343032.214072:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56824:x1848997993426432:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343032.214099:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.214126:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4dd9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a2f expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.214266:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4de0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.214285:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4de0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.214298:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4de0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343032.214311:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c6:0x0]: returning size 5 00010000:00010000:0.0:1763343032.214447:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4dd9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a2f expref: 235 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.214469:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4de0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a2f expref: 234 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.214479:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:0.0:1763343032.214483:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763343032.214487:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c000, rc 0) 00000100:00100000:0.0:1763343032.214561:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56824:x1848997993426432:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 491us (866us total) trans 8589939667 rc 0/0 00000100:00100000:0.0:1763343032.214569:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8970 00000100:00100000:1.0:1763343032.222283:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.222343:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993426688 00000100:00100000:0.0:1763343032.222358:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993426688 00000100:00100000:0.0:1763343032.222444:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8971 00000100:00100000:0.0:1763343032.222454:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56824:x1848997993426688:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343032.222491:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.222518:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4dee lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a36 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.222741:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.222759:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4dbd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a1a expref: 235 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.222769:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.222812:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4dbd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a1a expref: 235 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.222826:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4dbd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a1a expref: 235 pid: 10041 timeout: 1325 lvb_type: 0 00000100:00100000:1.0:1763343032.222841:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406648a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010224768:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343032.222952:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35379990c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343032.225483:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.227509:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406648a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010224768:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343032.227561:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:0.0:1763343032.229284:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.229434:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993427072 00000100:00100000:3.0:1763343032.229446:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993427072 00010000:00010000:3.0:1763343032.229491:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4dbd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a1a expref: 237 pid: 10041 timeout: 1325 lvb_type: 0 00000100:00100000:3.0:1763343032.229934:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2948 00000100:00100000:3.0:1763343032.229947:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:2430:x1848997993427072:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343032.229965:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343032.229974:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4dbd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a1a expref: 237 pid: 10041 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343032.230000:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4dbd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a1a expref: 237 pid: 10041 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343032.230136:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae4dbd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a1a expref: 237 pid: 10041 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343032.230159:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:3.0:1763343032.230166:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.230179:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.230188:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.230223:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343032.230284:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:2430:x1848997993427072:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 340us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.230292:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2948 00010000:00010000:0.0:1763343032.230356:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.230365:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343032.230396:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c6:0x0]: returning size 5 00010000:00010000:0.0:1763343032.230552:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4dee lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a36 expref: 237 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.230569:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a36 expref: 236 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.230577:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:0.0:1763343032.230581:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763343032.230583:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:0.0:1763343032.230650:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56824:x1848997993426688:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8168us (8354us total) trans 8589939669 rc 0/0 00000100:00100000:0.0:1763343032.230663:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8971 00000100:00100000:0.0:1763343032.230804:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.230914:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993427456 00000100:00100000:0.0:1763343032.230921:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993427456 00000100:00100000:0.0:1763343032.230957:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8972 00000100:00100000:0.0:1763343032.230966:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56825:x1848997993427456:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:0.0:1763343032.231036:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763343032.231052:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4de0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a2f expref: 236 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.231067:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4d85 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a13 expref: 235 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.231079:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7e00/0x607405d401ae4d46 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89fe expref: 234 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.231088:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:0.0:1763343032.231092:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343032.231119:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4e03 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.231129:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4e03 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.231137:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4e03 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.231148:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4e0a lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.231159:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4e0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.231165:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4e0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.231248:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.231259:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a36 expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.231268:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.231305:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a36 expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.231320:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a36 expref: 233 pid: 28422 timeout: 1325 lvb_type: 0 00000100:00100000:0.0:1763343032.231335:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010224896:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343032.231403:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34039e3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1763343032.235952:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010224896:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343032.236003:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:0.0:1763343032.236109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.236235:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.236323:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993427584 00000100:00100000:1.0:1763343032.236334:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993427584 00000100:00100000:1.0:1763343032.236418:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8973 00000100:00100000:1.0:1763343032.236430:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56824:x1848997993427584:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:3.0:1763343032.236456:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993427712 00000100:00100000:3.0:1763343032.236462:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993427712 00010000:00010000:1.0:1763343032.236467:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.236491:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a36 expref: 235 pid: 28422 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343032.236496:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4e18 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a3d expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343032.236529:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2949 00000100:00100000:3.0:1763343032.236538:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:2429:x1848997993427712:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343032.236551:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343032.236558:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a36 expref: 236 pid: 28422 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343032.236571:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a36 expref: 236 pid: 28422 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343032.236604:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae4df5 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1c6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a36 expref: 236 pid: 28422 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343032.236647:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:3.0:1763343032.236654:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.236666:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.236668:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4e1f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.236679:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.237247:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.237257:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4e1f lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.237274:0:10041:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 5/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.237284:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4e1f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.237424:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343032.237514:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:2429:x1848997993427712:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 975us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.237524:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2949 00010000:00010000:1.0:1763343032.237671:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.237683:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00000004:00080000:1.0:1763343032.238574:0:28422:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1c6:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1763343032.238728:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.238738:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.238745:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.238751:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.238756:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.238764:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.238782:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:1.0:1763343032.238785:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343032.238789:0:28422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4e1f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.238798:0:28422:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4e1f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.238806:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4e1f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.238840:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.238852:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4e11 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.238871:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4e03 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.238877:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4e03 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.238894:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4e03 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.238898:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.238902:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4e03 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.238907:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4e03 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.238915:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bf300) 00010000:00010000:1.0:1763343032.238918:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.238922:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4e03 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.238928:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4e03 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:1.0:1763343032.238946:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003745aac5 reply state 00000000fac780b4 transno 8589939670 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4e0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.238958:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4e0a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.238964:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bf400) 00010000:00010000:1.0:1763343032.238968:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343032.238971:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343032.239070:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56825:x1848997993427456:12345-192.168.204.21@tcp:36:rm.0 Request processed in 8101us (8262us total) trans 8589939670 rc 0/0 00000100:00100000:1.0:1763343032.239079:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8972 00010000:00010000:0.0:1763343032.239462:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4e1f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.239472:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4e1f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343032.239512:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c6:0x0]: returning size 5 00000004:00200000:0.0:1763343032.239517:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343032.239537:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4e1f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.239572:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4e18 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a3d expref: 236 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.239591:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4e1f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a3d expref: 235 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.239598:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:0.0:1763343032.239601:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343032.239603:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177a00, rc 0) 00000100:00100000:0.0:1763343032.239668:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56824:x1848997993427584:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3240us (4017us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.239674:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8973 00000100:00100000:0.0:1763343032.244215:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993427968 00000100:00100000:0.0:1763343032.244234:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993427968 00000100:00100000:0.0:1763343032.244316:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8974 00000100:00100000:0.0:1763343032.244328:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56824:x1848997993427968:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343032.244456:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.244485:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4e26 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a44 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.244679:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4e2d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.244704:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4e2d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.244719:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4e2d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343032.244734:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c6:0x0]: returning size 5 00010000:00010000:0.0:1763343032.244930:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4e26 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a44 expref: 238 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.244953:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4e2d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a44 expref: 237 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.244963:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:0.0:1763343032.244967:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343032.244972:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c000, rc 0) 00000100:00100000:0.0:1763343032.245061:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56824:x1848997993427968:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 734us (913us total) trans 8589939671 rc 0/0 00000100:00100000:0.0:1763343032.245070:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8974 00000100:00100000:3.0:1763343032.250064:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993428096 00000100:00100000:3.0:1763343032.250082:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993428096 00000100:00100000:3.0:1763343032.250161:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6260 00000100:00100000:3.0:1763343032.250176:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993428096:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:3.0:1763343032.250241:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae4e3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.250265:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4dcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a21 expref: 16 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.250274:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343032.250278:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343032.250283:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae4e3b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.250327:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4dcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a21 expref: 16 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.250343:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4dcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a21 expref: 16 pid: 28995 timeout: 1325 lvb_type: 0 00000100:00100000:3.0:1763343032.250361:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340465ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010225024:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343032.250475:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343032.252700:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340465ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010225024:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343032.252737:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae4e3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343032.253936:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993428224 00000100:00100000:3.0:1763343032.253949:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993428224 00002000:00100000:2.0:1763343032.254100:0:24021:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x283:0x0] (0->4) req@ffff9a3406b91880 x1848997993428224/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:528/0 lens 496/0 e 0 to 0 dl 1763343043 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343032.254113:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406b91880 with x1848997993428224 ext(0->4) 00010000:00010000:2.0:1763343032.254122:0:24021:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4dcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a21 expref: 17 pid: 28995 timeout: 1325 lvb_type: 0 00010000:00010000:2.0:1763343032.254138:0:24021:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4dcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a21 expref: 17 pid: 28995 timeout: 1325 lvb_type: 0 00002000:00010000:2.0:1763343032.254147:0:24021:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a3406b91880 00000100:00100000:1.0:1763343032.255611:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 101 00000100:00100000:1.0:1763343032.255669:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993428224:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:1.0:1763343032.261597:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993428224:12345-192.168.204.21@tcp:4:bash.0 Request processed in 5925us (8216us total) trans 17179871480 rc 0/0 00000100:00100000:1.0:1763343032.261615:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 101 00002000:00100000:1.0:1763343032.261677:0:28425:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x283:0x0] (0->4) req@ffff9a3406b91880 x1848997993428224/t17179871480(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:528/0 lens 496/448 e 0 to 0 dl 1763343043 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343032.261689:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406b91880 with x1848997993428224 ext(0->4) 00010000:00010000:1.0:1763343032.261701:0:28425:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4dcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a21 expref: 19 pid: 28995 timeout: 1325 lvb_type: 0 00010000:00010000:1.0:1763343032.261723:0:28425:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4dcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a21 expref: 19 pid: 28995 timeout: 1325 lvb_type: 0 00002000:00010000:1.0:1763343032.261731:0:28425:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a3406b91880 00000100:00100000:2.0:1763343032.263989:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.264816:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.264881:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993428480 00000100:00100000:3.0:1763343032.264893:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993428480 00010000:00010000:3.0:1763343032.264992:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4dcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a21 expref: 19 pid: 28995 timeout: 1325 lvb_type: 0 00000100:00100000:3.0:1763343032.265044:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2950 00000100:00100000:3.0:1763343032.265056:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2431:x1848997993428480:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343032.265076:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1763343032.265098:0:13199:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:3.0:1763343032.265103:0:13199:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763343032.265110:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4dcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a21 expref: 19 pid: 28995 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343032.265125:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4dcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a21 expref: 19 pid: 28995 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343032.265155:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6000/0x607405d401ae4dcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a21 expref: 19 pid: 28995 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343032.265176:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343032.265179:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343032.265184:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae4e3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.265196:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae4e3b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.265240:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343032.265478:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993428352 00000100:00100000:1.0:1763343032.265485:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993428352 00000100:00100000:1.0:1763343032.265533:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8975 00000100:00100000:1.0:1763343032.265542:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56826:x1848997993428352:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.265570:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.265597:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4e42 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a4b expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343032.265610:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2431:x1848997993428480:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 556us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.265659:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2950 00010000:00010000:1.0:1763343032.265708:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4e49 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.265872:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae4e3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.265883:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae4e3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.265912:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae4e3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.265920:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae4e3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.265929:0:28995:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae4e3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.265936:0:28995:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343032.265941:0:28995:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae4e3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.265949:0:28995:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae4e3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.265963:0:28995:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae4e3b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.265970:0:28995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae4e3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343032.266043:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993428096:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 15872us (16108us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.266052:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6260 00010000:00010000:1.0:1763343032.267456:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4e49 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267484:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4e49 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267510:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4e50 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267519:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4e50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267525:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4e50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267580:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4e49 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267587:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4e49 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267593:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4e49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267599:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.267604:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4e49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267610:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4e49 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267640:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:1.0:1763343032.267644:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.267648:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4e49 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267654:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4e49 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267668:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4e50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267674:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4e50 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267679:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4e50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267684:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.267686:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4e50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267691:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4e50 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267696:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bf400) 00010000:00010000:1.0:1763343032.267698:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.267700:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4e50 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267705:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4e50 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.267749:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4e42 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a4b expref: 238 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.267762:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:1.0:1763343032.267764:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.267768:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4e42 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a4b expref: 238 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.267784:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176e00, rc 0) 00000100:00100000:1.0:1763343032.267863:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56826:x1848997993428352:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2321us (3895us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343032.267872:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8975 00000100:00100000:0.0:1763343032.268414:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.269088:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993428736 00000100:00100000:1.0:1763343032.269100:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993428736 00000100:00100000:1.0:1763343032.269154:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8976 00000100:00100000:1.0:1763343032.269163:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56824:x1848997993428736:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:1.0:1763343032.269225:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343032.269448:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4e1f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a3d expref: 237 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.269469:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:1.0:1763343032.269474:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343032.269509:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4e57 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.269523:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4e57 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.269532:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4e57 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:1.0:1763343032.269858:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1336, 88 off113384 00000004:00080000:1.0:1763343032.269867:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1225937245324ns, next at 1226132529377ns, rc = 0 00000040:00080000:1.0:1763343032.269953:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1335, 88 off113384 00000004:00080000:1.0:1763343032.269957:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1225937336731ns, next at 1226132560989ns, rc = 0 00000040:00080000:1.0:1763343032.270463:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1336, 88 off113472 00000004:00080000:1.0:1763343032.270473:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1225937851829ns, next at 1226132560989ns, rc = 0 00000040:00080000:1.0:1763343032.270562:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1337, 88 off113472 00000004:00080000:1.0:1763343032.270568:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1225937947259ns, next at 1226132529377ns, rc = 0 00000100:00100000:2.0:1763343032.276143:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000001:00080000:3.0:1763343032.276612:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939672 is committed 00000004:00080000:3.0:1763343032.276645:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 881 committed 00000004:00080000:3.0:1763343032.276659:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 882 committed 00000004:00080000:3.0:1763343032.276672:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 881 committed 00000004:00080000:3.0:1763343032.276674:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 880 committed 00010000:00010000:1.0:1763343032.276849:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4e0a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.276863:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4e0a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.276871:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4e0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.276878:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ca00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.276883:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4e0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.276891:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4e0a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.276909:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bf400) 00010000:00010000:1.0:1763343032.276912:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.276917:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4e0a lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.276923:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4e0a lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:1.0:1763343032.277078:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bc4c5d4d reply state 00000000246005b1 transno 8589939672 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4e57 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.277094:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4e57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.277101:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:1.0:1763343032.277104:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763343032.277107:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1763343032.277236:0:28422:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763343032.277256:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56824:x1848997993428736:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 8090us (8840us total) trans 8589939672 rc 0/0 00000100:00100000:1.0:1763343032.277284:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8976 00000100:00100000:2.0:1763343032.277337:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010225280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343032.277386:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340465ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010225152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343032.277393:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343032.277416:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343032.277429:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343032.277435:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010225408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343032.277445:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343032.277450:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010225536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343032.277454:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343032.277468:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343032.277489:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010225280 00000100:00100000:2.0:1763343032.277497:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010225280 00000100:00100000:2.0:1763343032.277554:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010225152 00000100:00100000:2.0:1763343032.277557:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010225152 00000100:00100000:2.0:1763343032.277576:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010225408 00000100:00100000:2.0:1763343032.277579:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010225408 00000100:00100000:2.0:1763343032.277593:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010225536 00000100:00100000:2.0:1763343032.277597:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010225536 00000100:00100000:2.0:1763343032.277617:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6261 00000100:00100000:2.0:1763343032.277644:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+59:3659:x1848998010225280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.277691:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993428864 00000100:00100000:0.0:1763343032.277697:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993428864 00010000:00010000:1.0:1763343032.277708:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4e57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00000100:00100000:0.0:1763343032.277710:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6262 00010000:00010000:1.0:1763343032.277716:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4e57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00000100:00100000:0.0:1763343032.277719:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3658:x1848998010225152:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1763343032.277723:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4e57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.277728:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.277731:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4e57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.277737:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4e57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.277746:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:1.0:1763343032.277749:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343032.277753:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4e57 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.277758:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4e57 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:0.0:1763343032.277910:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3658:x1848998010225152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (492us total) trans 17179871481 rc 0/0 00000100:00100000:0.0:1763343032.277917:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6262 00000100:00100000:0.0:1763343032.277931:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6263 00000100:00100000:0.0:1763343032.277938:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3659:x1848998010225408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343032.278038:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343032.278042:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.278045:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.278047:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.278050:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343032.278081:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3659:x1848998010225408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (625us total) trans 21474838779 rc 0/0 00000100:00100000:0.0:1763343032.278088:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6263 00000100:00100000:0.0:1763343032.278099:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6264 00000100:00100000:0.0:1763343032.278105:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3658:x1848998010225536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343032.278156:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343032.278159:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.278160:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.278162:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.278164:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343032.278187:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3658:x1848998010225536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (718us total) trans 17179871482 rc 0/0 00000100:00100000:0.0:1763343032.278193:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6264 00000100:00100000:0.0:1763343032.278235:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8977 00000100:00100000:0.0:1763343032.278241:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56826:x1848997993428864:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343032.278254:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.278277:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4e5e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a52 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.278346:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4e65 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278358:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4e65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278369:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4e65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278381:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4e6c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278387:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4e6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278392:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4e6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278429:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4e65 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278435:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4e65 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278440:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4e65 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278445:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4e65 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278449:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.278452:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4e65 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278456:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4e65 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278466:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bf300) 00010000:00010000:0.0:1763343032.278469:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.278471:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4e65 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278477:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae4e65 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278486:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4e6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278491:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4e6c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278495:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4e6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278499:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.278502:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4e6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278506:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4e6c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278511:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bf200) 00010000:00010000:0.0:1763343032.278513:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.278515:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4e6c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278519:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae4e6c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.278546:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4e5e lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a52 expref: 229 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.278556:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bf300) 00010000:00010000:0.0:1763343032.278559:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.278562:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae4e5e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a52 expref: 229 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.278571:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d800, rc 0) 00000100:00100000:0.0:1763343032.278601:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56826:x1848997993428864:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 361us (2476us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343032.278607:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8977 00000004:00080000:0.0:1763343032.278958:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b91f80/2, rc 0, transno 21474838779 00000100:00100000:0.0:1763343032.278965:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010225408:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343032.279094:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052ace00/2, rc 0, transno 17179871482 00000100:00100000:3.0:1763343032.279100:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010225536:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343032.279110:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340465ea00/2, rc 0, transno 17179871481 00000100:00100000:3.0:1763343032.279114:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340465ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010225152:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343032.279771:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x281:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343032.279783:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x281:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343032.279786:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x281:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.279789:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x281:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343032.279791:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x281:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343032.279864:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+60:3659:x1848998010225280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2220us (2468us total) trans 21474838780 rc 0/0 00000100:00100000:0.0:1763343032.279874:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6261 00000004:00080000:2.0:1763343032.279898:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b91c00/2, rc 0, transno 21474838780 00000100:00100000:2.0:1763343032.279903:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010225280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.281707:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.281748:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.281956:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993428992 00000100:00100000:3.0:1763343032.281970:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993428992 00000100:00100000:3.0:1763343032.282045:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993429120 00000100:00100000:3.0:1763343032.282049:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993429120 00000100:00100000:3.0:1763343032.282172:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8978 00000100:00100000:3.0:1763343032.282184:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56824:x1848997993428992:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:1.0:1763343032.282210:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8979 00010000:00010000:3.0:1763343032.282217:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763343032.282227:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+228:56826:x1848997993429120:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.282238:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.282250:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4e73 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a59 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.282262:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4e7a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a60 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.282339:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4e81 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.282356:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4e81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.282369:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4e81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343032.282428:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343032.282435:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343032.282478:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4e7a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a60 expref: 230 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.282500:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4e81 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a60 expref: 229 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.282509:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:1.0:1763343032.282512:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343032.282517:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00010000:00010000:3.0:1763343032.282544:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4e73 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a59 expref: 230 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.282556:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4e73 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a59 expref: 230 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.282574:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:3.0:1763343032.282577:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343032.282581:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:1.0:1763343032.282597:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56826:x1848997993429120:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 374us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.282606:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8979 00000100:00100000:3.0:1763343032.282612:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56824:x1848997993428992:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 427us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.282659:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8978 00000100:00100000:0.0:1763343032.292303:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.292793:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993429376 00000100:00100000:2.0:1763343032.292808:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993429376 00000100:00100000:3.0:1763343032.292892:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8980 00000100:00100000:3.0:1763343032.292908:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+229:56826:x1848997993429376:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343032.292936:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.292965:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4e88 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a6e expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343032.293022:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343032.293066:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4e8f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293084:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4e8f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293097:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4e8f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293113:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4e96 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293120:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4e96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293127:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4e96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:2.0:1763343032.293194:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993429248 00000100:00100000:2.0:1763343032.293198:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993429248 00000100:00100000:2.0:1763343032.293235:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8981 00000100:00100000:2.0:1763343032.293243:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56824:x1848997993429248:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343032.293251:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.293262:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4e9d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a67 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.293312:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae4ea4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.293322:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae4ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.293331:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae4ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343032.293388:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c6:0x0]: returning size 5 00000004:00200000:2.0:1763343032.293393:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343032.293419:0:6523:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae4ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.293449:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4e9d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a67 expref: 233 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.293477:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae4ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a67 expref: 232 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.293487:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:2.0:1763343032.293491:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763343032.293496:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6600, rc 0) 00000100:00100000:2.0:1763343032.293574:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56824:x1848997993429248:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 331us (552us total) trans 0 rc 0/0 00010000:00010000:3.0:1763343032.293582:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4e8f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:2.0:1763343032.293583:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8981 00010000:00010000:3.0:1763343032.293594:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4e8f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293602:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4e8f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293609:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4e8f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293615:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.293648:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4e8f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293658:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4e8f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293670:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:3.0:1763343032.293673:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.293678:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4e8f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293685:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4e8f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293697:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4e96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293703:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4e96 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293710:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4e96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293715:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.293718:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4e96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293724:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4e96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293737:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404616000) 00010000:00010000:3.0:1763343032.293739:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.293743:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4e96 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293748:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4e96 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.293777:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4e88 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a6e expref: 231 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.293789:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:3.0:1763343032.293791:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.293795:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae4e88 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a6e expref: 231 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.293804:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:3.0:1763343032.293846:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56826:x1848997993429376:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 943us (1561us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343032.293853:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8980 00000100:00100000:0.0:1763343032.297038:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.297356:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993429632 00000100:00100000:1.0:1763343032.297370:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993429632 00000100:00100000:1.0:1763343032.297448:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8982 00000100:00100000:1.0:1763343032.297459:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56826:x1848997993429632:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.297489:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.297493:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343032.297529:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4e81 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a60 expref: 230 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.297555:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:1.0:1763343032.297569:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343032.297589:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4eab lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a75 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.297769:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4eb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.297784:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.297795:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.297807:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4eb9 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.297814:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.297822:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.298326:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4ec0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.298337:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.298345:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343032.298356:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c7:0x0]: returning size 0 00010000:00010000:1.0:1763343032.298386:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.298394:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4eb2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.298400:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4eb2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.298406:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.298410:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4eb2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.298419:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4eb2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.298428:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdcf00) 00010000:00010000:1.0:1763343032.298431:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.298436:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4eb2 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.298447:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4eb2 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:1.0:1763343032.298458:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ce84216b reply state 00000000fb5df860 transno 8589939673 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.298470:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4eb9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.298476:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdc200) 00010000:00010000:1.0:1763343032.298478:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343032.298481:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343032.298511:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4eab lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a75 expref: 232 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.298529:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a75 expref: 231 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.298536:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a3403bdc600) 00010000:00010000:1.0:1763343032.298538:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343032.298541:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177200, rc 0) 00000100:00100000:1.0:1763343032.298658:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56826:x1848997993429632:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1200us (1635us total) trans 8589939673 rc 0/0 00000100:00100000:1.0:1763343032.298666:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8982 00000100:00100000:2.0:1763343032.299175:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.300320:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993429760 00000100:00100000:3.0:1763343032.300347:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993429760 00000100:00100000:3.0:1763343032.300424:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6265 00000100:00100000:3.0:1763343032.300436:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993429760:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343032.300458:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.300481:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae4ece lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a7c expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343032.300518:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x283:0x0] initial LVB size: 5, mtime: 0x691a7ab8, atime: 0x0, ctime: 0x691a7ab8, blocks: 0x8 00010000:00010000:3.0:1763343032.300542:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343032.300545:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343032.300557:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae4ece lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a7c expref: 18 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343032.300577:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae4ece lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a7c expref: 18 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343032.300594:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:3.0:1763343032.300700:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993429760:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 266us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.300708:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6265 00000100:00100000:2.0:1763343032.304144:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.304618:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993430016 00000100:00100000:3.0:1763343032.304672:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993430016 00000100:00100000:2.0:1763343032.306261:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8983 00000100:00100000:2.0:1763343032.306301:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56826:x1848997993430016:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343032.306336:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.306365:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ed5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a83 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.306508:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4edc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.306526:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4ec0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a75 expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.306536:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4edc lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.306581:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a75 expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.306598:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4ec0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a75 expref: 233 pid: 28422 timeout: 1325 lvb_type: 0 00000100:00100000:2.0:1763343032.306614:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010225664:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343032.306785:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a353c6e8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1763343032.315871:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.316032:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010225664:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343032.316329:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4edc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:3.0:1763343032.316473:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993430144 00000100:00100000:3.0:1763343032.316484:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993430144 00010000:00010000:3.0:1763343032.316535:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4ec0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a75 expref: 234 pid: 28422 timeout: 1325 lvb_type: 0 00000100:00100000:3.0:1763343032.316584:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2951 00000100:00100000:3.0:1763343032.316595:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:2429:x1848997993430144:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343032.316615:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343032.316668:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4ec0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a75 expref: 234 pid: 28422 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343032.316687:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a75 expref: 234 pid: 28422 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343032.316715:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4ec0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a75 expref: 234 pid: 28422 timeout: 1325 lvb_type: 0 00010000:00010000:3.0:1763343032.316733:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a3403bdc600) 00010000:00010000:3.0:1763343032.316739:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4edc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.316749:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4edc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.316757:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4edc lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.316787:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343032.316855:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:2429:x1848997993430144:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 262us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.316864:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2951 00010000:00010000:2.0:1763343032.317664:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4edc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.317678:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4edc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343032.317713:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c7:0x0]: returning size 0 00000004:00080000:2.0:1763343032.317953:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x283:0x0], index 0: 0 00000004:00080000:2.0:1763343032.317960:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x285:0x0], index 1: 0 00000004:00080000:2.0:1763343032.317966:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x286:0x0], index 1: 0 00000004:00080000:2.0:1763343032.317970:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x284:0x0], index 0: 0 00010000:00010000:2.0:1763343032.318134:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4edc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.318143:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4edc lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.318151:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4edc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.318161:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.318166:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4edc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.318176:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4edc lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.318191:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a3403bdc600) 00010000:00010000:2.0:1763343032.318194:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343032.318199:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4edc lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.318206:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4edc lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.318268:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ed5 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a83 expref: 233 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.318280:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a3403bdc600) 00010000:00010000:2.0:1763343032.318282:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343032.318286:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ed5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a83 expref: 233 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.318305:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6400, rc 0) 00000100:00100000:2.0:1763343032.318403:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56826:x1848997993430016:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 12117us (14273us total) trans 8589939674 rc 301/301 00000100:00100000:2.0:1763343032.318413:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8983 00000100:00100000:0.0:1763343032.323835:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.323964:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993430400 00000100:00100000:2.0:1763343032.323987:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993430400 00000100:00100000:3.0:1763343032.324306:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3051 00000100:00100000:3.0:1763343032.324320:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56826:x1848997993430400:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343032.324746:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56826:x1848997993430400:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 427us (923us total) trans 8589939675 rc 0/0 00000100:00100000:3.0:1763343032.324755:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3051 00000100:00100000:2.0:1763343032.326994:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.327223:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993430656 00000100:00100000:0.0:1763343032.327237:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993430656 00000100:00100000:0.0:1763343032.327310:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3052 00000100:00100000:0.0:1763343032.327323:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56826:x1848997993430656:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343032.327681:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56826:x1848997993430656:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 359us (709us total) trans 8589939676 rc 0/0 00000100:00100000:0.0:1763343032.327690:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3052 00000100:00100000:0.0:1763343032.333597:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.334567:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993430912 00000100:00100000:2.0:1763343032.334583:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993430912 00000100:00100000:2.0:1763343032.334698:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8984 00000100:00100000:2.0:1763343032.334711:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:55941:x1848997993430912:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343032.334742:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.334772:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4eea lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a8a expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.334944:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4ef1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.334961:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.334988:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4ef1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335001:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae4ef8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335010:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae4ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335017:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae4ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335089:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae4eff lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335097:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae4eff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335105:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae4eff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343032.335117:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c7:0x0]: returning size 0 00010000:00010000:2.0:1763343032.335217:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4ef1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335226:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4ef1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335232:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4ef1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335240:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4ef1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335247:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.335252:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4ef1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335261:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4ef1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335290:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7b00) 00010000:00010000:2.0:1763343032.335293:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.335299:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4ef1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335306:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4ef1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335322:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae4ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335328:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae4ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335338:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae4ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335343:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.335347:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae4ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335352:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae4ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335359:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdc200) 00010000:00010000:2.0:1763343032.335362:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.335365:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae4ef8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335371:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae4ef8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.335413:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4eea lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a8a expref: 237 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.335432:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae4eff lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a8a expref: 236 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.335441:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343032.335443:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343032.335446:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7200, rc 0) 00000100:00100000:2.0:1763343032.338457:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:55941:x1848997993430912:12345-192.168.204.21@tcp:101:bash.0 Request processed in 3717us (4843us total) trans 8589939677 rc 0/0 00000100:00100000:2.0:1763343032.338478:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8984 00000100:00100000:3.0:1763343032.342572:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.343094:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993431040 00000100:00100000:2.0:1763343032.343109:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993431040 00000100:00100000:2.0:1763343032.344386:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8985 00000100:00100000:2.0:1763343032.344410:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:55941:x1848997993431040:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343032.344444:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.344471:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae4f0d lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a91 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.344515:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7e00/0x607405d401ae4f14 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.344533:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7e00/0x607405d401ae4f14 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.344548:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7e00/0x607405d401ae4f14 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.344728:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae4f0d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a91 expref: 238 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.344752:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7e00/0x607405d401ae4f14 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a91 expref: 237 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.344760:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343032.344764:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343032.344769:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7e00, rc 0) 00000100:00100000:2.0:1763343032.344853:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:55941:x1848997993431040:12345-192.168.204.21@tcp:101:bash.0 Request processed in 455us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.344862:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8985 00000100:00100000:3.0:1763343032.347219:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.347301:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993431296 00000100:00100000:2.0:1763343032.347315:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993431296 00000100:00100000:2.0:1763343032.347861:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8986 00000100:00100000:2.0:1763343032.347876:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:55941:x1848997993431296:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:2.0:1763343032.347949:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343032.348000:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae4eff lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a8a expref: 237 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.348025:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343032.348032:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343032.351054:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f1b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.351087:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f1b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.351104:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f1b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000001:00080000:2.0:1763343032.351216:0:10042:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939678 00000004:00010000:2.0:1763343032.351288:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008baa64e4 reply state 0000000081ea5b2f transno 8589939679 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f1b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.351303:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.351312:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343032.351316:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343032.351322:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343032.351487:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:55941:x1848997993431296:12345-192.168.204.21@tcp:36:bash.0 Request processed in 3609us (4273us total) trans 8589939679 rc 0/0 00000100:00100000:2.0:1763343032.351498:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8986 00000020:00080000:2.0:1763343032.351507:0:10042:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343032.356094:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.357509:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993431424 00000100:00100000:1.0:1763343032.357528:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993431424 00000100:00100000:1.0:1763343032.357610:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6266 00000100:00100000:1.0:1763343032.358424:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993431424:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:1.0:1763343032.359884:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993431424:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 2254us (3796us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.359901:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6266 00000100:00100000:0.0:1763343032.360075:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.360904:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993431552 00000100:00100000:1.0:1763343032.360917:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993431552 00000100:00100000:1.0:1763343032.360983:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8987 00000100:00100000:1.0:1763343032.360994:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:55941:x1848997993431552:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343032.361024:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.361051:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4f22 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a98 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.361124:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4f22 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a98 expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.361142:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4f22 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a98 expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.361162:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:1.0:1763343032.361166:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343032.361170:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176800, rc 0) 00000100:00100000:1.0:1763343032.361231:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993431552:12345-192.168.204.21@tcp:101:bash.0 Request processed in 238us (1966us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.361238:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8987 00000100:00100000:3.0:1763343032.364813:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.366358:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.366448:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993431936 00000100:00100000:1.0:1763343032.366462:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993431936 00000100:00100000:1.0:1763343032.366543:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8988 00000100:00100000:1.0:1763343032.366555:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993431936:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343032.366583:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.366587:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343032.366654:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4f22 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a98 expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.366678:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:1.0:1763343032.366685:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343032.366702:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4f29 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8a9f expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.366766:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae4f30 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.366784:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae4f30 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.366795:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae4f30 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:1.0:1763343032.367111:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1337, 88 off113560 00000004:00080000:1.0:1763343032.367122:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226034500275ns, next at 1226132560989ns, rc = 0 00000040:00080000:1.0:1763343032.367157:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1338, 88 off113560 00000004:00080000:1.0:1763343032.367163:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226034542045ns, next at 1226132529377ns, rc = 0 00000040:00080000:1.0:1763343032.367224:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1339, 88 off113648 00000004:00080000:1.0:1763343032.367229:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226034608669ns, next at 1226132529377ns, rc = 0 00000040:00080000:1.0:1763343032.367248:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1338, 88 off113648 00000004:00080000:1.0:1763343032.367253:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226034632190ns, next at 1226132560989ns, rc = 0 00000100:00100000:0.0:1763343032.367465:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993431680 00000100:00100000:0.0:1763343032.367474:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993431680 00000100:00100000:0.0:1763343032.367516:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6267 00000100:00100000:0.0:1763343032.367524:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2432:x1848997993431680:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:0.0:1763343032.367846:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2432:x1848997993431680:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 320us (3047us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.367855:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6267 00000100:00100000:3.0:1763343032.372615:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.372802:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993432064 00000100:00100000:1.0:1763343032.372817:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993432064 00000100:00100000:1.0:1763343032.373000:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1542 00000100:00100000:1.0:1763343032.373014:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2431:x1848997993432064:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:1.0:1763343032.373073:0:28425:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae4f37 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.373091:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.373094:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.373101:0:28425:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae4f37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.373120:0:28425:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae4f37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.373264:0:28425:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae4f37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.373275:0:28425:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae4f37 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.373283:0:28425:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae4f37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.373290:0:28425:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343032.373295:0:28425:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae4f37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.373305:0:28425:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae4f37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.373324:0:28425:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae4f37 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.373336:0:28425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae4f37 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343032.373433:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2431:x1848997993432064:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 421us (834us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763343032.373442:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1542 00000001:00080000:1.0:1763343032.376444:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939680 is committed 00000004:00080000:1.0:1763343032.376465:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 884 committed 00000004:00080000:1.0:1763343032.376487:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 883 committed 00000004:00080000:1.0:1763343032.376507:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 882 committed 00000004:00080000:1.0:1763343032.376510:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 883 committed 00010000:00010000:1.0:1763343032.376616:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae4f30 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a9f expref: 234 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.376756:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4eb9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.376768:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4eb9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.376777:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4eb9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.376784:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.376791:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4eb9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.376801:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4eb9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.376820:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdc200) 00010000:00010000:0.0:1763343032.376824:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.376830:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4eb9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.376838:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae4eb9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343032.377105:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010226176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343032.377199:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343032.377261:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343032.377268:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010225792:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343032.377289:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343032.377322:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010225920:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343032.377346:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343032.377365:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343032.377371:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010226048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343032.377393:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343032.377425:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010226176 00000100:00100000:2.0:1763343032.377434:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010226176 00000100:00100000:2.0:1763343032.377478:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010225792 00000100:00100000:2.0:1763343032.377481:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010225792 00000100:00100000:2.0:1763343032.377497:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010225920 00000100:00100000:2.0:1763343032.377499:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010225920 00000100:00100000:2.0:1763343032.377512:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010226048 00000100:00100000:2.0:1763343032.377514:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010226048 00000100:00100000:2.0:1763343032.377531:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6268 00010000:00010000:0.0:1763343032.377537:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00000100:00100000:2.0:1763343032.377539:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3657:x1848998010226176:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763343032.377546:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.377551:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.377556:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.377559:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.377565:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.377576:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:0.0:1763343032.377578:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.377581:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f1b lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.377590:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f1b lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1c7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000100:00100000:0.0:1763343032.377642:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6269 00000100:00100000:0.0:1763343032.377652:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3657:x1848998010225792:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343032.377890:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:1.0:1763343032.377894:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343032.377919:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae4f29 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a9f expref: 232 pid: 28422 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343032.377938:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae4f30 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a9f expref: 231 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.377987:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:1.0:1763343032.377990:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343032.377993:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:1.0:1763343032.378060:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:55941:x1848997993431936:12345-192.168.204.21@tcp:101:bash.0 Request processed in 11506us (11709us total) trans 8589939680 rc 0/0 00000100:00100000:1.0:1763343032.378072:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8988 00000100:00100000:0.0:1763343032.378303:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+62:3657:x1848998010225792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 645us (1003us total) trans 21474838781 rc 0/0 00000100:00100000:0.0:1763343032.378312:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6269 00000100:00100000:0.0:1763343032.378330:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6270 00000100:00100000:0.0:1763343032.378336:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3659:x1848998010225920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.378417:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+62:3659:x1848998010225920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (1067us total) trans 21474838782 rc 0/0 00000100:00100000:0.0:1763343032.378423:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6270 00000100:00100000:0.0:1763343032.378434:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6271 00000100:00100000:0.0:1763343032.378440:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3659:x1848998010226048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.378526:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3659:x1848998010226048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (1130us total) trans 17179871483 rc 0/0 00000100:00100000:0.0:1763343032.378532:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6271 00000004:00080000:0.0:1763343032.378603:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b6300/2, rc 0, transno 17179871483 00000100:00100000:0.0:1763343032.378610:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010226048:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343032.378650:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478e680/2, rc 0, transno 21474838782 00000100:00100000:0.0:1763343032.378656:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010225920:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343032.378878:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3657:x1848998010226176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1339us (1679us total) trans 17179871484 rc 0/0 00000100:00100000:2.0:1763343032.378885:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6268 00000004:00080000:1.0:1763343032.379115:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478c700/2, rc 0, transno 21474838781 00000100:00100000:1.0:1763343032.379121:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010225792:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343032.379132:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b7480/2, rc 0, transno 17179871484 00000100:00100000:1.0:1763343032.379135:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010226176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343032.379584:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.379816:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993432192 00000100:00100000:1.0:1763343032.379826:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993432192 00000100:00100000:1.0:1763343032.379893:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8989 00000100:00100000:1.0:1763343032.379901:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56824:x1848997993432192:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.379924:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.379950:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4f3e lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8aa6 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.380004:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4f45 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.380025:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4f45 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.380038:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4f45 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.380179:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae4f3e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aa6 expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.380205:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177200/0x607405d401ae4f45 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aa6 expref: 232 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.380223:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:1.0:1763343032.380226:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343032.380230:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177200, rc 0) 00000100:00100000:1.0:1763343032.380290:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56824:x1848997993432192:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 389us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.380297:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8989 00000100:00100000:3.0:1763343032.386560:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.386893:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.387220:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993432448 00000100:00100000:0.0:1763343032.387220:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993432320 00000100:00100000:2.0:1763343032.387234:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993432448 00000100:00100000:0.0:1763343032.387234:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993432320 00000100:00100000:0.0:1763343032.387480:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1543 00000100:00100000:2.0:1763343032.387484:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6272 00000100:00100000:2.0:1763343032.387493:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:55941:x1848997993432448:12345-192.168.204.21@tcp:101:bash.0 00000100:00100000:0.0:1763343032.387493:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2432:x1848997993432320:12345-192.168.204.21@tcp:4:lfs.0 00010000:00010000:2.0:1763343032.387509:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.387538:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae4f53 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8aad expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.387538:0:24021:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4f4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.387561:0:24021:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae4d31 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89e9 expref: 34 pid: 28993 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1763343032.387568:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x283:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343032.387569:0:24021:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.387572:0:24021:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.387576:0:24021:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4f4c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.387584:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.387586:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.387595:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae4f53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aad expref: 35 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.387612:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae4f53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aad expref: 35 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.387644:0:24021:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae4d31 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89e9 expref: 35 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343032.387650:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6800, rc 0) 00010000:00010000:0.0:1763343032.387669:0:24021:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae4d31 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89e9 expref: 35 pid: 28993 timeout: 1326 lvb_type: 1 00000100:00100000:0.0:1763343032.387685:0:24021:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:24021:1848998010226304:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343032.387724:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+35:55941:x1848997993432448:12345-192.168.204.21@tcp:101:bash.0 Request processed in 232us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.387731:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6272 00000100:00100000:0.0:1763343032.387751:0:24021:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34039e33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343032.392942:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.393086:0:24021:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:24021:1848998010226304:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343032.393127:0:24021:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4f4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343032.393466:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993432576 00000100:00100000:2.0:1763343032.393476:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993432576 00000100:00100000:2.0:1763343032.393556:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6273 00000100:00100000:2.0:1763343032.393567:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:55941:x1848997993432576:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343032.393588:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.393616:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae4f5a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ab4 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343032.393675:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x285:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1763343032.393722:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.394004:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993432704 00000100:00100000:3.0:1763343032.394008:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993432704 00010000:00010000:3.0:1763343032.394041:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae4d31 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89e9 expref: 35 pid: 28993 timeout: 1326 lvb_type: 1 00000100:00100000:3.0:1763343032.394093:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2952 00000100:00100000:3.0:1763343032.394102:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+35:2430:x1848997993432704:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343032.394119:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343032.394142:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae4d31 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89e9 expref: 35 pid: 28993 timeout: 1326 lvb_type: 1 00010000:00010000:3.0:1763343032.394155:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae4d31 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89e9 expref: 35 pid: 28993 timeout: 1326 lvb_type: 1 00010000:00010000:3.0:1763343032.394181:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae4d31 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89e9 expref: 35 pid: 28993 timeout: 1326 lvb_type: 1 00010000:00010000:3.0:1763343032.394201:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343032.394205:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343032.394210:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4f4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.394221:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4f4c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.394258:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343032.394283:0:24021:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4f4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.394293:0:24021:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4f4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343032.394333:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2430:x1848997993432704:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 231us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.394340:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2952 00010000:00010000:2.0:1763343032.394951:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.394957:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.394967:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae4f5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ab4 expref: 19 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.394994:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae4f5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ab4 expref: 19 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.395007:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7200, rc 0) 00000100:00100000:2.0:1763343032.395051:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:55941:x1848997993432576:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1486us (2126us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.395059:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6273 00000001:00080000:1.0:1763343032.403233:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838783 is committed 00000001:00080000:1.0:1763343032.403263:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838782 is committed 00000100:00100000:0.0:1763343032.403557:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.403598:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00002000:00010000:3.0:1763343032.403753:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1763343032.403758:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb mtime from disk: 0 -> 1763343032 00002000:00010000:3.0:1763343032.403761:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb ctime from disk: 0 -> 1763343032 00002000:00010000:3.0:1763343032.403764:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763343032.403780:0:24021:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4f4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.403793:0:24021:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4f4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.403803:0:24021:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4f4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.403809:0:24021:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343032.403814:0:24021:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4f4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.403823:0:24021:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4f4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.403849:0:24021:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4f4c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.403857:0:24021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae4f4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343032.403955:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993432832 00000100:00100000:3.0:1763343032.403959:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2432:x1848997993432320:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 16468us (17064us total) trans 21474838783 rc 0/0 00000100:00100000:2.0:1763343032.403966:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993432832 00000100:00100000:3.0:1763343032.403968:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1543 00000100:00100000:3.0:1763343032.404008:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993432960 00000100:00100000:3.0:1763343032.404011:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993432960 00002000:00010000:2.0:1763343032.404024:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/643 (0->18446744073709551615) 00002000:00010000:3.0:1763343032.404026:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/645 (0->18446744073709551615) 00002000:00100000:3.0:1763343032.404029:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3404ba5c00 with x1848997993432960 ext(0->18446744073709551615) 00002000:00100000:2.0:1763343032.404029:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3404ba7800 with x1848997993432832 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343032.404039:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3404ba5c00. 00002000:00010000:2.0:1763343032.404039:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3404ba7800. 00000100:00100000:2.0:1763343032.404068:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1544 00000100:00100000:2.0:1763343032.404080:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2429:x1848997993432832:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343032.404320:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x283:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343032.404324:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x283:0x0] updating lvb mtime from disk: 0 -> 1763343032 00002000:00010000:2.0:1763343032.404326:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x283:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343032.404328:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x283:0x0] updating lvb ctime from disk: 0 -> 1763343032 00002000:00010000:2.0:1763343032.404330:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x283:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343032.404359:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993432832:12345-192.168.204.21@tcp:10:bash.0 Request processed in 282us (809us total) trans 21474838784 rc 0/0 00000100:00100000:2.0:1763343032.404366:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1544 00002000:00010000:2.0:1763343032.404370:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/643 (0->18446744073709551615) 00002000:00100000:2.0:1763343032.404389:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3404ba7800 with x1848997993432832 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343032.404394:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3404ba7800. 00000100:00100000:2.0:1763343032.404409:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1545 00000100:00100000:2.0:1763343032.404416:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993432960:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343032.404512:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x285:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343032.404515:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x285:0x0] updating lvb mtime from disk: 0 -> 1763343032 00002000:00010000:2.0:1763343032.404517:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x285:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343032.404519:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x285:0x0] updating lvb ctime from disk: 0 -> 1763343032 00002000:00010000:2.0:1763343032.404521:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x285:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343032.404558:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993432960:12345-192.168.204.21@tcp:10:bash.0 Request processed in 142us (959us total) trans 17179871485 rc 0/0 00000100:00100000:2.0:1763343032.404565:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1545 00002000:00010000:2.0:1763343032.404569:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/645 (0->18446744073709551615) 00002000:00100000:2.0:1763343032.404571:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3404ba5c00 with x1848997993432960 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343032.404576:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3404ba5c00. 00000100:00100000:0.0:1763343032.411421:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.413264:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993433216 00000100:00100000:2.0:1763343032.413290:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993433216 00000100:00100000:2.0:1763343032.413381:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3053 00000100:00100000:2.0:1763343032.413393:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:55941:x1848997993433216:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:2.0:1763343032.416678:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:55941:x1848997993433216:12345-192.168.204.21@tcp:35:bash.0 Request processed in 3266us (5253us total) trans 8589939681 rc 0/0 00000100:00100000:2.0:1763343032.416697:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3053 00000100:00100000:0.0:1763343032.422381:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.423460:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993433472 00000100:00100000:3.0:1763343032.423478:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993433472 00000100:00100000:2.0:1763343032.424331:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8990 00000100:00100000:2.0:1763343032.424345:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56824:x1848997993433472:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:2.0:1763343032.424679:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343032.424719:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae4ea4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a67 expref: 233 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.424745:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:2.0:1763343032.424752:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343032.424842:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4f61 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.424860:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4f61 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.424873:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4f61 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00010000:2.0:1763343032.425055:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000043273a97 reply state 00000000afede90f transno 8589939682 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4f61 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.425070:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4f61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.425076:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:2.0:1763343032.425078:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343032.425081:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343032.425204:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56824:x1848997993433472:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 860us (2839us total) trans 8589939682 rc 0/0 00000100:00100000:2.0:1763343032.425213:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8990 00000100:00100000:0.0:1763343032.426998:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.427114:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993433600 00000100:00100000:2.0:1763343032.427127:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993433600 00000100:00100000:2.0:1763343032.427237:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8991 00000100:00100000:2.0:1763343032.427249:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56827:x1848997993433600:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:2.0:1763343032.427291:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.427321:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae4f68 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8abb expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.427413:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae4f6f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427429:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae4f6f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427443:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae4f6f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427464:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f76 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427471:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427477:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427575:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae4f7d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427586:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae4f7d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427593:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae4f7d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343032.427663:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c7:0x0]: returning size 5 00000004:00200000:2.0:1763343032.427669:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343032.427693:0:10042:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae4f7d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427708:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae4f7d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427719:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae4f6f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427726:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae4f6f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427732:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae4f6f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427739:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae4f6f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427745:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.427749:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae4f6f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427757:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae4f6f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427771:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7500) 00010000:00010000:2.0:1763343032.427774:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.427780:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae4f6f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427786:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae4f6f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427802:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427808:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f76 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427813:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427818:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.427821:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427827:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f76 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427835:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3538bf7200) 00010000:00010000:2.0:1763343032.427837:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.427840:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f76 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427845:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4f76 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.427880:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae4f68 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8abb expref: 236 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.427898:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae4f7d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8abb expref: 235 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.427905:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343032.427908:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343032.427911:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3406702600, rc 0) 00000100:00100000:2.0:1763343032.427989:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56827:x1848997993433600:12345-192.168.204.21@tcp:101:rm.0 Request processed in 742us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.427997:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8991 00000100:00100000:0.0:1763343032.428944:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.429033:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993433728 00000100:00100000:2.0:1763343032.429044:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993433728 00000100:00100000:1.0:1763343032.429864:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6274 00000100:00100000:1.0:1763343032.429882:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:56824:x1848997993433728:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.429904:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.429930:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176000/0x607405d401ae4f84 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ac2 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343032.429959:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x282:0x0] initial LVB size: 4096, mtime: 0x691a7ab8, atime: 0x0, ctime: 0x691a7ab8, blocks: 0x8 00010000:00010000:1.0:1763343032.430000:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.430003:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.430013:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176000/0x607405d401ae4f84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac2 expref: 13 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.430037:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176000/0x607405d401ae4f84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac2 expref: 13 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.430052:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00000100:00100000:1.0:1763343032.430126:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:56824:x1848997993433728:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 250us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.430134:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6274 00000100:00100000:0.0:1763343032.436743:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.436797:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.436946:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993434112 00000100:00100000:3.0:1763343032.436960:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993434112 00000100:00100000:3.0:1763343032.437066:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8992 00000100:00100000:3.0:1763343032.437078:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56827:x1848997993434112:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:3.0:1763343032.437156:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763343032.437193:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae4f30 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a9f expref: 235 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.437217:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae4f7d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8abb expref: 234 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.437237:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7e00/0x607405d401ae4f14 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a91 expref: 233 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.437249:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:3.0:1763343032.437264:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343032.437297:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4f8b lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.437313:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4f8b lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.437324:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4f8b lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.437336:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4f92 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.437343:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4f92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.437349:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4f92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.437459:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4f99 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.437466:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4f99 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.437472:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4f99 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000040:00080000:3.0:1763343032.437797:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1339, 64 off113712 00000040:00080000:3.0:1763343032.437822:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1340, 64 off113712 00000040:00080000:3.0:1763343032.437830:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1341, 64 off113776 00000040:00080000:3.0:1763343032.437837:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1340, 64 off113776 00010000:00010000:3.0:1763343032.437895:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fa0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.437904:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.437912:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.437920:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fa0 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.437927:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fa0 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.437932:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.437961:0:10042:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343032.437991:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4f99 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.437997:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4f99 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.438003:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4f99 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.438010:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.438015:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4f99 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.438021:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4f99 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.438030:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a350b53ad00) 00010000:00010000:3.0:1763343032.438033:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763343032.438036:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4f99 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.438042:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4f99 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.438185:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4f8b lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.438191:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4f8b lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.438197:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4f8b lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.438202:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4f8b lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.438206:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.438209:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4f8b lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.438214:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4f8b lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.438221:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53ac00) 00010000:00010000:3.0:1763343032.438224:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.438226:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4f8b lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.438231:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4f8b lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:3.0:1763343032.438244:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006d10cdb2 reply state 00000000cbadab8d transno 8589939683 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4f92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.438255:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4f92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.438260:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:3.0:1763343032.438263:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343032.438266:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343032.438358:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56827:x1848997993434112:12345-192.168.204.21@tcp:36:rm.0 Request processed in 1280us (1558us total) trans 8589939683 rc 0/0 00000100:00100000:3.0:1763343032.438367:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8992 00000100:00100000:2.0:1763343032.438509:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993433856 00000100:00100000:2.0:1763343032.438517:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993433856 00000100:00100000:2.0:1763343032.438569:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6275 00000100:00100000:2.0:1763343032.438577:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:56824:x1848997993433856:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343032.438591:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.438607:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3406702000/0x607405d401ae4fa7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ac9 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.438657:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae4d38 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89f0 expref: 21 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343032.438666:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.438668:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.438672:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3406702000/0x607405d401ae4fa7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac9 expref: 21 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.438708:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae4d38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89f0 expref: 21 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343032.438723:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae4d38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89f0 expref: 21 pid: 28993 timeout: 1326 lvb_type: 1 00000100:00100000:2.0:1763343032.438737:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010226432:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343032.438801:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a353c6e80c0 going to sleep for 11 seconds 00010000:00010000:0.0:1763343032.438934:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343032.438942:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fa0 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.438949:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343032.438953:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fa0 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.438959:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.438970:0:13198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c7:0x0].0x0 (ffff9a350b53ad00) 00010000:00010000:0.0:1763343032.438983:0:13198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343032.438986:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fa0 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.438992:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fa0 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1c7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.439006:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.439009:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.439011:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343032.444565:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.444729:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010226432:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343032.444777:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3406702000/0x607405d401ae4fa7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac9 expref: 21 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.444813:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3406702000, rc 0) 00000100:00100000:3.0:1763343032.445274:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993434240 00000100:00100000:3.0:1763343032.445285:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993434240 00010000:00010000:3.0:1763343032.445334:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae4d38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89f0 expref: 22 pid: 28993 timeout: 1326 lvb_type: 1 00000100:00100000:0.0:1763343032.446271:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:56824:x1848997993433856:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 7686us (9533us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.446284:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6275 00000100:00100000:1.0:1763343032.446739:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2953 00000100:00100000:1.0:1763343032.446757:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993434240:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343032.446779:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343032.446809:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae4d38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x284:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89f0 expref: 21 pid: 28993 timeout: 1326 lvb_type: 1 00010000:00010000:1.0:1763343032.446828:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae4d38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x284:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89f0 expref: 21 pid: 28993 timeout: 1326 lvb_type: 1 00010000:00010000:1.0:1763343032.446861:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae4d38 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x284:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac89f0 expref: 21 pid: 28993 timeout: 1326 lvb_type: 1 00010000:00010000:1.0:1763343032.446885:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.446887:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.446894:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3406702000/0x607405d401ae4fa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac9 expref: 20 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.446907:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3406702000/0x607405d401ae4fa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac9 expref: 20 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.446956:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a3406702000/0x607405d401ae4fa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac9 expref: 20 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343032.446985:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406649f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1848998010226560:192.168.204.21@tcp:105: 00000100:00100000:1.0:1763343032.447077:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340c767780 going to sleep for 11 seconds 00000100:00100000:1.0:1763343032.456836:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406649f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1848998010226560:192.168.204.21@tcp:105: 00000100:00100000:0.0:1763343032.456848:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.456887:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.456926:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.456959:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993434368 00000100:00100000:2.0:1763343032.456960:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993434496 00000100:00100000:2.0:1763343032.456967:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993434496 00000100:00100000:0.0:1763343032.456967:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993434368 00002000:00010000:2.0:1763343032.457030:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/642 (5->18446744073709551615) 00002000:00100000:2.0:1763343032.457035:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3404ba6300 with x1848997993434496 ext(5->18446744073709551615) 00000100:00100000:0.0:1763343032.457045:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8993 00002000:00010000:2.0:1763343032.457050:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3404ba6300. 00000100:00100000:0.0:1763343032.457055:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56828:x1848997993434368:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:2.0:1763343032.457066:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993434624 00000100:00100000:2.0:1763343032.457068:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993434624 00002000:00010000:2.0:1763343032.457079:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/644 (0->18446744073709551615) 00010000:00010000:0.0:1763343032.457079:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1763343032.457082:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3404ba7b80 with x1848997993434624 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343032.457088:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3404ba7b80. 00000100:00100000:2.0:1763343032.457104:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1546 00010000:00010000:0.0:1763343032.457107:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4fae lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ad0 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343032.457110:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993434496:12345-192.168.204.21@tcp:10:lfs.0 00010000:00010000:0.0:1763343032.457189:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4fb5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457207:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4fb5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457220:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4fb5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457231:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4fbc lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457238:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4fbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457243:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4fbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457300:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4fb5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457307:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4fb5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457313:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457320:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ca00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.457324:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457331:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4fb5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457344:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bf300) 00010000:00010000:0.0:1763343032.457348:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.457353:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4fb5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457359:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae4fb5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457372:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4fbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457377:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4fbc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457382:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4fbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457386:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.457389:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4fbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457394:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4fbc lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457400:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:0.0:1763343032.457402:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.457405:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4fbc lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457410:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae4fbc lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.457441:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4fae lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ad0 expref: 235 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.457451:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bf300) 00010000:00010000:0.0:1763343032.457454:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.457457:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4fae lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ad0 expref: 235 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.457471:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665ce00, rc 0) 00002000:00010000:2.0:1763343032.457486:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:2.0:1763343032.457489:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00002000:00010000:2.0:1763343032.457491:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343032.457494:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:2.0:1763343032.457496:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343032.457536:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1547 00000100:00100000:0.0:1763343032.457537:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56828:x1848997993434368:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 483us (610us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343032.457544:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8993 00000100:00100000:3.0:1763343032.457547:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993434624:12345-192.168.204.21@tcp:10:lfs.0 00010000:00010000:1.0:1763343032.457766:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343032.458047:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993434496:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 933us (1197us total) trans 21474838785 rc 0/0 00000100:00100000:1.0:1763343032.458047:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993434240:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 11295us (13498us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.458055:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1546 00000100:00100000:1.0:1763343032.458056:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2953 00002000:00010000:2.0:1763343032.458059:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/642 (5->18446744073709551615) 00002000:00100000:2.0:1763343032.458061:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3404ba6300 with x1848997993434496 ext(5->18446744073709551615) 00002000:00010000:2.0:1763343032.458067:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3404ba6300. 00002000:00010000:0.0:1763343032.458724:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343032.458730:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb mtime from disk: 0 -> 1763343032 00002000:00010000:0.0:1763343032.458732:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.458734:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb ctime from disk: 0 -> 1763343032 00002000:00010000:0.0:1763343032.458737:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343032.458781:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993434624:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 1235us (1891us total) trans 17179871486 rc 0/0 00000100:00100000:0.0:1763343032.458789:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1547 00002000:00010000:0.0:1763343032.458794:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/644 (0->18446744073709551615) 00002000:00100000:0.0:1763343032.458796:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3404ba7b80 with x1848997993434624 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343032.458802:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3404ba7b80. 00000100:00100000:0.0:1763343032.464167:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.464284:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993434752 00000100:00100000:3.0:1763343032.464297:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993434752 00000100:00100000:3.0:1763343032.464365:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8994 00000100:00100000:3.0:1763343032.464375:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56828:x1848997993434752:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343032.464402:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.464435:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4fc3 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ad7 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.464527:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4fca lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464544:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4fca lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464556:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4fca lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464566:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fd1 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464573:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464578:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464688:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4fca lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464695:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4fca lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464701:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4fca lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464706:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4fca lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464711:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.464715:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4fca lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464722:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4fca lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464740:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53ac00) 00010000:00010000:3.0:1763343032.464744:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.464748:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4fca lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464755:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae4fca lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464768:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464772:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464777:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464782:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.464785:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464790:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fd1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464795:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:3.0:1763343032.464797:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.464799:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fd1 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464803:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae4fd1 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.464829:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4fc3 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ad7 expref: 235 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.464840:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53ac00) 00010000:00010000:3.0:1763343032.464842:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.464845:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae4fc3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ad7 expref: 235 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.464856:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343032.464933:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56828:x1848997993434752:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 559us (779us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343032.464940:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8994 00000100:00100000:1.0:1763343032.467565:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.467938:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993435008 00000100:00100000:0.0:1763343032.467954:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993435008 00000100:00100000:0.0:1763343032.468038:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8995 00000100:00100000:0.0:1763343032.468050:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56824:x1848997993435008:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343032.468170:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4fd8 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.468191:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.468204:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343032.468371:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002bde3361 reply state 000000002db3b325 transno 8589939684 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.468386:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4fd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.468395:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:0.0:1763343032.468399:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343032.468404:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343032.468532:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56824:x1848997993435008:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 484us (981us total) trans 8589939684 rc 0/0 00000100:00100000:0.0:1763343032.468540:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8995 00000100:00100000:1.0:1763343032.468908:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.468981:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993435136 00000100:00100000:3.0:1763343032.468988:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993435136 00000100:00100000:3.0:1763343032.469032:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8996 00000100:00100000:3.0:1763343032.469041:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56828:x1848997993435136:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343032.469222:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.469244:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4fdf lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ade expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.469352:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4fe6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.469362:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.469373:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343032.469415:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343032.469421:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343032.469457:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae4fdf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ade expref: 238 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.469480:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ade expref: 237 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.469487:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53a000) 00010000:00010000:3.0:1763343032.469490:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343032.469493:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343032.469544:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56828:x1848997993435136:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 505us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.469551:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8996 00000100:00100000:2.0:1763343032.470468:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.470560:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993435264 00000100:00100000:0.0:1763343032.470569:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993435264 00000100:00100000:3.0:1763343032.470862:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6276 00000100:00100000:3.0:1763343032.470873:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993435264:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:3.0:1763343032.471070:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343032.471074:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00002000:00010000:3.0:1763343032.471076:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb atime from disk: 0 -> 1763343032 00002000:00010000:3.0:1763343032.471079:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:3.0:1763343032.471081:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343032.471141:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993435264:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 270us (678us total) trans 17179871487 rc 0/0 00000100:00100000:3.0:1763343032.471147:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6276 00000100:00100000:1.0:1763343032.474315:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.474424:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.474503:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993435648 00000100:00100000:3.0:1763343032.474517:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993435648 00000100:00100000:3.0:1763343032.474594:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8997 00000100:00100000:3.0:1763343032.474605:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56828:x1848997993435648:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:2.0:1763343032.474810:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993435520 00000100:00100000:2.0:1763343032.474815:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993435520 00000100:00100000:2.0:1763343032.474852:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3054 00000100:00100000:2.0:1763343032.474860:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56824:x1848997993435520:12345-192.168.204.21@tcp:35:lfs.0 00010000:00010000:1.0:1763343032.475148:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.475179:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4fed lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ae5 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1763343032.475582:0:14879:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1c6:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4e2d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a44 expref: 239 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.475665:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.475680:0:14879:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4e73 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a59 expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.475693:0:14879:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.475734:0:14879:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4e73 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a59 expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.475749:0:14879:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4e73 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a59 expref: 239 pid: 10042 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343032.475766:0:14879:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010226688:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343032.475875:0:14879:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a353c6e80c0 going to sleep for 11 seconds 00010000:00010000:1.0:1763343032.475969:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4ff4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.475990:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476002:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476021:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5002 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476028:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5002 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476034:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5002 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476091:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4ff4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476099:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4ff4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476105:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476112:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4ff4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476118:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.476123:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4ff4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476130:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4ff4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476141:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53a000) 00010000:00010000:1.0:1763343032.476144:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.476149:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4ff4 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476156:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae4ff4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476174:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5002 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476180:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5002 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476185:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5002 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476190:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.476193:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5002 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476199:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5002 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476206:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:1.0:1763343032.476209:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.476212:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5002 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476222:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5002 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.476255:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4fed lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ae5 expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.476275:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53a000) 00010000:00010000:1.0:1763343032.476277:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.476281:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae4fed lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ae5 expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.476297:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176e00, rc 0) 00000100:00100000:1.0:1763343032.476343:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56828:x1848997993435648:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1740us (1919us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343032.476353:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8997 00000100:00100000:2.0:1763343032.478831:0:14879:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010226688:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343032.478872:0:14879:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00000100:00100000:1.0:1763343032.480180:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.480402:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993435776 00000100:00100000:3.0:1763343032.480417:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993435776 00000100:00100000:2.0:1763343032.480433:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343032.480471:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4e73 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a59 expref: 238 pid: 10042 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343032.480502:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993436032 00000100:00100000:1.0:1763343032.480507:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993436032 00000100:00100000:3.0:1763343032.480527:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2954 00000100:00100000:3.0:1763343032.480538:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:2430:x1848997993435776:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343032.480558:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343032.480566:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4e73 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a59 expref: 239 pid: 10042 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343032.480580:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4e73 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a59 expref: 239 pid: 10042 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343032.480610:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae4e73 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a59 expref: 239 pid: 10042 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343032.480658:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:3.0:1763343032.480664:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343032.480678:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343032.480686:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343032.480719:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343032.480781:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8998 00000100:00100000:3.0:1763343032.480785:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:2430:x1848997993435776:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 249us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.480790:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56828:x1848997993436032:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:3.0:1763343032.480794:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2954 00010000:00010000:1.0:1763343032.480812:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.480815:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343032.480829:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae4fe6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ade expref: 237 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.480841:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53a000) 00010000:00010000:1.0:1763343032.480853:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343032.480873:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5009 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8aec expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.481025:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5010 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.481038:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5010 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.481047:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5010 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.481063:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5017 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.481070:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5017 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.481076:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5017 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.481947:0:14879:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.481961:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00000040:00080000:2.0:1763343032.482451:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1342, 88 off113864 00000004:00080000:2.0:1763343032.482463:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226149841490ns, next at 1226132529377ns, rc = 0 00000040:00080000:2.0:1763343032.482505:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1341, 88 off113864 00000004:00080000:2.0:1763343032.482511:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226149889835ns, next at 1226132560989ns, rc = 0 00000040:00080000:2.0:1763343032.482543:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1342, 88 off113952 00000004:00080000:2.0:1763343032.482549:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226149927820ns, next at 1226132560989ns, rc = 0 00000040:00080000:2.0:1763343032.482560:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1343, 88 off113952 00000004:00080000:2.0:1763343032.482564:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226149943133ns, next at 1226132529377ns, rc = 0 00010000:00010000:1.0:1763343032.485120:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae501e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.485152:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae501e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.485167:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae501e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343032.485183:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c9:0x0]: returning size 0 00010000:00010000:1.0:1763343032.485219:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5010 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.485227:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5010 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.485234:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5010 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.485246:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5010 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.485253:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.485258:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5010 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.485268:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5010 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.485283:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde800) 00010000:00010000:1.0:1763343032.485286:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.485292:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5010 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.485298:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5010 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:1.0:1763343032.485316:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dc049ae0 reply state 0000000058caec24 transno 8589939686 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5017 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.485328:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5017 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.485334:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:1.0:1763343032.485336:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343032.485340:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343032.485385:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5009 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aec expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.485407:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae501e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aec expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.485466:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bdeb00) 00010000:00010000:1.0:1763343032.485468:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343032.485471:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176e00, rc 0) 00000100:00100000:1.0:1763343032.485576:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56828:x1848997993436032:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4785us (5140us total) trans 8589939686 rc 0/0 00000100:00100000:1.0:1763343032.485589:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8998 00000001:00080000:2.0:1763343032.487371:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939685 is committed 00000004:00080000:2.0:1763343032.487386:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 885 committed 00000004:00080000:2.0:1763343032.487403:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 886 committed 00000004:00080000:2.0:1763343032.487416:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 885 committed 00000004:00080000:2.0:1763343032.487419:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 884 committed 00000004:00010000:2.0:1763343032.487496:0:14879:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d441a5f1 reply state 00000000a02c75e1 transno 8589939685 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.487521:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.487531:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:2.0:1763343032.487534:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1763343032.487538:0:14879:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343032.487548:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:2.0:1763343032.487550:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343032.487560:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae4e2d lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a44 expref: 234 pid: 10041 timeout: 0 lvb_type: 0 00010000:00080000:2.0:1763343032.487727:0:14879:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1763343032.487746:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56824:x1848997993435520:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 12886us (13446us total) trans 8589939685 rc 0/0 00000100:00100000:2.0:1763343032.487757:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3054 00010000:00010000:2.0:1763343032.487796:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.487805:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.487813:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.487819:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.487824:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.487833:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.487843:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:2.0:1763343032.487846:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343032.487849:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.487855:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae4ffb lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00000100:00100000:3.0:1763343032.488463:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010227200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343032.488527:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343032.488562:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343032.488567:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010226816:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343032.488588:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343032.488617:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010227200 00000100:00100000:3.0:1763343032.488654:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010227200 00000100:00100000:3.0:1763343032.488697:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010226816 00000100:00100000:3.0:1763343032.488699:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010226816 00000100:00100000:3.0:1763343032.488716:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6277 00000100:00100000:3.0:1763343032.488724:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3657:x1848998010227200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343032.488905:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343032.488909:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00002000:00010000:3.0:1763343032.488912:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343032.488915:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:3.0:1763343032.488917:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x284:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343032.488949:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3657:x1848998010227200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 225us (421us total) trans 17179871488 rc 0/0 00000100:00100000:3.0:1763343032.488955:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6277 00000100:00100000:3.0:1763343032.488969:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6278 00000100:00100000:3.0:1763343032.488985:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3657:x1848998010226816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343032.489000:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:645 count 1 00010000:00010000:3.0:1763343032.489021:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae502c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.489041:0:28993:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae4f5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ab4 expref: 21 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.489055:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343032.489058:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343032.489062:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae502c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.489091:0:28993:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae4f5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ab4 expref: 21 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.489105:0:28993:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae4f5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ab4 expref: 21 pid: 27835 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1763343032.489117:0:28993:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:28993:1848998010227328:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343032.489172:0:28993:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c300 going to sleep for 11 seconds 00000004:00080000:3.0:1763343032.489213:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478e300/2, rc 0, transno 17179871488 00000100:00100000:3.0:1763343032.489218:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010227200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.489413:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010226944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.489449:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.489485:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343032.489491:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010227072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.489512:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.489541:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010226944 00000100:00100000:0.0:1763343032.489545:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010226944 00000100:00100000:0.0:1763343032.489569:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010227072 00000100:00100000:0.0:1763343032.489571:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010227072 00000100:00100000:0.0:1763343032.489586:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6279 00000100:00100000:0.0:1763343032.489591:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3659:x1848998010226944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343032.489605:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:646 count 1 00002000:00010000:0.0:1763343032.489666:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x286:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343032.489672:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5033 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.489682:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.489684:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.489689:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5033 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.489703:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5033 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.489712:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5033 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.489720:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.489737:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343032.489954:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3659:x1848998010226944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 361us (503us total) trans 17179871489 rc 0/0 00000100:00100000:0.0:1763343032.489961:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6279 00000100:00100000:0.0:1763343032.489987:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6280 00000100:00100000:0.0:1763343032.489994:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3659:x1848998010227072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343032.490059:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343032.490062:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343032.490065:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb atime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343032.490068:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343032.490070:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x283:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343032.490091:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3659:x1848998010227072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (578us total) trans 17179871490 rc 0/0 00000100:00100000:0.0:1763343032.490097:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6280 00010000:00010000:0.0:1763343032.490130:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343032.490137:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.490146:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343032.490151:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.490161:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5033 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.490178:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5033 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.490186:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5033 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.490203:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.490205:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.490207:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343032.490288:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010227712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.490320:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.490340:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763343032.490345:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010227584:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.490360:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.490378:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010227712 00000100:00100000:0.0:1763343032.490383:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010227712 00000100:00100000:0.0:1763343032.490406:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010227584 00000100:00100000:0.0:1763343032.490408:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010227584 00000100:00100000:0.0:1763343032.490420:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6281 00000100:00100000:0.0:1763343032.490424:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3660:x1848998010227712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343032.490502:0:28648:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x281:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343032.490505:0:28648:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x281:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343032.490508:0:28648:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x281:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.490510:0:28648:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x281:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343032.490512:0:28648:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x281:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343032.490536:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3660:x1848998010227712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (216us total) trans 21474838786 rc 0/0 00000100:00100000:0.0:1763343032.490542:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6281 00000100:00100000:0.0:1763343032.490553:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6282 00000100:00100000:0.0:1763343032.490558:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3660:x1848998010227584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343032.490568:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:644 count 1 00002000:00010000:0.0:1763343032.490586:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x284:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343032.490591:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae503a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.490601:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.490603:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.490607:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae503a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.490617:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae503a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.490660:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae503a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.490668:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae503a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.490681:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343032.490801:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3660:x1848998010227584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 242us (438us total) trans 21474838787 rc 0/0 00000100:00100000:0.0:1763343032.490806:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6282 00000100:00100000:0.0:1763343032.490845:0:3660:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838782 gen 2 00000004:00080000:0.0:1763343032.490872:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad2d80, transno 21474838709 00000004:00080000:0.0:1763343032.490879:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406648380, transno 21474838710 00000004:00080000:0.0:1763343032.490882:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406648000, transno 21474838711 00000004:00080000:0.0:1763343032.490885:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406648e00, transno 21474838712 00000004:00080000:0.0:1763343032.490888:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537b0d180, transno 21474838713 00000004:00080000:0.0:1763343032.490891:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478ed80, transno 21474838714 00000004:00080000:0.0:1763343032.490895:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c71500, transno 21474838715 00000004:00080000:0.0:1763343032.490898:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c72a00, transno 21474838716 00000004:00080000:0.0:1763343032.490902:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b9880, transno 21474838718 00000004:00080000:0.0:1763343032.490904:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095bad80, transno 21474838719 00000004:00080000:0.0:1763343032.490908:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b9f80, transno 21474838720 00000004:00080000:0.0:1763343032.490910:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095bb480, transno 21474838721 00000004:00080000:0.0:1763343032.490913:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537968380, transno 21474838724 00000004:00080000:0.0:1763343032.490916:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b5f80, transno 21474838725 00000004:00080000:0.0:1763343032.490918:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a350121aa00, transno 21474838726 00000004:00080000:0.0:1763343032.490921:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a6d80, transno 21474838727 00000004:00080000:0.0:1763343032.490924:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b93b80, transno 21474838731 00000004:00080000:0.0:1763343032.490927:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b90000, transno 21474838732 00000004:00080000:0.0:1763343032.490929:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b93800, transno 21474838733 00000004:00080000:0.0:1763343032.490932:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b90380, transno 21474838734 00000004:00080000:0.0:1763343032.490934:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c253480, transno 21474838735 00000004:00080000:0.0:1763343032.490937:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c252300, transno 21474838736 00000004:00080000:0.0:1763343032.490940:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c251c00, transno 21474838737 00000004:00080000:0.0:1763343032.490942:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c251500, transno 21474838738 00000004:00080000:0.0:1763343032.490944:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d4e00, transno 21474838741 00000004:00080000:0.0:1763343032.490947:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b5880, transno 21474838742 00000004:00080000:0.0:1763343032.490950:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a354134e300, transno 21474838743 00000004:00080000:0.0:1763343032.490953:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a354134df80, transno 21474838744 00000004:00080000:0.0:1763343032.490955:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d13bb80, transno 21474838748 00000004:00080000:0.0:1763343032.490958:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d139180, transno 21474838749 00000004:00080000:0.0:1763343032.490961:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d139f80, transno 21474838750 00000004:00080000:0.0:1763343032.490963:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d139c00, transno 21474838751 00000004:00080000:0.0:1763343032.490966:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c250380, transno 21474838752 00000004:00080000:0.0:1763343032.490969:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b91180, transno 21474838753 00000004:00080000:0.0:1763343032.490986:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406ab1880, transno 21474838754 00000004:00080000:0.0:1763343032.490989:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406ab0000, transno 21474838755 00000004:00080000:0.0:1763343032.490992:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34060a8000, transno 21474838758 00000004:00080000:0.0:1763343032.490995:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34060abb80, transno 21474838759 00000004:00080000:0.0:1763343032.490998:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad6a00, transno 21474838760 00000004:00080000:0.0:1763343032.491001:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad7480, transno 21474838761 00000004:00080000:0.0:1763343032.491003:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad4700, transno 21474838765 00000004:00080000:0.0:1763343032.491006:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad6300, transno 21474838766 00000004:00080000:0.0:1763343032.491008:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad6d80, transno 21474838767 00000004:00080000:0.0:1763343032.491011:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad5500, transno 21474838768 00000004:00080000:0.0:1763343032.491013:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d4a80, transno 21474838769 00000004:00080000:0.0:1763343032.491016:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d5880, transno 21474838770 00000004:00080000:0.0:1763343032.491018:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d4700, transno 21474838771 00000004:00080000:0.0:1763343032.491021:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d7b80, transno 21474838772 00000004:00080000:0.0:1763343032.491023:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052afb80, transno 21474838774 00000004:00080000:0.0:1763343032.491026:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052ac700, transno 21474838775 00000004:00080000:0.0:1763343032.491028:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052ae680, transno 21474838776 00000004:00080000:0.0:1763343032.491031:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052ae300, transno 21474838777 00000004:00080000:0.0:1763343032.491033:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b91f80, transno 21474838779 00000004:00080000:0.0:1763343032.491036:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b91c00, transno 21474838780 00000004:00080000:0.0:1763343032.491038:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478c700, transno 21474838781 00000004:00080000:0.0:1763343032.491041:0:3660:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478e680, transno 21474838782 00000100:00100000:0.0:1763343032.491047:0:3660:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a3406553800 x1848998010227584/t21474838787(21474838787) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763343048 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763343032.491058:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406553800/2, rc 0, transno 21474838787 00000100:00100000:0.0:1763343032.491062:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010227584:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1763343032.491073:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406551c00/2, rc 0, transno 21474838786 00000100:00100000:0.0:1763343032.491076:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010227712:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343032.491358:0:32355:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 4 in progress, 2 in flight, 56 done 00000004:00080000:0.0:1763343032.491387:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478c000/2, rc 0, transno 17179871490 00000100:00100000:0.0:1763343032.491392:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010227072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343032.491404:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478ca80/2, rc 0, transno 17179871489 00000100:00100000:0.0:1763343032.491407:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010226944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.491425:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010227840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.491460:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.491483:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343032.491488:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010227456:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.491503:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.491524:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010227840 00000100:00100000:0.0:1763343032.491530:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010227840 00000100:00100000:0.0:1763343032.491551:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010227456 00000100:00100000:0.0:1763343032.491554:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010227456 00000100:00100000:0.0:1763343032.491568:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6283 00000100:00100000:0.0:1763343032.491574:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3657:x1848998010227840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343032.491688:0:8408:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343032.491691:0:8408:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343032.491694:0:8408:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.491697:0:8408:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343032.491699:0:8408:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x282:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343032.491728:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010227840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 153us (268us total) trans 21474838788 rc 0/0 00000100:00100000:0.0:1763343032.491734:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6283 00000100:00100000:0.0:1763343032.491746:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6284 00000100:00100000:0.0:1763343032.491752:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3657:x1848998010227456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343032.491762:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:643 count 1 00010000:00010000:0.0:1763343032.491778:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5041 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.491798:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae4f53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aad expref: 13 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.491807:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343032.491809:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343032.491812:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5041 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.491843:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae4f53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aad expref: 13 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.491854:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae4f53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aad expref: 13 pid: 27835 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343032.491866:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406551180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1848998010227968:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343032.491920:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34039e33c0 going to sleep for 11 seconds 00000004:00080000:0.0:1763343032.491944:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406552a00/2, rc 0, transno 21474838788 00000100:00100000:0.0:1763343032.491948:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010227840:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343032.492111:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4f61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.492121:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4f61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.492128:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4f61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.492135:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.492139:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4f61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.492146:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4f61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.492164:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:1.0:1763343032.492167:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.492171:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4f61 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.492177:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae4f61 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.492194:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4f92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.492199:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4f92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.492204:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4f92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.492214:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.492217:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4f92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.492223:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4f92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.492231:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:1.0:1763343032.492233:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.492236:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4f92 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.492241:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae4f92 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.492254:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4fd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.492260:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4fd8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.492265:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4fd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.492270:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.492273:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4fd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.492279:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4fd8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.492287:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:1.0:1763343032.492291:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.492294:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4fd8 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.492300:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae4fd8 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.493232:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343032.493247:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae503a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.493258:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343032.493263:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae503a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.493272:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae503a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.493296:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae503a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.493303:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665dc00/0x607405d401ae503a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.493327:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343032.493329:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343032.493331:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343032.493961:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.494296:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993436288 00000100:00100000:1.0:1763343032.494307:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993436288 00000100:00100000:1.0:1763343032.494384:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8999 00000100:00100000:1.0:1763343032.494395:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56828:x1848997993436288:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.494422:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.494446:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5048 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8af3 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.494590:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae504f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.494608:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae501e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aec expref: 231 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.494653:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae504f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.494698:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae501e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aec expref: 231 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.494711:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae501e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aec expref: 231 pid: 10042 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343032.494726:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406648380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010228096:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343032.494822:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe300 going to sleep for 11 seconds 00000100:00100000:3.0:1763343032.496595:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.500351:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993436416 00000100:00100000:2.0:1763343032.500372:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993436416 00000100:00100000:2.0:1763343032.500471:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9000 00000100:00100000:2.0:1763343032.500483:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56824:x1848997993436416:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343032.500516:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.500545:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7e00/0x607405d401ae5056 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8afa expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.500663:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7e00/0x607405d401ae5056 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8afa expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.500680:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7e00/0x607405d401ae5056 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8afa expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.500702:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:2.0:1763343032.500706:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343032.500711:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7e00, rc 0) 00000100:00100000:2.0:1763343032.500794:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56824:x1848997993436416:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 313us (4210us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.500802:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9000 00000100:00100000:2.0:1763343032.501085:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406551180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1848998010227968:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343032.501118:0:8408:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5041 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343032.501158:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.501184:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.501206:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993436544 00000100:00100000:2.0:1763343032.501211:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993436544 00010000:00010000:2.0:1763343032.501237:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae4f5a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ab4 expref: 22 pid: 27835 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343032.501275:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993436672 00000100:00100000:2.0:1763343032.501278:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993436672 00010000:00010000:2.0:1763343032.501293:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae4f53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aad expref: 14 pid: 27835 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343032.501314:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2955 00000100:00100000:2.0:1763343032.501322:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993436544:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343032.501335:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343032.501341:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae4f5a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ab4 expref: 22 pid: 27835 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.501354:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae4f5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ab4 expref: 22 pid: 27835 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.501384:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.501386:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.501392:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae502c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.501403:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae502c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.501423:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343032.501452:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993436544:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 131us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.501461:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2955 00000100:00100000:2.0:1763343032.501475:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2956 00000100:00100000:2.0:1763343032.501482:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993436672:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343032.501491:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343032.501497:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae4f53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aad expref: 14 pid: 27835 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.501507:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae4f53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aad expref: 14 pid: 27835 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.501522:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae4f53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aad expref: 14 pid: 27835 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.501537:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.501539:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.501542:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.501549:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5041 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.501565:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343032.501584:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993436672:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 102us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.501591:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2956 00010000:00010000:2.0:1763343032.501684:0:8408:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.501694:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.501705:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5041 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.501713:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5041 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.501732:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343032.502032:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010227456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10278us (10526us total) trans 21474838789 rc 0/0 00000100:00100000:2.0:1763343032.502041:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6284 00010000:00010000:2.0:1763343032.502065:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343032.502073:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5041 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.502081:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343032.502085:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5041 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.502095:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5041 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.502108:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5041 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.502120:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5041 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343032.502132:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:2.0:1763343032.502139:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343032.502141:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343032.502143:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763343032.502178:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406552d80/2, rc 0, transno 21474838789 00000100:00100000:0.0:1763343032.502182:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.502185:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010227456:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343032.502207:0:32345:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993436800 00000100:00100000:2.0:1763343032.502211:0:32345:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993436800 00000100:00100000:0.0:1763343032.502239:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.502242:0:32345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 151 00000100:00100000:2.0:1763343032.502249:0:32345:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b3ae62-6386-4093-b1cf-f8b7be7393a5+9:2432:x1848997993436800:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:0.0:1763343032.502280:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993436928 00000100:00100000:0.0:1763343032.502284:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993436928 00000100:00100000:2.0:1763343032.502285:0:32345:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b3ae62-6386-4093-b1cf-f8b7be7393a5+9:2432:x1848997993436800:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.502292:0:32345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 151 00000100:00100000:2.0:1763343032.502315:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993437056 00000100:00100000:2.0:1763343032.502319:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993437056 00000100:00100000:0.0:1763343032.502329:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1466 00010000:00010000:2.0:1763343032.502336:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae501e lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aec expref: 233 pid: 10042 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343032.502336:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2432:x1848997993436928:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1763343032.502355:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2957 00000100:00100000:2.0:1763343032.502360:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:2430:x1848997993437056:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343032.502369:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343032.502375:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae501e lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aec expref: 233 pid: 10042 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343032.502377:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2432:x1848997993436928:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 43us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.502384:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1466 00010000:00010000:2.0:1763343032.502392:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae501e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aec expref: 233 pid: 10042 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.502408:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bdeb00) 00010000:00010000:2.0:1763343032.502414:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae504f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.502423:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae504f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.502429:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae504f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.502442:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343032.502460:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:2430:x1848997993437056:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 99us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.502466:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2957 00000100:00080000:3.0:1763343032.503782:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1763343032.503840:0:28993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae4f5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ab4 expref: 21 pid: 27835 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1763343032.503840:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae501e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8aec expref: 232 pid: 10042 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1763343032.503859:0:28993:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:28993:1848998010227328:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343032.503860:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406648380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010228096:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343032.503881:0:28993:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae502c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.503881:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae504f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.503891:0:28993:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae502c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.503891:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae504f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.503897:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae504f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343032.503898:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae502c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.503907:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae502c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.503915:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae502c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1763343032.503926:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c9:0x0]: returning size 0 00000004:00080000:1.0:1763343032.504149:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x287:0x0], index 1: 0 00000004:00080000:1.0:1763343032.504156:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x285:0x0], index 0: 0 00000004:00080000:1.0:1763343032.504160:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x286:0x0], index 0: 0 00000004:00080000:1.0:1763343032.504164:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x288:0x0], index 1: 0 00010000:00010000:1.0:1763343032.504285:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae504f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.504298:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae504f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.504304:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae504f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.504310:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.504315:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae504f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.504326:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae504f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.504345:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bdeb00) 00010000:00010000:1.0:1763343032.504347:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343032.504351:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae504f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.504357:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae504f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.504413:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5048 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8af3 expref: 232 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.504424:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bdeb00) 00010000:00010000:1.0:1763343032.504426:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343032.504430:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5048 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8af3 expref: 232 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.504445:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:1.0:1763343032.504534:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56828:x1848997993436288:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 10140us (10579us total) trans 8589939687 rc 301/301 00000100:00100000:1.0:1763343032.504542:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8999 00010000:00010000:0.0:1763343032.506214:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343032.506231:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae502c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.506245:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343032.506250:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae502c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.506261:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae502c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.506299:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae502c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.506309:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.506311:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.506313:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343032.507258:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1763343032.507272:0:28993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae502c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343032.507923:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3657:x1848998010226816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18926us (19322us total) trans 17179871491 rc 0/0 00000100:00100000:0.0:1763343032.507936:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6278 00000004:00080000:2.0:1763343032.508231:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478fb80/2, rc 0, transno 17179871491 00000100:00100000:2.0:1763343032.508240:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010226816:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343032.508959:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.509060:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993437312 00000100:00100000:0.0:1763343032.509070:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993437312 00000100:00100000:0.0:1763343032.509198:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3055 00000100:00100000:0.0:1763343032.509211:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56828:x1848997993437312:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343032.509428:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.509464:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993437568 00000100:00100000:3.0:1763343032.509470:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993437568 00000100:00100000:3.0:1763343032.509509:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3056 00000100:00100000:3.0:1763343032.509518:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56824:x1848997993437568:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:2.0:1763343032.509899:0:6526:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1c6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763343032.509985:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1344, 64 off114016 00000004:00080000:2.0:1763343032.509994:0:6526:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226177372312ns, next at 1227177369372ns, rc = 0 00000100:00100000:0.0:1763343032.510003:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56828:x1848997993437312:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 795us (1048us total) trans 8589939688 rc 0/0 00000100:00100000:0.0:1763343032.510011:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3055 00000040:00080000:2.0:1763343032.510020:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1343, 64 off114016 00000004:00080000:2.0:1763343032.510024:0:6526:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226177403011ns, next at 1227177401661ns, rc = 0 00000040:00080000:2.0:1763343032.510034:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1344, 64 off114080 00000040:00080000:2.0:1763343032.510044:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1345, 64 off114080 00010000:00010000:2.0:1763343032.510095:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5064 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343032.510116:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5064 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343032.510130:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5064 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343032.510140:0:6526:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5064 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343032.510146:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5064 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343032.510151:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5064 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343032.510174:0:6526:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343032.510204:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343032.510212:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5064 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343032.510218:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343032.510223:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5064 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343032.510231:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5064 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343032.510245:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c6:0x0].0x0 (ffff9a3538bf7f00) 00010000:00010000:0.0:1763343032.510249:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343032.510256:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5064 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343032.510281:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5064 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1c6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343032.510293:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.510295:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.510296:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343032.510344:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56824:x1848997993437568:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 826us (914us total) trans 8589939689 rc 0/0 00000100:00100000:2.0:1763343032.510352:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3056 00000100:00100000:2.0:1763343032.513279:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.513855:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.513952:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993437824 00000100:00100000:0.0:1763343032.513966:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993437824 00000100:00100000:1.0:1763343032.514124:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993438080 00000100:00100000:1.0:1763343032.514130:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993438080 00000100:00100000:1.0:1763343032.514168:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9001 00000100:00100000:0.0:1763343032.514168:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3057 00000100:00100000:1.0:1763343032.514180:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56824:x1848997993438080:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:0.0:1763343032.514180:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56828:x1848997993437824:12345-192.168.204.21@tcp:35:lfs.0 00010000:00010000:1.0:1763343032.514212:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.514245:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae506b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b01 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.514524:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5072 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514541:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5072 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514553:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5072 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514565:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae5079 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514574:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae5079 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514580:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae5079 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514720:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5080 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514729:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5080 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514736:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5080 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343032.514749:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c9:0x0]: returning size 0 00010000:00010000:1.0:1763343032.514802:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5072 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514810:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5072 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514817:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5072 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514824:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5072 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514830:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.514835:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5072 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514844:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5072 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514858:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdeb00) 00010000:00010000:1.0:1763343032.514862:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.514868:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5072 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514911:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5072 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514925:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae5079 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514931:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae5079 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514936:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae5079 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514941:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.514944:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae5079 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514956:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae5079 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514963:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:1.0:1763343032.514966:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.514969:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae5079 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.514983:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae5079 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.515019:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae506b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b01 expref: 238 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.515039:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5080 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b01 expref: 237 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.515047:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bde800) 00010000:00010000:1.0:1763343032.515049:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343032.515051:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00000100:00100000:0.0:1763343032.515112:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56828:x1848997993437824:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 912us (1825us total) trans 8589939690 rc 0/0 00000100:00100000:1.0:1763343032.515114:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56824:x1848997993438080:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 937us (1262us total) trans 8589939691 rc 0/0 00000100:00100000:1.0:1763343032.515122:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9001 00000100:00100000:0.0:1763343032.515122:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3057 00000100:00100000:3.0:1763343032.517800:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.517854:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993438208 00000100:00100000:0.0:1763343032.517868:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993438208 00000100:00100000:0.0:1763343032.517941:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6285 00000100:00100000:0.0:1763343032.517953:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2431:x1848997993438208:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343032.517988:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.518018:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae508e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b08 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343032.518049:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343032.518076:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.518080:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.518094:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae508e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b08 expref: 22 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343032.518114:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae508e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b08 expref: 22 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343032.518130:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d000, rc 0) 00000100:00100000:0.0:1763343032.518203:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2431:x1848997993438208:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 251us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.518210:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6285 00000100:00100000:2.0:1763343032.518689:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.518848:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993438464 00000100:00100000:1.0:1763343032.518855:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993438464 00000100:00100000:1.0:1763343032.518898:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9002 00000100:00100000:1.0:1763343032.518907:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:55941:x1848997993438464:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343032.519035:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.519039:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343032.519070:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5080 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b01 expref: 236 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.519091:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bde800) 00010000:00010000:1.0:1763343032.519104:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343032.519119:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5095 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b0f expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.519306:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae509c lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.519321:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae509c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1c9:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.519331:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae509c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1c9:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343032.519348:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c9:0x0]: returning size 0 00010000:00010000:1.0:1763343032.519697:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5095 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b0f expref: 238 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.519713:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae509c lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1c9:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b0f expref: 237 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.519720:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:1.0:1763343032.519723:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1763343032.519725:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177600, rc 0) 00000100:00100000:1.0:1763343032.520247:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:55941:x1848997993438464:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1338us (1557us total) trans 8589939692 rc 0/0 00000100:00100000:1.0:1763343032.520257:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9002 00000100:00100000:3.0:1763343032.520425:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.520498:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993438592 00000100:00100000:1.0:1763343032.520505:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993438592 00000100:00100000:1.0:1763343032.520581:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9003 00000100:00100000:1.0:1763343032.520591:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56824:x1848997993438592:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.520606:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.520645:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae50aa lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b16 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.520692:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae50aa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b16 expref: 238 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.520705:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae50aa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b16 expref: 238 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.520721:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:1.0:1763343032.520724:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343032.520727:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343032.520772:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56824:x1848997993438592:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 182us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.520779:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9003 00000100:00100000:3.0:1763343032.523956:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.524084:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.524206:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993438848 00000100:00100000:0.0:1763343032.524221:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993438848 00000100:00100000:0.0:1763343032.524304:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3058 00000100:00100000:0.0:1763343032.524316:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56824:x1848997993438848:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343032.524652:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56824:x1848997993438848:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 306us (680us total) trans 8589939693 rc 0/0 00000100:00100000:0.0:1763343032.524660:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3058 00000100:00100000:1.0:1763343032.524798:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993438976 00000100:00100000:1.0:1763343032.524805:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993438976 00000100:00100000:1.0:1763343032.524842:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9004 00000100:00100000:1.0:1763343032.524849:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:55941:x1848997993438976:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343032.524864:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.524893:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae50b1 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b1d expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.524942:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae50b8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.524964:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae50b8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.524990:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae50b8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.525109:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae50b1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b1d expref: 241 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.525131:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae50b8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b1d expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.525143:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:1.0:1763343032.525146:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343032.525151:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176e00, rc 0) 00000100:00100000:1.0:1763343032.525185:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993438976:12345-192.168.204.21@tcp:101:bash.0 Request processed in 337us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.525191:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9004 00000100:00100000:3.0:1763343032.529487:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.529839:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.529861:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993439488 00000100:00100000:0.0:1763343032.529882:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993439488 00000100:00100000:0.0:1763343032.529957:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9005 00000100:00100000:0.0:1763343032.529968:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993439488:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343032.530057:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343032.530093:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae509c lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1c9:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b0f expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.530118:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:0.0:1763343032.530124:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343032.530347:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993439360 00000100:00100000:1.0:1763343032.530352:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993439360 00010000:00010000:0.0:1763343032.530382:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae50bf lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00000100:00100000:1.0:1763343032.530391:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9006 00000100:00100000:1.0:1763343032.530398:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56824:x1848997993439360:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343032.530399:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae50bf lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.530409:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.530411:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae50bf lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.530426:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae50c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b24 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1763343032.530467:0:6523:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939694 00010000:00010000:1.0:1763343032.530490:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae50cd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00000004:00010000:0.0:1763343032.530493:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000068a11371 reply state 00000000e9e02fdb transno 8589939695 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae50bf lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.530499:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae50cd lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.530505:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae50bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.530507:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae50cd lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.530512:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:0.0:1763343032.530515:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.530517:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae50d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00000100:00100000:0.0:1763343032.530518:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343032.530524:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae50d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530530:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae50d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530651:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae50db lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530661:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae50db lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00000100:00100000:0.0:1763343032.530663:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:55941:x1848997993439488:12345-192.168.204.21@tcp:36:bash.0 Request processed in 697us (1191us total) trans 8589939695 rc 0/0 00010000:00010000:1.0:1763343032.530668:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae50db lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:0.0:1763343032.530670:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9005 00000020:00080000:0.0:1763343032.530677:0:6523:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000004:00200000:1.0:1763343032.530678:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c9:0x0]: returning size 0 00010000:00010000:1.0:1763343032.530737:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae50cd lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530745:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae50cd lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530756:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae50cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530762:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae50cd lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530768:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.530772:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae50cd lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530781:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae50cd lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530789:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde800) 00010000:00010000:1.0:1763343032.530792:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.530795:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae50cd lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530800:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae50cd lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530811:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae50d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530816:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae50d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530821:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae50d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530825:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.530827:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae50d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530837:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae50d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530844:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:1.0:1763343032.530846:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.530849:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae50d4 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530854:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae50d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.530904:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae50c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b24 expref: 245 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.530925:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae50db lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b24 expref: 244 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.530932:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:1.0:1763343032.530934:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343032.530936:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:1.0:1763343032.530985:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56824:x1848997993439360:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 586us (1145us total) trans 8589939696 rc 0/0 00000100:00100000:1.0:1763343032.530992:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9006 00000100:00100000:3.0:1763343032.533007:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.533219:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993439744 00000100:00100000:2.0:1763343032.533231:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993439744 00000100:00100000:3.0:1763343032.533286:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.533707:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993440000 00000100:00100000:0.0:1763343032.533713:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993440000 00000100:00100000:0.0:1763343032.533747:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9007 00000100:00100000:0.0:1763343032.533756:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:55941:x1848997993440000:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343032.533785:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.533788:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343032.533819:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae50aa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b16 expref: 245 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.533840:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:0.0:1763343032.533845:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343032.533861:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae50e9 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b2b expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.533926:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae50f0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.533940:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae50db lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b24 expref: 245 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.533949:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae50f0 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.534003:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae50db lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b24 expref: 245 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.534019:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae50db lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b24 expref: 245 pid: 10042 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343032.534035:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406550e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010228224:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343032.534257:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3059 00000100:00100000:2.0:1763343032.534279:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56824:x1848997993439744:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343032.534835:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56824:x1848997993439744:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 568us (1973us total) trans 8589939697 rc 0/0 00000100:00100000:2.0:1763343032.534843:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3059 00000100:00100000:0.0:1763343032.534853:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340468f540 going to sleep for 11 seconds 00000100:00100000:2.0:1763343032.538592:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406550e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010228224:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343032.538677:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae50f0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343032.539098:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.539212:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.539361:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993440256 00000100:00100000:0.0:1763343032.539372:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993440256 00010000:00010000:0.0:1763343032.539418:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae50db lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b24 expref: 246 pid: 10042 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343032.539453:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2958 00000100:00100000:0.0:1763343032.539464:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538757480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:2431:x1848997993440256:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343032.539482:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343032.539489:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae50db lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b24 expref: 246 pid: 10042 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343032.539502:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae50db lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b24 expref: 246 pid: 10042 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343032.539529:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae50db lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b24 expref: 246 pid: 10042 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343032.539549:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:0.0:1763343032.539554:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae50f0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.539566:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae50f0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.539575:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae50f0 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.539611:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343032.539700:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538757480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:2431:x1848997993440256:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 236us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.539709:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2958 00000100:00100000:2.0:1763343032.540080:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993440128 00000100:00100000:2.0:1763343032.540086:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993440128 00000100:00100000:2.0:1763343032.540133:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3060 00000100:00100000:2.0:1763343032.540142:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56824:x1848997993440128:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:2.0:1763343032.540322:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56824:x1848997993440128:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 181us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.540329:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3060 00010000:00010000:1.0:1763343032.540538:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae50f0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.540548:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae50f0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000040:00080000:1.0:1763343032.540868:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1346, 88 off114168 00000004:00080000:1.0:1763343032.540878:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226208256322ns, next at 1227177369372ns, rc = 0 00000040:00080000:1.0:1763343032.540909:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1345, 88 off114168 00000004:00080000:1.0:1763343032.540913:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226208292704ns, next at 1227177401661ns, rc = 0 00000040:00080000:1.0:1763343032.540933:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1346, 88 off114256 00000004:00080000:1.0:1763343032.540937:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226208316775ns, next at 1227177401661ns, rc = 0 00000040:00080000:1.0:1763343032.540946:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1347, 88 off114256 00000004:00080000:1.0:1763343032.540949:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226208328697ns, next at 1227177369372ns, rc = 0 00000001:00080000:0.0:1763343032.546457:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939698 is committed 00000004:00080000:0.0:1763343032.546487:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 888 committed 00010000:00010000:2.0:1763343032.546491:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5017 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.546508:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5017 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00000004:00080000:0.0:1763343032.546512:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 889 committed 00010000:00010000:2.0:1763343032.546518:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5017 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.546528:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00000004:00080000:0.0:1763343032.546528:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 888 committed 00000004:00080000:0.0:1763343032.546534:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 887 committed 00010000:00010000:2.0:1763343032.546537:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5017 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.546547:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5017 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00000004:00080000:0.0:1763343032.546564:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 887 committed 00010000:00010000:2.0:1763343032.546569:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00000004:00080000:0.0:1763343032.546569:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 886 committed 00010000:00010000:2.0:1763343032.546576:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.546584:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5017 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.546593:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5017 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.546649:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae50bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.546656:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae50bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.546662:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae50bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.546667:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.546670:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae50bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.546676:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae50bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.546684:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:2.0:1763343032.546687:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.546690:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae50bf lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.546696:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae50bf lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:1.0:1763343032.546956:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010228480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343032.547053:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343032.547105:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343032.547111:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010228608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343032.547158:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343032.547197:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010228736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343032.547225:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343032.547450:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010229120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343032.547490:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010228992:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343032.547756:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010228352:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343032.548023:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010229248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343032.548048:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343032.549450:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.549614:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010228480 00000100:00100000:0.0:1763343032.549654:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010228480 00000100:00100000:0.0:1763343032.549721:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010228608 00000100:00100000:0.0:1763343032.549725:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010228608 00000100:00100000:0.0:1763343032.549745:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010228736 00000100:00100000:0.0:1763343032.549748:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010228736 00000100:00100000:0.0:1763343032.549763:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010229248 00000100:00100000:0.0:1763343032.549766:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010229248 00000100:00100000:0.0:1763343032.549790:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6286 00000100:00100000:0.0:1763343032.549800:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3659:x1848998010228480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343032.549852:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:642 count 1 00010000:00010000:0.0:1763343032.549894:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae50f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.549921:0:28993:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176000/0x607405d401ae4f84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac2 expref: 12 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.549940:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343032.549943:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343032.549948:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae50f7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343032.549982:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6287 00000100:00100000:3.0:1763343032.549993:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3659:x1848998010228608:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763343032.550008:0:28993:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d176000/0x607405d401ae4f84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac2 expref: 12 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.550026:0:28993:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176000/0x607405d401ae4f84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac2 expref: 12 pid: 28993 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343032.550043:0:28993:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406551880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010229376:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343032.550144:0:28993:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340468f180 going to sleep for 11 seconds 00000100:00100000:0.0:1763343032.550169:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6288 00000100:00100000:0.0:1763343032.550177:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3657:x1848998010228736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343032.550332:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3659:x1848998010228608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 341us (3173us total) trans 21474838791 rc 0/0 00000100:00100000:0.0:1763343032.550335:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3657:x1848998010228736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (3108us total) trans 21474838790 rc 0/0 00000100:00100000:3.0:1763343032.550341:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6287 00000100:00100000:1.0:1763343032.550590:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010228864:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343032.550631:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343032.550672:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010228352 00000100:00100000:1.0:1763343032.550677:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010228352 00000100:00100000:2.0:1763343032.550721:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010228864 00000100:00100000:2.0:1763343032.550724:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010228864 00000100:00100000:0.0:1763343032.551059:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6288 00000100:00100000:3.0:1763343032.551065:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6289 00000100:00100000:3.0:1763343032.551076:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3657:x1848998010229248:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763343032.551195:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae50f0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b2b expref: 231 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.551208:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:0.0:1763343032.551212:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1763343032.551223:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3657:x1848998010229248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 149us (3173us total) trans 17179871492 rc 0/0 00000100:00100000:3.0:1763343032.551229:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6289 00010000:00010000:0.0:1763343032.551231:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae50e9 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b2b expref: 231 pid: 10041 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1763343032.551251:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343032.551257:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae50f0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b2b expref: 230 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.551291:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:0.0:1763343032.551294:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1763343032.551295:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343032.551297:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c400, rc 0) 00000100:00100000:0.0:1763343032.551330:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:55941:x1848997993440000:12345-192.168.204.21@tcp:101:bash.0 Request processed in 17575us (18044us total) trans 8589939698 rc 0/0 00000100:00100000:0.0:1763343032.551337:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9007 00000004:00080000:3.0:1763343032.551339:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406648e00/2, rc 0, transno 21474838791 00000100:00100000:3.0:1763343032.551347:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010228608:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343032.551367:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010229120 00000100:00100000:3.0:1763343032.551370:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010229120 00000004:00080000:0.0:1763343032.551376:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3538754700/2, rc 0, transno 17179871492 00000100:00100000:0.0:1763343032.551381:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010229248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343032.551391:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010228992 00000004:00080000:0.0:1763343032.551392:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340664a680/2, rc 0, transno 21474838790 00000100:00100000:3.0:1763343032.551394:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010228992 00000100:00100000:0.0:1763343032.551396:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340664a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010228736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343032.551410:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6290 00000100:00100000:3.0:1763343032.551416:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3660:x1848998010229120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.551418:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6291 00000100:00100000:0.0:1763343032.551425:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3659:x1848998010228992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343032.551438:0:10294:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:644 count 1 00010000:00010000:0.0:1763343032.551455:0:10294:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae50fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.551471:0:10294:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3406702000/0x607405d401ae4fa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac9 expref: 21 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.551479:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343032.551481:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343032.551485:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae50fe lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343032.551498:0:8408:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x287:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343032.551501:0:8408:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x287:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343032.551503:0:8408:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x287:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343032.551505:0:8408:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x287:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343032.551508:0:8408:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x287:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1763343032.551514:0:10294:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3406702000/0x607405d401ae4fa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac9 expref: 21 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.551525:0:10294:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3406702000/0x607405d401ae4fa7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac9 expref: 21 pid: 27835 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1763343032.551536:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3660:x1848998010229120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (285us total) trans 17179871493 rc 0/0 00000100:00100000:0.0:1763343032.551537:0:10294:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406552680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10294:1848998010229504:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343032.551549:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6290 00000004:00080000:3.0:1763343032.551576:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3538755500/2, rc 0, transno 17179871493 00000100:00100000:0.0:1763343032.551576:0:10294:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340468f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343032.551580:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010229120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343032.552018:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6292 00000100:00100000:1.0:1763343032.552029:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3658:x1848998010228352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343032.552046:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:641 count 1 00010000:00010000:1.0:1763343032.552063:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5105 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x281:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.552081:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae4dd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a28 expref: 12 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.552088:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343032.552090:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343032.552093:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5105 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.552115:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae4dd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a28 expref: 12 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.552126:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae4dd2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a28 expref: 12 pid: 27835 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343032.552137:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34050f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010229632:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343032.552179:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe780 going to sleep for 11 seconds 00000100:00100000:2.0:1763343032.552239:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6293 00000100:00100000:2.0:1763343032.552251:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3658:x1848998010228864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343032.552266:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:643 count 1 00010000:00010000:2.0:1763343032.552281:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae510c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.552293:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae4ece lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a7c expref: 21 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343032.552300:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.552301:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.552304:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae510c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.552325:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae4ece lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a7c expref: 21 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343032.552334:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae4ece lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a7c expref: 21 pid: 27835 timeout: 1326 lvb_type: 1 00000100:00100000:2.0:1763343032.552344:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010229760:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343032.552369:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a353c6e8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1763343032.557048:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010229760:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343032.557093:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae510c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343032.557149:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.557171:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.557186:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.557213:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993440384 00000100:00100000:2.0:1763343032.557221:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993440384 00000100:00100000:0.0:1763343032.557436:0:28993:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406551880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010229376:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343032.557461:0:28993:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae50f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343032.557482:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993440640 00000100:00100000:0.0:1763343032.557486:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993440640 00010000:00010000:0.0:1763343032.557507:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae4dd2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a28 expref: 14 pid: 27835 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343032.557541:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993440512 00000100:00100000:0.0:1763343032.557544:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993440512 00010000:00010000:0.0:1763343032.557560:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3406702000/0x607405d401ae4fa7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac9 expref: 22 pid: 27835 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343032.557584:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2959 00000100:00100000:0.0:1763343032.557593:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2431:x1848997993440640:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343032.557611:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343032.557636:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae4dd2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a28 expref: 14 pid: 27835 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343032.557648:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae4dd2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a28 expref: 14 pid: 27835 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343032.557681:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.557684:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.557689:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5105 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.557701:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5105 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.557723:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343032.557785:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2431:x1848997993440640:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 193us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.557793:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2959 00000100:00100000:0.0:1763343032.557814:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2960 00000100:00100000:0.0:1763343032.557822:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2431:x1848997993440512:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343032.557831:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343032.557835:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3406702000/0x607405d401ae4fa7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac9 expref: 22 pid: 27835 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343032.557844:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3406702000/0x607405d401ae4fa7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac9 expref: 22 pid: 27835 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343032.557859:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.557862:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.557865:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae50fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.557873:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae50fe lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.557885:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343032.557904:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2431:x1848997993440512:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 82us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.557910:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2960 00000100:00100000:0.0:1763343032.557956:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.557991:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993440768 00000100:00100000:0.0:1763343032.557996:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993440768 00010000:00010000:0.0:1763343032.558009:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae4ece lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a7c expref: 22 pid: 27835 timeout: 1326 lvb_type: 1 00000100:00100000:0.0:1763343032.558024:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2961 00000100:00100000:0.0:1763343032.558029:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2431:x1848997993440768:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343032.558037:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343032.558040:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae4ece lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a7c expref: 22 pid: 27835 timeout: 1326 lvb_type: 1 00010000:00010000:0.0:1763343032.558048:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae4ece lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a7c expref: 22 pid: 27835 timeout: 1326 lvb_type: 1 00010000:00010000:0.0:1763343032.558062:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae4ece lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x283:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a7c expref: 22 pid: 27835 timeout: 1326 lvb_type: 1 00010000:00010000:0.0:1763343032.558080:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.558082:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.558086:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae510c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.558093:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae510c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.558111:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343032.558130:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2431:x1848997993440768:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 100us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.558136:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2961 00010000:00010000:3.0:1763343032.558393:0:28996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae4dd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8a28 expref: 13 pid: 27835 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1763343032.558405:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34050f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010229632:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343032.558426:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5105 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.558435:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5105 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.558442:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5105 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.558454:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5105 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.558462:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5105 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.558482:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343032.558935:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176000/0x607405d401ae4f84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac2 expref: 12 pid: 28993 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343032.558987:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2962 00000100:00100000:2.0:1763343032.558997:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2431:x1848997993440384:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343032.559011:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343032.559015:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d176000/0x607405d401ae4f84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac2 expref: 12 pid: 28993 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.559026:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d176000/0x607405d401ae4f84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac2 expref: 12 pid: 28993 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.559042:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176000/0x607405d401ae4f84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac2 expref: 12 pid: 28993 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.559053:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.559055:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.559059:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae50f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.559067:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae50f7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.559088:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343032.559178:0:10294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3406702000/0x607405d401ae4fa7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ac9 expref: 20 pid: 27835 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343032.559190:0:10294:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406552680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10294:1848998010229504:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343032.559206:0:10294:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae50fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.559215:0:10294:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae50fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.559226:0:10294:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae50fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.559234:0:10294:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae50fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.559241:0:10294:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae50fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.559257:0:10294:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343032.560560:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3658:x1848998010228352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8527us (11111us total) trans 21474838792 rc 0/0 00000100:00100000:2.0:1763343032.560561:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2431:x1848997993440384:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1556us (3401us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.560582:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6292 00000100:00100000:2.0:1763343032.560586:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2962 00010000:00010000:3.0:1763343032.560656:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343032.560664:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae510c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.560667:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5105 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.560685:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae510c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.560687:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343032.560696:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5105 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.560700:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae510c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.560714:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5105 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.560715:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae510c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.560750:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5105 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.560750:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1763343032.560762:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5105 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.560785:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343032.560789:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae50fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.560796:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665da00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343032.560799:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae50fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.560806:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae50fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.560815:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae50fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.560827:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae50fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.560840:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343032.560843:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae510c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.560848:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343032.560851:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae510c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.560858:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae510c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.560866:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae510c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.560873:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae510c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.560885:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343032.560886:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343032.560888:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343032.560936:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406648380/2, rc 0, transno 21474838792 00000100:00100000:3.0:1763343032.560944:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010228352:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343032.561167:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3658:x1848998010228864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8918us (10546us total) trans 17179871495 rc 0/0 00000100:00100000:2.0:1763343032.561174:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6293 00000100:00100000:2.0:1763343032.561244:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.561276:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993440896 00000100:00100000:2.0:1763343032.561284:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993440896 00000100:00100000:2.0:1763343032.561317:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6294 00000100:00100000:2.0:1763343032.561327:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:55941:x1848997993440896:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343032.561345:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.561363:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae5113 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b32 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.561392:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae508e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b08 expref: 21 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343032.561401:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.561403:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.561408:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae5113 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b32 expref: 21 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.561444:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae508e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b08 expref: 21 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343032.561459:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae508e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b08 expref: 21 pid: 28993 timeout: 1326 lvb_type: 1 00000100:00100000:1.0:1763343032.561470:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3659:x1848998010228992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10045us (10174us total) trans 17179871494 rc 0/0 00000100:00100000:2.0:1763343032.561475:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010229888:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343032.561479:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6291 00010000:00010000:1.0:1763343032.561509:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343032.561537:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a353c6e8000 going to sleep for 11 seconds 00010000:00010000:1.0:1763343032.561569:0:28993:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae50f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343032.561573:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:1.0:1763343032.561578:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae50f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.561587:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae50f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.561595:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae50f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.561644:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343032.561767:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343032.561773:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae50f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.561780:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343032.561784:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae50f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.561792:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae50f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.561809:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae50f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.561818:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae50f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.561835:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343032.561837:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343032.561838:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343032.561869:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3659:x1848998010228480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12071us (14816us total) trans 21474838793 rc 0/0 00000004:00080000:3.0:1763343032.561927:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3538755180/2, rc 0, transno 17179871494 00000100:00100000:3.0:1763343032.561934:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010228992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343032.561935:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6286 00000004:00080000:3.0:1763343032.561947:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406648000/2, rc 0, transno 21474838793 00000100:00100000:3.0:1763343032.561951:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010228480:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763343032.561967:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343032.561984:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3538754e00/2, rc 0, transno 17179871495 00000100:00100000:3.0:1763343032.561988:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010228864:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343032.561995:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993441152 00000100:00100000:1.0:1763343032.561999:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993441152 00000100:00100000:1.0:1763343032.562047:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9008 00000100:00100000:1.0:1763343032.564678:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+230:56829:x1848997993441152:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.564721:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.564765:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae511a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b39 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.565167:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5121 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.565184:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5121 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.565200:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5121 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.565224:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5128 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.565231:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5128 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.565238:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5128 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:0.0:1763343032.565294:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010229888:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343032.565329:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae5113 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b32 expref: 21 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.565350:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6200, rc 0) 00000100:00100000:0.0:1763343032.565428:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:55941:x1848997993440896:12345-192.168.204.21@tcp:101:bash.0 Request processed in 4101us (4184us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.565439:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6294 00010000:00010000:1.0:1763343032.565702:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae512f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.565713:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae512f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.565720:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae512f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343032.565733:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c9:0x0]: returning size 2 00010000:00010000:1.0:1763343032.565867:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5121 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.565939:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5121 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.565946:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5121 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.565953:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5121 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.565959:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00000100:00100000:3.0:1763343032.565962:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:1.0:1763343032.565964:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5121 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.565981:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5121 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.565995:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde800) 00010000:00010000:1.0:1763343032.565998:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.566004:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5121 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.566015:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5121 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.566031:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5128 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.566038:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5128 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.566043:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5128 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.566401:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.566407:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5128 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.566415:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5128 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.566424:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdeb00) 00010000:00010000:1.0:1763343032.566427:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.566430:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5128 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.566435:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5128 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.566501:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae511a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b39 expref: 233 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.566517:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae512f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b39 expref: 232 pid: 10041 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343032.566644:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993441280 00000100:00100000:0.0:1763343032.566656:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993441280 00010000:00010000:1.0:1763343032.566751:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:1.0:1763343032.566756:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343032.566759:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:1.0:1763343032.566818:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56829:x1848997993441152:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4692us (5242us total) trans 8589939699 rc 0/0 00000100:00100000:1.0:1763343032.566827:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9008 00010000:00010000:0.0:1763343032.566880:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae508e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b08 expref: 21 pid: 28993 timeout: 1326 lvb_type: 1 00000100:00100000:0.0:1763343032.566925:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2963 00000100:00100000:0.0:1763343032.566936:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993441280:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343032.566953:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343032.566959:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae508e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b08 expref: 21 pid: 28993 timeout: 1326 lvb_type: 1 00010000:00010000:0.0:1763343032.566981:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae508e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b08 expref: 21 pid: 28993 timeout: 1326 lvb_type: 1 00010000:00010000:0.0:1763343032.567003:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae508e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b08 expref: 21 pid: 28993 timeout: 1326 lvb_type: 1 00010000:00010000:0.0:1763343032.567015:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.567018:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.567027:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae5113 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b32 expref: 20 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.567039:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae5113 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b32 expref: 20 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.567082:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae5113 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b32 expref: 20 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343032.567097:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406552300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1848998010230016:192.168.204.21@tcp:105: 00000100:00100000:0.0:1763343032.567172:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340468f180 going to sleep for 11 seconds 00000100:00100000:1.0:1763343032.570771:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406552300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1848998010230016:192.168.204.21@tcp:105: 00010000:00010000:1.0:1763343032.570813:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343032.570884:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993441280:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 3949us (4921us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.570905:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2963 00000100:00100000:3.0:1763343032.571044:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.571207:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.571217:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993441408 00000100:00100000:0.0:1763343032.571226:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993441408 00000100:00100000:1.0:1763343032.571321:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993441664 00000100:00100000:1.0:1763343032.571329:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993441664 00000100:00100000:2.0:1763343032.571594:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6295 00000100:00100000:2.0:1763343032.571608:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:55941:x1848997993441408:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343032.571668:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.571698:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae513d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b40 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343032.571729:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x285:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343032.571755:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.571758:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.571770:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae513d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b40 expref: 12 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.571789:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae513d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b40 expref: 12 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.571803:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7c00, rc 0) 00000100:00100000:2.0:1763343032.571851:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:55941:x1848997993441408:12345-192.168.204.21@tcp:101:bash.0 Request processed in 247us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.571858:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6295 00000100:00100000:1.0:1763343032.571988:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3061 00000100:00100000:1.0:1763343032.571997:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56829:x1848997993441664:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343032.572406:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56829:x1848997993441664:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 409us (1198us total) trans 8589939700 rc 0/0 00000100:00100000:1.0:1763343032.572415:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3061 00000100:00100000:3.0:1763343032.573432:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.573473:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.573666:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993441792 00000100:00100000:0.0:1763343032.573679:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993441792 00002000:00010000:0.0:1763343032.573722:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/647 (0->18446744073709551615) 00002000:00100000:0.0:1763343032.573727:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538755f80 with x1848997993441792 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343032.573742:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3538755f80. 00000100:00100000:0.0:1763343032.573760:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993441920 00000100:00100000:0.0:1763343032.573763:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993441920 00002000:00010000:0.0:1763343032.573776:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/645 (0->18446744073709551615) 00002000:00100000:0.0:1763343032.573778:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538754000 with x1848997993441920 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343032.573785:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3538754000. 00000100:00100000:0.0:1763343032.573817:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1548 00000100:00100000:0.0:1763343032.573826:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993441792:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343032.574049:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x287:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343032.574053:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x287:0x0] updating lvb mtime from disk: 0 -> 1763343032 00002000:00010000:0.0:1763343032.574056:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x287:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.574059:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x287:0x0] updating lvb ctime from disk: 0 -> 1763343032 00002000:00010000:0.0:1763343032.574061:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x287:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343032.574122:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993441792:12345-192.168.204.21@tcp:10:bash.0 Request processed in 295us (701us total) trans 17179871496 rc 0/0 00000100:00100000:0.0:1763343032.574130:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1548 00002000:00010000:0.0:1763343032.574134:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/647 (0->18446744073709551615) 00002000:00100000:0.0:1763343032.574137:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538755f80 with x1848997993441792 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343032.574141:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3538755f80. 00000100:00100000:1.0:1763343032.574152:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1549 00000100:00100000:1.0:1763343032.574162:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993441920:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:1.0:1763343032.574284:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x285:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343032.574287:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x285:0x0] updating lvb mtime from disk: 0 -> 1763343032 00002000:00010000:1.0:1763343032.574289:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x285:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343032.574292:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x285:0x0] updating lvb ctime from disk: 0 -> 1763343032 00002000:00010000:1.0:1763343032.574295:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x285:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343032.574323:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993441920:12345-192.168.204.21@tcp:10:bash.0 Request processed in 163us (849us total) trans 21474838794 rc 0/0 00000100:00100000:1.0:1763343032.574330:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1549 00002000:00010000:1.0:1763343032.574334:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/645 (0->18446744073709551615) 00002000:00100000:1.0:1763343032.574336:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538754000 with x1848997993441920 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343032.574341:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3538754000. 00000100:00100000:3.0:1763343032.577993:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.578152:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993442176 00000100:00100000:1.0:1763343032.578166:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993442176 00000100:00100000:1.0:1763343032.578243:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3062 00000100:00100000:1.0:1763343032.578254:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:55941:x1848997993442176:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:1.0:1763343032.578733:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:55941:x1848997993442176:12345-192.168.204.21@tcp:35:bash.0 Request processed in 478us (764us total) trans 8589939701 rc 0/0 00000100:00100000:1.0:1763343032.578742:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3062 00000100:00100000:2.0:1763343032.583195:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.583732:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993442432 00000100:00100000:1.0:1763343032.583748:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993442432 00000100:00100000:1.0:1763343032.583828:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9009 00000100:00100000:1.0:1763343032.583840:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56830:x1848997993442432:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.583871:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.583899:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5144 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b47 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.584057:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae514b lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.584076:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae514b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.584088:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae514b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343032.584101:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c9:0x0]: returning size 5 00010000:00010000:1.0:1763343032.584241:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5144 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b47 expref: 237 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.584732:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae514b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b47 expref: 236 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.584744:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:1.0:1763343032.584747:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763343032.584752:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:1.0:1763343032.584837:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56830:x1848997993442432:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 999us (1658us total) trans 8589939702 rc 0/0 00000100:00100000:1.0:1763343032.584846:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9009 00000100:00100000:0.0:1763343032.586333:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.586428:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993442688 00000100:00100000:1.0:1763343032.586441:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993442688 00000100:00100000:1.0:1763343032.587108:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9010 00000100:00100000:1.0:1763343032.587122:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56831:x1848997993442688:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:1.0:1763343032.587191:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343032.587224:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae50f0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b2b expref: 236 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.587248:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae512f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b39 expref: 235 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.587267:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae50b8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b1d expref: 234 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.587278:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:1.0:1763343032.587284:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343032.587317:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5159 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.587331:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5159 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.587341:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5159 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.587352:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5160 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.587357:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5160 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.587364:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5160 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.587459:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.587470:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae514b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b47 expref: 233 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.587478:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.587520:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae514b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b47 expref: 233 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.587535:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae514b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b47 expref: 233 pid: 10041 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343032.587552:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34050f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010230144:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343032.587673:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343032.590212:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.591663:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993442816 00000100:00100000:2.0:1763343032.591681:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993442816 00000100:00100000:2.0:1763343032.591762:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9011 00000100:00100000:2.0:1763343032.591772:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56830:x1848997993442816:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:0.0:1763343032.591788:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:2.0:1763343032.591804:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.591833:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae516e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b4e expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343032.591857:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993442944 00000100:00100000:1.0:1763343032.591861:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993442944 00010000:00010000:1.0:1763343032.591889:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae514b lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b47 expref: 236 pid: 10041 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343032.591923:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2964 00000100:00100000:1.0:1763343032.591929:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:2429:x1848997993442944:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343032.591941:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343032.591947:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae514b lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b47 expref: 236 pid: 10041 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1763343032.591961:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae514b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b47 expref: 236 pid: 10041 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.591981:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5175 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.592004:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.592013:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5175 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.592096:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae514b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b47 expref: 236 pid: 10041 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343032.592120:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34050f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010230144:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343032.592344:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:1.0:1763343032.592351:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.592360:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.592369:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 5/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.592378:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5175 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.592384:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5175 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.592389:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5175 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.592406:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343032.592471:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:2429:x1848997993442944:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 541us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.592479:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2964 00010000:00010000:2.0:1763343032.592537:0:10042:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.592549:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5175 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.592731:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.592740:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.592746:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00000004:00080000:0.0:1763343032.593062:0:10041:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1c9:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763343032.593164:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593172:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593179:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593185:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.593188:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593196:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593208:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:0.0:1763343032.593212:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343032.593214:0:10041:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5175 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.593227:0:10041:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5175 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.593233:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5175 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.593253:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593261:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5167 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593278:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5159 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593284:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5159 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593290:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5159 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593295:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5159 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593299:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.593302:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5159 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593307:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5159 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593315:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde800) 00010000:00010000:0.0:1763343032.593318:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.593321:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5159 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593327:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5159 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00010000:0.0:1763343032.593345:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000024cc3c71 reply state 000000000c6518e1 transno 8589939703 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5160 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593357:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5160 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.593362:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdeb00) 00010000:00010000:0.0:1763343032.593365:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343032.593368:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343032.593423:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56831:x1848997993442688:12345-192.168.204.21@tcp:36:rm.0 Request processed in 6303us (7098us total) trans 8589939703 rc 0/0 00000100:00100000:0.0:1763343032.593431:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9010 00010000:00010000:2.0:1763343032.593544:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5175 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.593552:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5175 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343032.593582:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c9:0x0]: returning size 5 00000004:00200000:2.0:1763343032.593588:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343032.593605:0:10042:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5175 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.593678:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae516e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b4e expref: 236 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.593694:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6400/0x607405d401ae5175 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b4e expref: 235 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.593702:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:2.0:1763343032.593705:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343032.593708:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6400, rc 0) 00000100:00100000:2.0:1763343032.593747:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56830:x1848997993442816:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1976us (3551us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.593754:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9011 00000100:00100000:0.0:1763343032.599570:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.599689:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993443200 00000100:00100000:2.0:1763343032.599702:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993443200 00000100:00100000:2.0:1763343032.599771:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3063 00000100:00100000:2.0:1763343032.599782:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56830:x1848997993443200:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:2.0:1763343032.600108:0:14879:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1c9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763343032.600197:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1348, 64 off114320 00000040:00080000:2.0:1763343032.600227:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1347, 64 off114320 00000040:00080000:2.0:1763343032.600238:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1348, 64 off114384 00000040:00080000:2.0:1763343032.600248:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1349, 64 off114384 00010000:00010000:2.0:1763343032.600329:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae517c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.600351:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae517c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.600366:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae517c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.600377:0:14879:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae517c lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.600384:0:14879:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae517c lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.600391:0:14879:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae517c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343032.600421:0:14879:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343032.600466:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343032.600474:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae517c lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343032.600481:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343032.600486:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae517c lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343032.600494:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae517c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343032.600508:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c9:0x0].0x0 (ffff9a3403bded00) 00010000:00010000:3.0:1763343032.600512:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343032.600518:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae517c lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343032.600524:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae517c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343032.600536:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343032.600538:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343032.600539:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343032.600695:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56830:x1848997993443200:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 911us (1138us total) trans 8589939704 rc 0/0 00000100:00100000:2.0:1763343032.600705:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3063 00000100:00100000:0.0:1763343032.608184:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.609215:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993443328 00000100:00100000:2.0:1763343032.609233:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993443328 00000100:00100000:2.0:1763343032.609325:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9012 00000100:00100000:2.0:1763343032.609337:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56830:x1848997993443328:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343032.609369:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.609402:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5183 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b55 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.609495:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae518a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609513:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae518a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609526:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae518a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609539:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5191 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609548:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5191 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609555:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5191 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609611:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae518a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609649:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae518a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609657:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae518a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609664:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae518a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609670:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.609675:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae518a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609683:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae518a lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609697:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:2.0:1763343032.609701:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.609707:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae518a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609714:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae518a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609729:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5191 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609736:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5191 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609742:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5191 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609748:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.609750:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5191 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609756:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5191 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609763:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdeb00) 00010000:00010000:2.0:1763343032.609766:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.609769:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5191 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609775:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5191 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.609807:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5183 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b55 expref: 237 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.609818:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:2.0:1763343032.609821:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.609824:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5183 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b55 expref: 237 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.609839:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6800, rc 0) 00000100:00100000:2.0:1763343032.609923:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56830:x1848997993443328:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 588us (1754us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343032.609931:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9012 00000100:00100000:0.0:1763343032.617489:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.620469:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993443456 00000100:00100000:2.0:1763343032.620491:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993443456 00000100:00100000:2.0:1763343032.620576:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9013 00000100:00100000:2.0:1763343032.620587:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56832:x1848997993443456:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343032.620615:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.620701:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5198 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b5c expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.620783:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae519f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620800:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae519f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620812:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae519f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620826:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620834:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620840:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620886:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae519f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620893:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae519f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620901:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae519f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620908:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae519f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620914:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.620918:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae519f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620926:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae519f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620938:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7b00) 00010000:00010000:2.0:1763343032.620942:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.620946:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae519f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620952:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae519f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620965:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620982:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620988:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.620993:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.620996:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.621007:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.621014:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdeb00) 00010000:00010000:2.0:1763343032.621016:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.621019:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.621025:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.621052:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5198 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b5c expref: 237 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.621063:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7b00) 00010000:00010000:2.0:1763343032.621065:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.621069:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5198 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b5c expref: 237 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.621083:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6000, rc 0) 00000100:00100000:2.0:1763343032.621155:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56832:x1848997993443456:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 570us (3682us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343032.621163:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9013 00000100:00100000:1.0:1763343032.629067:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.629176:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993443584 00000100:00100000:2.0:1763343032.629189:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993443584 00000100:00100000:2.0:1763343032.629272:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9014 00000100:00100000:2.0:1763343032.629285:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56832:x1848997993443584:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343032.629314:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.629347:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae51ad lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b63 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.629444:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51b4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629462:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51b4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629475:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51b4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629487:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51bb lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629495:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629502:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629552:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51b4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629559:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51b4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629566:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51b4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629573:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51b4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629580:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.629585:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51b4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629595:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51b4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629609:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:2.0:1763343032.629613:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.629664:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51b4 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629672:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629691:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629698:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629704:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629709:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fa00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.629712:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629719:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629726:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdeb00) 00010000:00010000:2.0:1763343032.629729:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.629732:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51bb lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629738:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51bb lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.629771:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae51ad lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b63 expref: 237 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.629783:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:2.0:1763343032.629785:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.629789:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae51ad lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b63 expref: 237 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.629806:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f000, rc 0) 00000100:00100000:2.0:1763343032.632784:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56832:x1848997993443584:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3481us (3711us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343032.632803:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9014 00000100:00100000:1.0:1763343032.637872:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.637921:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993443968 00000100:00100000:2.0:1763343032.637936:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993443968 00000100:00100000:0.0:1763343032.637946:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.639603:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993443712 00000100:00100000:1.0:1763343032.639637:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993443712 00000100:00100000:1.0:1763343032.639708:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9015 00000100:00100000:1.0:1763343032.639720:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56833:x1848997993443968:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.639750:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.639782:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae51c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b71 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.639891:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae51c9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.639907:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae51c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.639920:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae51c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.639931:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae51d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.639938:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae51d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.639945:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae51d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640007:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae51c9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640015:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae51c9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640023:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae51c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640031:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae51c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640037:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.640042:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae51c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640051:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae51c9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640066:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde300) 00010000:00010000:1.0:1763343032.640070:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.640077:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae51c9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640084:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae51c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640103:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae51d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640109:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae51d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640115:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae51d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640120:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.640122:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae51d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640128:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae51d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640134:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdeb00) 00010000:00010000:1.0:1763343032.640137:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.640139:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae51d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640145:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae51d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640180:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae51c2 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b71 expref: 238 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.640192:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde300) 00010000:00010000:1.0:1763343032.640196:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343032.640199:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae51c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b71 expref: 238 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.640214:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343032.640300:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56833:x1848997993443968:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 581us (2445us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343032.640308:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9015 00000100:00100000:1.0:1763343032.640337:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9016 00000100:00100000:1.0:1763343032.640346:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56832:x1848997993443712:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.640355:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.640365:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae51d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b6a expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.640404:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae51de lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640413:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae51de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.640420:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae51de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343032.640472:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343032.640478:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343032.640512:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae51d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b6a expref: 238 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.640527:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae51de lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b6a expref: 237 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.640538:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdec00) 00010000:00010000:1.0:1763343032.640541:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343032.640543:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177a00, rc 0) 00000100:00100000:1.0:1763343032.640565:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56832:x1848997993443712:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 221us (2619us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.640571:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9016 00000100:00100000:1.0:1763343032.653175:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.653304:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993444224 00000100:00100000:2.0:1763343032.653318:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993444224 00000100:00100000:2.0:1763343032.653397:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9017 00000100:00100000:2.0:1763343032.653409:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56832:x1848997993444224:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343032.653437:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.653441:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343032.653476:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae51de lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b6a expref: 237 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.653501:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdec00) 00010000:00010000:2.0:1763343032.653515:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343032.653537:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae51e5 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b78 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.653715:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51ec lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.653729:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51ec lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.653738:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51ec lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.653747:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51f3 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.653754:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.653759:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.654229:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51fa lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.654239:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51fa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.654247:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51fa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343032.654258:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ca:0x0]: returning size 0 00010000:00010000:2.0:1763343032.654290:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51ec lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.654298:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51ec lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.654309:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51ec lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.654315:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51ec lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.654321:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fa00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.654325:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51ec lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.654333:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51ec lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.654342:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:2.0:1763343032.654345:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.654350:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51ec lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.654356:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae51ec lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:2.0:1763343032.654370:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009ae67e71 reply state 000000001929bfa0 transno 8589939705 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.654383:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.654388:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdeb00) 00010000:00010000:2.0:1763343032.654391:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343032.654393:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343032.654423:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae51e5 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b78 expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.654447:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51fa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b78 expref: 238 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.654454:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7b00) 00010000:00010000:2.0:1763343032.654456:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343032.654459:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3fc00, rc 0) 00000100:00100000:2.0:1763343032.654559:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56832:x1848997993444224:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1151us (1397us total) trans 8589939705 rc 0/0 00000100:00100000:2.0:1763343032.654567:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9017 00000100:00100000:1.0:1763343032.657245:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.657363:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993444480 00000100:00100000:2.0:1763343032.657375:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993444480 00000100:00100000:2.0:1763343032.657454:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9018 00000100:00100000:2.0:1763343032.657466:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56832:x1848997993444480:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343032.657499:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.657527:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5208 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b7f expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.657707:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae520f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.657726:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51fa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b78 expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.657735:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae520f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.657779:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51fa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b78 expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.657795:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51fa lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b78 expref: 240 pid: 10042 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343032.657812:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010230272:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343032.657916:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a353c6e8000 going to sleep for 11 seconds 00000100:00100000:1.0:1763343032.660739:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.661862:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993444736 00000100:00100000:3.0:1763343032.661880:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993444736 00000100:00100000:0.0:1763343032.662599:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9019 00000100:00100000:0.0:1763343032.662617:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56834:x1848997993444736:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343032.662707:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.662740:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae5216 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b86 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.662883:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae521d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.662904:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae521d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.662919:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae521d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343032.662931:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ca:0x0]: returning size 0 00010000:00010000:0.0:1763343032.663050:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae521d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.663058:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae521d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.663065:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae521d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.663071:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.663077:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae521d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.663084:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae521d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.663097:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7b00) 00010000:00010000:0.0:1763343032.663101:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763343032.663106:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae521d lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.663112:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae521d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.663163:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae5216 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b86 expref: 243 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.663180:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7b00) 00010000:00010000:0.0:1763343032.663183:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343032.663187:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae5216 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b86 expref: 243 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.663198:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665cc00, rc 0) 00000100:00100000:0.0:1763343032.663306:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56834:x1848997993444736:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 694us (2581us total) trans 8589939706 rc 301/301 00000100:00100000:0.0:1763343032.663315:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9019 00000100:00100000:2.0:1763343032.663763:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.664261:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993444864 00000100:00100000:2.0:1763343032.664271:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993444864 00010000:00010000:2.0:1763343032.664313:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51fa lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b78 expref: 242 pid: 10042 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343032.664349:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2965 00000100:00100000:2.0:1763343032.664358:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:2429:x1848997993444864:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343032.664373:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343032.664381:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51fa lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b78 expref: 242 pid: 10042 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.664394:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51fa lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b78 expref: 242 pid: 10042 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.664415:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7b00) 00010000:00010000:2.0:1763343032.664419:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae520f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.664428:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae520f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.664439:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae520f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343032.664460:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343032.664500:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:2429:x1848997993444864:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 143us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.664508:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2965 00010000:00010000:0.0:1763343032.664678:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae51fa lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b78 expref: 241 pid: 10042 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343032.664695:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010230272:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343032.664720:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae520f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.664729:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae520f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.664735:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae520f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:0.0:1763343032.664759:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ca:0x0]: returning size 0 00000004:00080000:0.0:1763343032.664985:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x287:0x0], index 0: 0 00000004:00080000:0.0:1763343032.664995:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x289:0x0], index 1: 0 00000004:00080000:0.0:1763343032.665000:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x28a:0x0], index 1: 0 00000004:00080000:0.0:1763343032.665004:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x288:0x0], index 0: 0 00010000:00010000:0.0:1763343032.665121:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae520f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.665131:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae520f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.665139:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae520f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.665146:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.665151:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae520f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.665158:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae520f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.665169:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7b00) 00010000:00010000:0.0:1763343032.665172:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343032.665176:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae520f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.665183:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae520f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343032.665231:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5208 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b7f expref: 241 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.665241:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7b00) 00010000:00010000:0.0:1763343032.665244:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343032.665248:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5208 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b7f expref: 241 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.665263:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f200, rc 0) 00000100:00100000:0.0:1763343032.665314:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56832:x1848997993444480:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 7849us (8082us total) trans 8589939707 rc 301/301 00000100:00100000:0.0:1763343032.665322:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9018 00000100:00100000:2.0:1763343032.667542:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.667814:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993445120 00000100:00100000:1.0:1763343032.667827:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993445120 00000100:00100000:1.0:1763343032.667897:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3064 00000100:00100000:1.0:1763343032.667908:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56834:x1848997993445120:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343032.668315:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56834:x1848997993445120:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 408us (782us total) trans 8589939708 rc 0/0 00000100:00100000:1.0:1763343032.668324:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3064 00000100:00100000:1.0:1763343032.670992:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.671552:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993445376 00000100:00100000:2.0:1763343032.671568:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993445376 00000100:00100000:2.0:1763343032.671841:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3065 00000100:00100000:2.0:1763343032.671856:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56832:x1848997993445376:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343032.672199:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56832:x1848997993445376:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 346us (1230us total) trans 8589939709 rc 0/0 00000100:00100000:2.0:1763343032.672207:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3065 00000100:00100000:0.0:1763343032.674419:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.674534:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993445632 00000100:00100000:3.0:1763343032.674549:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993445632 00000100:00100000:3.0:1763343032.674851:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9020 00000100:00100000:3.0:1763343032.674864:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56834:x1848997993445632:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343032.674895:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.674927:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5232 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b8d expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.675052:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5239 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675070:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5239 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675084:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5239 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675097:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5240 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675106:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5240 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675112:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5240 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675260:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5247 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675283:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5247 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675290:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5247 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343032.675302:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ca:0x0]: returning size 0 00010000:00010000:3.0:1763343032.675404:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5239 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675412:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5239 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675419:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5239 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675425:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.675430:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5239 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675439:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5239 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675453:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53ac00) 00010000:00010000:3.0:1763343032.675457:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.675463:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5239 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675469:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5239 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675485:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5240 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675495:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5240 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675501:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5240 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675505:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.675508:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5240 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675513:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5240 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675519:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdeb00) 00010000:00010000:3.0:1763343032.675521:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.675524:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5240 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675530:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5240 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.675571:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5232 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b8d expref: 245 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.675589:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5247 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b8d expref: 244 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.675596:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a350b53a800) 00010000:00010000:3.0:1763343032.675598:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343032.675600:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343032.675714:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56834:x1848997993445632:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 853us (1310us total) trans 8589939710 rc 0/0 00000100:00100000:3.0:1763343032.675723:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9020 00000100:00100000:3.0:1763343032.681397:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.681568:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993445888 00000100:00100000:2.0:1763343032.681583:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993445888 00000100:00100000:2.0:1763343032.681690:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3066 00000100:00100000:2.0:1763343032.681703:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56832:x1848997993445888:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343032.682021:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56832:x1848997993445888:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 319us (639us total) trans 8589939711 rc 0/0 00000100:00100000:2.0:1763343032.682030:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3066 00000100:00100000:1.0:1763343032.686651:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.686754:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.686857:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993446016 00000100:00100000:0.0:1763343032.686871:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993446016 00000100:00100000:0.0:1763343032.686947:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993446144 00000100:00100000:0.0:1763343032.686951:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993446144 00000100:00100000:0.0:1763343032.686997:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6296 00000100:00100000:0.0:1763343032.687009:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2431:x1848997993446016:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343032.687035:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.687064:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae5255 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b94 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343032.687095:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343032.687122:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.687125:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.687137:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae5255 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b94 expref: 22 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343032.687157:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae5255 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b94 expref: 22 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343032.687173:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665cc00, rc 0) 00000100:00100000:0.0:1763343032.687241:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2431:x1848997993446016:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 233us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.687249:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6296 00000100:00100000:1.0:1763343032.687399:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6297 00000100:00100000:1.0:1763343032.687410:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2431:x1848997993446144:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.687420:0:10294:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.687435:0:10294:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae525c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8b9b expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343032.687458:0:10294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x288:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343032.687469:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.687470:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.687475:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae525c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b9b expref: 14 pid: 10294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343032.687486:0:10294:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae525c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b9b expref: 14 pid: 10294 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343032.687495:0:10294:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:1.0:1763343032.687516:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2431:x1848997993446144:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 111us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.687523:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6297 00000100:00100000:3.0:1763343032.692851:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.693017:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.693062:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993446400 00000100:00100000:2.0:1763343032.693076:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993446400 00000100:00100000:0.0:1763343032.693123:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993446528 00000100:00100000:0.0:1763343032.693131:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993446528 00000100:00100000:2.0:1763343032.693164:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9021 00000100:00100000:0.0:1763343032.693175:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9022 00000100:00100000:2.0:1763343032.693181:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:55941:x1848997993446400:12345-192.168.204.21@tcp:101:bash.0 00000100:00100000:0.0:1763343032.693192:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56834:x1848997993446528:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343032.693219:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.693224:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343032.693263:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5247 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b8d expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.693283:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a350b53a800) 00010000:00010000:2.0:1763343032.693296:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343032.693316:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5263 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ba2 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.693328:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.693343:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae526a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ba9 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.693399:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae526a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ba9 expref: 247 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.693413:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae526a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ba9 expref: 247 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.693434:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:0.0:1763343032.693438:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343032.693442:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665ce00, rc 0) 00010000:00010000:2.0:1763343032.693451:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae5271 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.693464:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae5271 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.693474:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae5271 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343032.693488:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ca:0x0]: returning size 0 00010000:00010000:2.0:1763343032.693662:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5263 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ba2 expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.693678:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae5271 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ba2 expref: 248 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.693684:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:2.0:1763343032.693687:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1763343032.693690:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3ea00, rc 0) 00000100:00100000:0.0:1763343032.693803:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56834:x1848997993446528:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 616us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.693811:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9022 00000100:00100000:2.0:1763343032.694226:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:55941:x1848997993446400:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1049us (1390us total) trans 8589939712 rc 0/0 00000100:00100000:2.0:1763343032.694234:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9021 00000100:00100000:0.0:1763343032.696693:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.696735:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.696837:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993446912 00000100:00100000:2.0:1763343032.696851:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993446912 00000100:00100000:2.0:1763343032.696917:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9023 00000100:00100000:2.0:1763343032.696928:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:55941:x1848997993446912:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343032.696958:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.696999:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae527f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8bb0 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.697042:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5286 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.697058:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5286 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.697072:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5286 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.697219:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae527f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bb0 expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.697240:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5286 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bb0 expref: 248 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.697250:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:2.0:1763343032.697253:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343032.697256:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3e200, rc 0) 00000100:00100000:2.0:1763343032.697357:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:55941:x1848997993446912:12345-192.168.204.21@tcp:101:bash.0 Request processed in 429us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.697368:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9023 00000100:00100000:1.0:1763343032.697461:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993446784 00000100:00100000:1.0:1763343032.697467:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993446784 00000100:00100000:1.0:1763343032.697508:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3067 00000100:00100000:1.0:1763343032.697516:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56834:x1848997993446784:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343032.697732:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56834:x1848997993446784:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 216us (1052us total) trans 8589939713 rc 0/0 00000100:00100000:1.0:1763343032.697739:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3067 00000100:00100000:1.0:1763343032.702115:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.702274:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.702464:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993447168 00000100:00100000:3.0:1763343032.702478:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993447168 00000100:00100000:3.0:1763343032.702550:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993447424 00000100:00100000:3.0:1763343032.702553:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993447424 00000100:00100000:3.0:1763343032.702578:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9024 00000100:00100000:3.0:1763343032.702588:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:55941:x1848997993447168:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:3.0:1763343032.702696:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343032.702734:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae5271 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ba2 expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.702760:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:3.0:1763343032.702767:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343032.703005:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae528d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.703021:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae528d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.703031:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae528d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000001:00080000:3.0:1763343032.703085:0:28422:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939714 00000004:00010000:3.0:1763343032.703108:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000493a9f32 reply state 00000000b9339f54 transno 8589939715 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae528d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.703121:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae528d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.703128:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:3.0:1763343032.703131:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343032.703134:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343032.703244:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:55941:x1848997993447168:12345-192.168.204.21@tcp:36:bash.0 Request processed in 656us (1145us total) trans 8589939715 rc 0/0 00000100:00100000:3.0:1763343032.703252:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9024 00000020:00080000:3.0:1763343032.703258:0:28422:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343032.703291:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9025 00000100:00100000:3.0:1763343032.703299:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56834:x1848997993447424:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343032.703311:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.703326:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae5294 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8bb7 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.703387:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae529b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.703397:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae529b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.703404:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae529b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.703415:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae52a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.703423:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae52a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.703429:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae52a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.703533:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae52a9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.703543:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae52a9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.703551:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae52a9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343032.703561:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ca:0x0]: returning size 0 00010000:00010000:2.0:1763343032.703879:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae529b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.703890:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae529b lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.703898:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae529b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.703904:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.703909:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae529b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.703917:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae529b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.703928:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53ac00) 00010000:00010000:2.0:1763343032.703930:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.703935:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae529b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.703941:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae529b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.703953:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae52a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.703959:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae52a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.703965:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae52a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.703991:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.703994:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae52a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.703999:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae52a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.704013:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdeb00) 00010000:00010000:2.0:1763343032.704015:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.704018:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae52a2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.704024:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae52a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.704071:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae5294 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bb7 expref: 254 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.704089:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae52a9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bb7 expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.704096:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:2.0:1763343032.704098:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343032.704101:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93a00, rc 0) 00000100:00100000:2.0:1763343032.704151:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56834:x1848997993447424:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 851us (1876us total) trans 8589939716 rc 0/0 00000100:00100000:2.0:1763343032.704159:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9025 00000100:00100000:1.0:1763343032.707664:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.708113:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993447680 00000100:00100000:2.0:1763343032.708128:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993447680 00000100:00100000:2.0:1763343032.708199:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3068 00000100:00100000:2.0:1763343032.708209:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56834:x1848997993447680:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343032.708403:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.708570:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56834:x1848997993447680:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 360us (958us total) trans 8589939717 rc 0/0 00000100:00100000:2.0:1763343032.708579:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3068 00000100:00100000:0.0:1763343032.709051:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993447936 00000100:00100000:0.0:1763343032.709059:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993447936 00000100:00100000:0.0:1763343032.709116:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9026 00000100:00100000:0.0:1763343032.709125:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:55941:x1848997993447936:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343032.709143:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.709148:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343032.709183:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae526a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ba9 expref: 254 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.709208:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:0.0:1763343032.709215:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343032.709231:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae52b7 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8bbe expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.709290:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae52be lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.709306:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae52a9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bb7 expref: 254 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.709317:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae52be lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.709366:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae52a9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bb7 expref: 254 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.709383:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae52a9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bb7 expref: 254 pid: 28422 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343032.709399:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010230400:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343032.709490:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340468ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1763343032.713861:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.713959:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993448064 00000100:00100000:3.0:1763343032.714301:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993448064 00000100:00100000:3.0:1763343032.714371:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3069 00000100:00100000:3.0:1763343032.714382:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56834:x1848997993448064:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:3.0:1763343032.714612:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56834:x1848997993448064:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 230us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.714645:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3069 00000100:00100000:2.0:1763343032.716302:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.716437:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010230400:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343032.716495:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae52be lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343032.718301:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993448192 00000100:00100000:3.0:1763343032.718320:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993448192 00010000:00010000:3.0:1763343032.718381:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae52a9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bb7 expref: 255 pid: 28422 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1763343032.718432:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2966 00000100:00100000:3.0:1763343032.718442:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:2429:x1848997993448192:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343032.718462:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343032.718470:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae52a9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bb7 expref: 255 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343032.718490:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae52a9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bb7 expref: 255 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343032.718518:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae52a9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bb7 expref: 255 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343032.718537:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:3.0:1763343032.718544:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae52be lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.718556:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae52be lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.718564:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae52be lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.718599:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343032.718697:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:2429:x1848997993448192:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 256us (2405us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.718705:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2966 00010000:00010000:0.0:1763343032.720098:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae52be lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.720121:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae52be lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:0.0:1763343032.720448:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1349, 88 off114472 00000004:00080000:0.0:1763343032.720458:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226387836004ns, next at 1227177401661ns, rc = 0 00000040:00080000:0.0:1763343032.721478:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1350, 88 off114472 00000004:00080000:0.0:1763343032.721492:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226388871048ns, next at 1227177369372ns, rc = 0 00000040:00080000:0.0:1763343032.721524:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1351, 88 off114560 00000004:00080000:0.0:1763343032.721529:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226388907963ns, next at 1227177369372ns, rc = 0 00000040:00080000:0.0:1763343032.721540:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1350, 88 off114560 00000004:00080000:0.0:1763343032.721544:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226388923334ns, next at 1227177401661ns, rc = 0 00000001:00080000:2.0:1763343032.725521:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939718 is committed 00000004:00080000:2.0:1763343032.725537:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 891 committed 00000004:00080000:2.0:1763343032.725556:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 890 committed 00000004:00080000:2.0:1763343032.725569:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 889 committed 00000004:00080000:2.0:1763343032.725571:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 890 committed 00000100:00100000:0.0:1763343032.725870:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010230912:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343032.725952:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5160 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00000100:00100000:0.0:1763343032.725961:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343032.725977:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5160 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.725986:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5160 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.725992:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.725998:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5160 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.726006:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5160 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00000100:00100000:0.0:1763343032.726024:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1763343032.726026:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdeb00) 00010000:00010000:1.0:1763343032.726030:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.726036:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5160 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.726042:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5160 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.726063:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.726068:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.726075:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.726080:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.726082:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.726088:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.726096:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdeb00) 00010000:00010000:1.0:1763343032.726099:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.726102:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51f3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.726109:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae51f3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343032.726130:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae528d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.726136:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae528d lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.726141:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae528d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.726146:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.726149:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae528d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.726155:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae528d lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.726164:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:1.0:1763343032.726167:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.726170:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae528d lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.726176:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae528d lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343032.726182:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010231040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343032.726214:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343032.726240:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae52be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bbe expref: 232 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343032.726245:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763343032.726250:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010231424:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1763343032.726250:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:1.0:1763343032.726253:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343032.726269:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae52b7 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bbe expref: 232 pid: 28422 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1763343032.726281:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343032.726285:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae52be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bbe expref: 231 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.726321:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:1.0:1763343032.726324:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343032.726326:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c400, rc 0) 00000100:00100000:3.0:1763343032.727244:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010230912 00000100:00100000:3.0:1763343032.727263:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010230912 00000100:00100000:3.0:1763343032.727332:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010231040 00000100:00100000:3.0:1763343032.727335:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010231040 00000100:00100000:1.0:1763343032.727351:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:55941:x1848997993447936:12345-192.168.204.21@tcp:101:bash.0 Request processed in 18223us (18947us total) trans 8589939718 rc 0/0 00000100:00100000:3.0:1763343032.727356:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010231424 00000100:00100000:3.0:1763343032.727358:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010231424 00000100:00100000:1.0:1763343032.727362:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9026 00000100:00100000:3.0:1763343032.727380:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6298 00000100:00100000:3.0:1763343032.727388:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3657:x1848998010230912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343032.727640:0:28996:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343032.727645:0:28996:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343032.727648:0:28996:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343032.727650:0:28996:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343032.727653:0:28996:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343032.727720:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3657:x1848998010230912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 332us (1757us total) trans 21474838795 rc 0/0 00000100:00100000:3.0:1763343032.727728:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6298 00000100:00100000:3.0:1763343032.727745:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6299 00000100:00100000:3.0:1763343032.727752:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3658:x1848998010231040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343032.727770:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:647 count 1 00010000:00010000:3.0:1763343032.727798:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae52c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.727818:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae5113 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b32 expref: 21 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.727828:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343032.727831:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343032.727835:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae52c5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.727878:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae5113 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b32 expref: 21 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.727893:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae5113 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b32 expref: 21 pid: 28994 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1763343032.727909:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010231552:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343032.727990:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6300 00000100:00100000:3.0:1763343032.727998:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c300 going to sleep for 11 seconds 00000100:00100000:2.0:1763343032.728005:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3658:x1848998010231424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.728122:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010230528:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.728161:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1763343032.728206:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f38000/2, rc 0, transno 21474838795 00000100:00100000:0.0:1763343032.728213:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010230912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.728234:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010230656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.728253:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.728277:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010231168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.728296:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.728313:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1763343032.728317:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010230784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.728333:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.728345:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010231296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.728360:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.728392:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010230528 00000100:00100000:0.0:1763343032.728398:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010230528 00000100:00100000:0.0:1763343032.728427:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010230656 00000100:00100000:0.0:1763343032.728430:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010230656 00000100:00100000:0.0:1763343032.728448:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010231168 00000100:00100000:0.0:1763343032.728451:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010231168 00000100:00100000:0.0:1763343032.728466:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010230784 00000100:00100000:0.0:1763343032.728469:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010230784 00000100:00100000:0.0:1763343032.728478:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010231296 00000100:00100000:0.0:1763343032.728480:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010231296 00000100:00100000:0.0:1763343032.728492:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6301 00000100:00100000:0.0:1763343032.728499:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3657:x1848998010230528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343032.728513:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:645 count 1 00010000:00010000:0.0:1763343032.728529:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae52cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.728543:0:28993:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae513d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b40 expref: 13 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.728550:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343032.728552:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343032.728555:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae52cc lrc: 4/0,1 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.728576:0:28993:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae513d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b40 expref: 13 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.728585:0:28993:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae513d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b40 expref: 13 pid: 28993 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343032.728597:0:28993:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340465d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010231680:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343032.728651:0:28993:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340468fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343032.728666:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6302 00000100:00100000:0.0:1763343032.728673:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3659:x1848998010230656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343032.728684:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:646 count 1 00002000:00010000:0.0:1763343032.728705:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x286:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343032.728710:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665da00/0x607405d401ae52d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.728717:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.728719:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.728724:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665da00/0x607405d401ae52d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.728737:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665da00/0x607405d401ae52d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.728745:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665da00/0x607405d401ae52d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.728752:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665da00/0x607405d401ae52d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.728768:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343032.728986:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010230656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 311us (729us total) trans 21474838796 rc 0/0 00000100:00100000:0.0:1763343032.728996:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6302 00000100:00100000:0.0:1763343032.729013:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6303 00000100:00100000:0.0:1763343032.729019:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3659:x1848998010231168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343032.729030:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:648 count 1 00002000:00010000:0.0:1763343032.729049:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x288:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343032.729054:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae52da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.729062:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.729064:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.729068:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae52da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.729078:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae52da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.729085:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae52da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.729092:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae52da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.729107:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763343032.729236:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3659:x1848998010231168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 216us (938us total) trans 17179871497 rc 0/0 00000100:00100000:0.0:1763343032.729242:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6303 00000100:00100000:0.0:1763343032.729255:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6304 00000100:00100000:0.0:1763343032.729261:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3659:x1848998010230784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.729347:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010230784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (1012us total) trans 21474838797 rc 0/0 00000100:00100000:0.0:1763343032.729354:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6304 00000100:00100000:0.0:1763343032.729366:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6305 00000100:00100000:0.0:1763343032.729372:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3659:x1848998010231296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763343032.729398:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343032.729402:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343032.729405:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343032.729407:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343032.729410:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343032.729437:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3659:x1848998010231296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (1076us total) trans 17179871499 rc 0/0 00000100:00100000:0.0:1763343032.729444:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6305 00000100:00100000:2.0:1763343032.729446:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3658:x1848998010231424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1444us (3164us total) trans 17179871498 rc 0/0 00000100:00100000:2.0:1763343032.729457:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6300 00010000:00010000:1.0:1763343032.729768:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763343032.729777:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665da00/0x607405d401ae52d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.729786:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665da00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343032.729790:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665da00/0x607405d401ae52d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.729800:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665da00/0x607405d401ae52d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.729827:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665da00/0x607405d401ae52d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.729834:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665da00/0x607405d401ae52d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.729854:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343032.729858:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae52da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.729866:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343032.729869:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae52da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.729876:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae52da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.729885:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae52da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.729892:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d000/0x607405d401ae52da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.729904:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343032.729905:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343032.729907:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763343032.730103:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c38a80/2, rc 0, transno 17179871498 00000100:00100000:2.0:1763343032.730109:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010231424:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763343032.730925:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343032.732308:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f3b100/2, rc 0, transno 21474838797 00000100:00100000:0.0:1763343032.732326:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010230784:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343032.732371:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c3aa00/2, rc 0, transno 17179871499 00000100:00100000:0.0:1763343032.732378:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010231296:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343032.732392:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f3b800/2, rc 0, transno 21474838796 00000100:00100000:0.0:1763343032.732396:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010230656:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1763343032.732408:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c38700/2, rc 0, transno 17179871497 00000100:00100000:0.0:1763343032.732412:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010231168:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763343032.732689:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343032.733335:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.734846:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993448448 00000100:00100000:1.0:1763343032.734864:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993448448 00000100:00100000:1.0:1763343032.734953:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9027 00000100:00100000:1.0:1763343032.734964:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56835:x1848997993448448:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.735002:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.735034:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae52e1 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8bc5 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.735142:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae52e8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.735160:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae52e8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.735179:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae52e8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.735193:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae52ef lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.735200:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae52ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.735205:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae52ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.735542:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae52f6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.735552:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae52f6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.735559:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae52f6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343032.735574:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ca:0x0]: returning size 2 00010000:00010000:1.0:1763343032.736312:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae52e8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.736323:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae52e8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.736330:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae52e8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.736335:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.736340:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae52e8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.736346:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae52e8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.736361:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde900) 00010000:00010000:1.0:1763343032.736364:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.736368:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae52e8 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.736373:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae52e8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.736388:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae52ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.736393:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae52ef lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.736398:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae52ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.736408:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.736410:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae52ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.736416:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae52ef lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.736421:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdea00) 00010000:00010000:1.0:1763343032.736423:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.736425:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae52ef lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.736430:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae52ef lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.736485:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae52e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bc5 expref: 234 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.736499:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae52f6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bc5 expref: 233 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.736505:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:1.0:1763343032.736507:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343032.736509:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:0.0:1763343032.737466:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.737489:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.737507:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.737606:0:28993:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340465d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010231680:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343032.737672:0:28993:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae52cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343032.737708:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993448576 00000100:00100000:2.0:1763343032.737716:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993448576 00010000:00010000:2.0:1763343032.737756:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae5113 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b32 expref: 22 pid: 28994 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343032.737770:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56835:x1848997993448448:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2807us (4440us total) trans 8589939719 rc 0/0 00000100:00100000:1.0:1763343032.737781:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9027 00000100:00100000:2.0:1763343032.737789:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993448832 00000100:00100000:2.0:1763343032.737793:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993448832 00010000:00010000:2.0:1763343032.737804:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae513d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b40 expref: 14 pid: 28993 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343032.737832:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2967 00000100:00100000:1.0:1763343032.737838:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2968 00000100:00100000:2.0:1763343032.737842:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993448576:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763343032.737846:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993448832:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343032.737859:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343032.737859:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343032.737865:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae5113 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b32 expref: 22 pid: 28994 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1763343032.737865:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae513d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b40 expref: 14 pid: 28993 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.737877:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae5113 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b32 expref: 22 pid: 28994 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1763343032.737877:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae513d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b40 expref: 14 pid: 28993 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1763343032.737900:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae513d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b40 expref: 14 pid: 28993 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.737902:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.737905:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.737911:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae52c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.737912:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.737914:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.737917:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae52cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.737923:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae52c5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.737925:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae52cc lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.737942:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343032.737946:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343032.738011:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993448832:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 165us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.738018:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2968 00000100:00100000:3.0:1763343032.738022:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993448704 00000100:00100000:3.0:1763343032.738026:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993448704 00010000:00010000:1.0:1763343032.738039:0:28993:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae52cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.738047:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae52cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343032.738055:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6306 00000100:00100000:3.0:1763343032.738061:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:55941:x1848997993448704:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343032.738062:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae52cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.738070:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae52cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.738076:0:15756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.738086:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343032.738095:0:15756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5304 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8bcc expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343032.738118:0:15756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343032.738134:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343032.738136:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343032.738143:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5304 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bcc expref: 14 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.738156:0:15756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5304 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bcc expref: 14 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.738167:0:15756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92c00, rc 0) 00010000:00010000:0.0:1763343032.739649:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343032.739663:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae52cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.739676:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343032.739683:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae52cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.739694:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae52cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.739716:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae52cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.739725:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae52cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.739749:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.739751:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.739753:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343032.739831:0:28996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae5113 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b32 expref: 22 pid: 28994 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343032.739844:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010231552:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343032.739870:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae52c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.739881:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae52c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.739889:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae52c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.739903:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae52c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.739912:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae52c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.739934:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343032.740123:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3657:x1848998010230528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11620us (11958us total) trans 21474838798 rc 0/0 00000100:00100000:1.0:1763343032.740136:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6301 00010000:00010000:1.0:1763343032.740187:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343032.740192:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae52c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.740199:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343032.740202:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae52c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.740210:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae52c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.740224:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae52c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.740231:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93a00/0x607405d401ae52c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343032.740236:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+33:3658:x1848998010231040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12485us (14021us total) trans 17179871500 rc 0/0 00000100:00100000:0.0:1763343032.740243:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6299 00010000:00010000:1.0:1763343032.740254:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343032.740256:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343032.740258:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343032.740313:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c3bb80/2, rc 0, transno 17179871500 00000100:00100000:0.0:1763343032.740320:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010231040:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1763343032.740326:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f38380/2, rc 0, transno 21474838798 00000100:00100000:1.0:1763343032.740331:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010230528:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343032.740668:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993448576:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 2825us (3174us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.740679:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2967 00000100:00100000:3.0:1763343032.741165:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:55941:x1848997993448704:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1413us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.741175:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6306 00000100:00100000:0.0:1763343032.743516:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.743791:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993448960 00000100:00100000:3.0:1763343032.743805:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993448960 00000100:00100000:3.0:1763343032.743877:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6307 00000100:00100000:3.0:1763343032.743890:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993448960:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343032.743913:0:15756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.743941:0:15756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae530b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8bd3 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343032.744127:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.744146:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010231808:192.168.204.21@tcp:106: 00000100:00100000:1.0:1763343032.744191:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993449088 00000100:00100000:1.0:1763343032.744197:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993449088 00000100:00100000:3.0:1763343032.744252:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343032.744384:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6308 00000100:00100000:1.0:1763343032.744396:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:55941:x1848997993449088:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343032.744405:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.744423:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae5312 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8bda expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343032.744450:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x289:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343032.744467:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.744469:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.744480:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae5312 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bda expref: 22 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.744497:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae5312 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bda expref: 22 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.744511:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00000100:00100000:1.0:1763343032.744542:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:55941:x1848997993449088:12345-192.168.204.21@tcp:101:bash.0 Request processed in 148us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.744549:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6308 00002000:00010000:3.0:1763343032.746873:0:15756:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb mtime: 0 -> 1763343032 00000100:00100000:0.0:1763343032.746873:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00002000:00010000:3.0:1763343032.746878:0:15756:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb atime: 0 -> 1763343032 00002000:00010000:3.0:1763343032.746881:0:15756:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb ctime: 0 -> 1763343032 00000100:00100000:3.0:1763343032.746905:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010231808:192.168.204.21@tcp:106: 00000100:00100000:0.0:1763343032.746929:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343032.746948:0:15756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae530b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bd3 expref: 15 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343032.746984:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae530b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bd3 expref: 15 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343032.746999:0:15756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:1.0:1763343032.746999:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993449344 00000100:00100000:1.0:1763343032.747009:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993449344 00002000:00010000:1.0:1763343032.747055:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/649 (0->18446744073709551615) 00002000:00100000:1.0:1763343032.747060:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34059d4e00 with x1848997993449344 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343032.747077:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34059d4e00. 00000100:00100000:3.0:1763343032.747141:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993448960:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3250us (3635us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343032.747150:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6307 00000100:00100000:1.0:1763343032.747270:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993449216 00000100:00100000:1.0:1763343032.747274:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993449216 00002000:00010000:1.0:1763343032.747287:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/647 (0->18446744073709551615) 00002000:00100000:1.0:1763343032.747291:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34059d4a80 with x1848997993449216 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343032.747297:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34059d4a80. 00000100:00100000:2.0:1763343032.747328:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1550 00000100:00100000:3.0:1763343032.747335:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1551 00000100:00100000:2.0:1763343032.747340:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993449344:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:3.0:1763343032.747342:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993449216:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343032.747538:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343032.747538:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x289:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343032.747542:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00002000:00010000:2.0:1763343032.747542:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x289:0x0] updating lvb mtime from disk: 0 -> 1763343032 00002000:00010000:3.0:1763343032.747545:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb atime from disk: 1763343032 -> 0 00002000:00010000:2.0:1763343032.747545:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x289:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343032.747548:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:2.0:1763343032.747548:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x289:0x0] updating lvb ctime from disk: 0 -> 1763343032 00002000:00010000:2.0:1763343032.747551:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x289:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1763343032.747552:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343032.747590:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993449216:12345-192.168.204.21@tcp:10:bash.0 Request processed in 248us (659us total) trans 21474838799 rc 0/0 00000100:00100000:3.0:1763343032.747597:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1551 00002000:00010000:3.0:1763343032.747602:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/647 (0->18446744073709551615) 00002000:00100000:3.0:1763343032.747605:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34059d4a80 with x1848997993449216 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343032.747609:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34059d4a80. 00000100:00100000:2.0:1763343032.748207:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2429:x1848997993449344:12345-192.168.204.21@tcp:10:bash.0 Request processed in 865us (1341us total) trans 17179871501 rc 0/0 00000100:00100000:2.0:1763343032.748216:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1550 00002000:00010000:2.0:1763343032.748220:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/649 (0->18446744073709551615) 00002000:00100000:2.0:1763343032.748223:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34059d4e00 with x1848997993449344 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343032.748234:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34059d4e00. 00000100:00100000:0.0:1763343032.751757:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.751862:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993449600 00000100:00100000:1.0:1763343032.751877:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993449600 00000100:00100000:1.0:1763343032.751951:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3070 00000100:00100000:1.0:1763343032.751961:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56835:x1848997993449600:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343032.752274:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56835:x1848997993449600:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 313us (531us total) trans 8589939720 rc 0/0 00000100:00100000:1.0:1763343032.752283:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3070 00000100:00100000:1.0:1763343032.752934:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.753006:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993449856 00000100:00100000:3.0:1763343032.753014:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993449856 00000100:00100000:3.0:1763343032.753060:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3071 00000100:00100000:3.0:1763343032.753069:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:55941:x1848997993449856:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:3.0:1763343032.753345:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:55941:x1848997993449856:12345-192.168.204.21@tcp:35:bash.0 Request processed in 276us (413us total) trans 8589939721 rc 0/0 00000100:00100000:3.0:1763343032.753353:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3071 00000100:00100000:0.0:1763343032.754855:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.755010:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993450112 00000100:00100000:1.0:1763343032.755021:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993450112 00000100:00100000:1.0:1763343032.755079:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9028 00000100:00100000:1.0:1763343032.755089:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56835:x1848997993450112:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.755117:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.755143:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5319 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8be1 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.755279:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.755298:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae52f6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bc5 expref: 236 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.755309:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.755353:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae52f6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bc5 expref: 236 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.755369:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae52f6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bc5 expref: 236 pid: 28422 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343032.755399:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34050f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010231936:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343032.755509:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe540 going to sleep for 11 seconds 00000100:00100000:0.0:1763343032.763529:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.763807:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993450368 00000100:00100000:3.0:1763343032.763822:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993450368 00000100:00100000:3.0:1763343032.763909:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9029 00000100:00100000:3.0:1763343032.763920:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56836:x1848997993450368:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:3.0:1763343032.764006:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1763343032.764042:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae52be lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bbe expref: 237 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.764068:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5286 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bb0 expref: 236 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.764080:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:3.0:1763343032.764086:0:10041:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.764098:0:10041:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.764105:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343032.764139:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5327 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.764151:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5327 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.764161:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5327 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.764173:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae532e lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.764179:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae532e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.764186:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae532e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.764344:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.764353:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.764359:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.764377:0:10041:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343032.764393:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:0.0:1763343032.765238:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.765266:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34050f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010231936:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343032.765295:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343032.765360:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993450496 00000100:00100000:2.0:1763343032.765369:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993450496 00010000:00010000:2.0:1763343032.765407:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae52f6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bc5 expref: 236 pid: 28422 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343032.765453:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2969 00000100:00100000:2.0:1763343032.765464:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:2430:x1848997993450496:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343032.765480:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343032.765486:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae52f6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bc5 expref: 236 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.765497:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae52f6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bc5 expref: 236 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.765517:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae52f6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bc5 expref: 236 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.765534:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:2.0:1763343032.765538:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.765548:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.765554:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.765561:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.765571:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.765590:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343032.765678:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:2430:x1848997993450496:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 215us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.765686:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2969 00010000:00010000:0.0:1763343032.765815:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.765825:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343032.765854:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ca:0x0]: returning size 5 00010000:00010000:1.0:1763343032.766068:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5319 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8be1 expref: 236 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.766092:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8be1 expref: 235 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1763343032.766101:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8be1 expref: 235 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1763343032.766109:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:1.0:1763343032.766156:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56835:x1848997993450112:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 11069us (11311us total) trans 8589939722 rc 0/0 00000100:00100000:1.0:1763343032.766164:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9028 00000100:00100000:0.0:1763343032.770026:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.770895:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.770985:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993450752 00000100:00100000:2.0:1763343032.770999:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993450752 00010000:00010000:2.0:1763343032.771055:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8be1 expref: 235 pid: 28422 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343032.771106:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2970 00000100:00100000:2.0:1763343032.771117:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:2431:x1848997993450752:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343032.771138:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343032.771145:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8be1 expref: 235 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.771159:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8be1 expref: 235 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.771187:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5320 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1ca:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8be1 expref: 235 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.771209:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:2.0:1763343032.771216:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.771232:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.771240:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00000100:00100000:1.0:1763343032.771428:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993450624 00000100:00100000:1.0:1763343032.771434:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993450624 00000100:00100000:1.0:1763343032.771481:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9030 00000100:00100000:1.0:1763343032.771489:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56835:x1848997993450624:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.771514:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.771534:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5343 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8be8 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.771692:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae534a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.771705:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.771713:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae534a lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.771729:0:28422:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 5/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.771741:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae534a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.771929:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343032.772020:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:2431:x1848997993450752:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 902us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.772029:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2970 00010000:00010000:0.0:1763343032.772117:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343032.772126:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00000004:00080000:1.0:1763343032.774332:0:10041:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1ca:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1763343032.774464:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774477:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774486:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774493:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.774498:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774506:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774522:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:1.0:1763343032.774526:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343032.774529:0:10041:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae534a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.774540:0:10041:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae534a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.774547:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae534a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.774598:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774606:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5335 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774663:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5327 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774671:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5327 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774677:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5327 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774684:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5327 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774688:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.774691:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5327 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774698:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5327 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774706:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53aa00) 00010000:00010000:1.0:1763343032.774709:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.774713:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5327 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774719:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5327 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00010000:1.0:1763343032.774737:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d0ed3eb1 reply state 000000007c043108 transno 8589939723 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae532e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774750:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae532e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.774756:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ac00) 00010000:00010000:1.0:1763343032.774759:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343032.774762:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343032.774874:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56836:x1848997993450368:12345-192.168.204.21@tcp:36:rm.0 Request processed in 10949us (11356us total) trans 8589939723 rc 0/0 00000100:00100000:1.0:1763343032.774885:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9029 00010000:00010000:2.0:1763343032.775066:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae534a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.775075:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae534a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343032.775112:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ca:0x0]: returning size 5 00000004:00200000:2.0:1763343032.775118:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343032.775138:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae534a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.775173:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5343 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8be8 expref: 237 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.775191:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae534a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8be8 expref: 236 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.775199:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:2.0:1763343032.775202:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343032.775205:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:2.0:1763343032.775250:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56835:x1848997993450624:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3761us (5240us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.775258:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9030 00000100:00100000:1.0:1763343032.780997:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.781908:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993451008 00000100:00100000:2.0:1763343032.781927:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993451008 00000100:00100000:2.0:1763343032.782043:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9031 00000100:00100000:2.0:1763343032.782057:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56835:x1848997993451008:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343032.782099:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.782131:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5351 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8bef expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.782287:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5358 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.782304:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5358 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.782316:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5358 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343032.782331:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ca:0x0]: returning size 5 00010000:00010000:2.0:1763343032.782492:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5351 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bef expref: 239 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.782515:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5358 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bef expref: 238 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.782526:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:2.0:1763343032.782529:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343032.782534:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f000, rc 0) 00000100:00100000:2.0:1763343032.782646:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56835:x1848997993451008:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 565us (1638us total) trans 8589939724 rc 0/0 00000100:00100000:2.0:1763343032.782655:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9031 00000100:00100000:0.0:1763343032.788668:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.788830:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993451136 00000100:00100000:3.0:1763343032.788845:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993451136 00000100:00100000:3.0:1763343032.788925:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6309 00000100:00100000:3.0:1763343032.788939:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993451136:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:3.0:1763343032.789020:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae5366 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.789049:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5304 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bcc expref: 15 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.789059:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343032.789062:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343032.789067:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae5366 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.789121:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5304 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bcc expref: 15 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.789139:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5304 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bcc expref: 15 pid: 15756 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1763343032.789159:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010232064:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343032.789276:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c300 going to sleep for 11 seconds 00000100:00100000:0.0:1763343032.792831:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010232064:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343032.792872:0:15756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae5366 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343032.795079:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.795200:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993451264 00000100:00100000:3.0:1763343032.795214:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993451264 00002000:00100000:3.0:1763343032.795291:0:28424:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x287:0x0] (0->4) req@ffff9a34052ac700 x1848997993451264/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:528/0 lens 496/0 e 0 to 0 dl 1763343043 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343032.795305:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34052ac700 with x1848997993451264 ext(0->4) 00010000:00010000:3.0:1763343032.795316:0:28424:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5304 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bcc expref: 16 pid: 15756 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343032.795333:0:28424:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5304 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bcc expref: 16 pid: 15756 timeout: 1326 lvb_type: 0 00002000:00010000:3.0:1763343032.795342:0:28424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a34052ac700 00000100:00100000:3.0:1763343032.795826:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 102 00000100:00100000:3.0:1763343032.795839:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993451264:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:0.0:1763343032.797648:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.798672:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993451264:12345-192.168.204.21@tcp:4:bash.0 Request processed in 2827us (3601us total) trans 21474838800 rc 0/0 00000100:00100000:3.0:1763343032.798689:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 102 00002000:00100000:3.0:1763343032.798705:0:28424:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x287:0x0] (0->4) req@ffff9a34052ac700 x1848997993451264/t21474838800(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:528/0 lens 496/448 e 0 to 0 dl 1763343043 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343032.798716:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34052ac700 with x1848997993451264 ext(0->4) 00010000:00010000:3.0:1763343032.798727:0:28424:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5304 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bcc expref: 18 pid: 15756 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343032.798745:0:28424:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5304 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bcc expref: 18 pid: 15756 timeout: 1326 lvb_type: 0 00002000:00010000:3.0:1763343032.798753:0:28424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a34052ac700 00000100:00100000:1.0:1763343032.798863:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993451392 00000100:00100000:1.0:1763343032.798874:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993451392 00000100:00100000:1.0:1763343032.798936:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9032 00000100:00100000:1.0:1763343032.798947:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56837:x1848997993451392:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.798983:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.799013:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae536d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8bf6 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.799101:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5374 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799117:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5374 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799134:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5374 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799146:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae537b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799153:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae537b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799159:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae537b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799204:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5374 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799212:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5374 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799218:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5374 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799226:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5374 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799232:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.799237:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5374 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799244:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5374 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799259:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde900) 00010000:00010000:1.0:1763343032.799320:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.799327:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5374 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799333:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5374 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799351:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae537b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799356:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae537b lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799361:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae537b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799366:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.799369:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae537b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799375:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae537b lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799397:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ac00) 00010000:00010000:1.0:1763343032.799399:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.799402:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae537b lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799407:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae537b lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.799436:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae536d lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bf6 expref: 239 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.799446:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde900) 00010000:00010000:1.0:1763343032.799448:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.799452:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae536d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bf6 expref: 239 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.799467:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343032.799525:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56837:x1848997993451392:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 579us (1911us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343032.799533:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9032 00000100:00100000:0.0:1763343032.803383:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.804375:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993451520 00000100:00100000:2.0:1763343032.804394:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993451520 00010000:00010000:2.0:1763343032.804456:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5304 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bcc expref: 18 pid: 15756 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343032.804515:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2971 00000100:00100000:2.0:1763343032.804526:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993451520:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343032.804546:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763343032.804571:0:13199:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763343032.804575:0:13199:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb atime from disk: 0 -> 1763343032 00002000:00010000:2.0:1763343032.804578:0:13199:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343032.804585:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5304 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bcc expref: 18 pid: 15756 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.804600:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5304 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bcc expref: 18 pid: 15756 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.804652:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5304 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bcc expref: 18 pid: 15756 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343032.804673:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.804676:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.804682:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae5366 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.804693:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae5366 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.804743:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343032.804773:0:15756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae5366 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.804784:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae5366 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.804808:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae5366 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343032.804813:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993451520:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 289us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.804822:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2971 00010000:00010000:1.0:1763343032.804823:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae5366 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.804831:0:15756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae5366 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.804838:0:15756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343032.804842:0:15756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae5366 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.804852:0:15756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae5366 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.804864:0:15756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae5366 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.804872:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae5366 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343032.804927:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993451136:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 15992us (16325us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.804937:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6309 00000100:00100000:0.0:1763343032.805132:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.805174:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993451648 00000100:00100000:1.0:1763343032.805180:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993451648 00000100:00100000:1.0:1763343032.805229:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9033 00000100:00100000:1.0:1763343032.805237:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56837:x1848997993451648:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.805258:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.805285:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5382 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8bfd expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.805373:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5389 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805388:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5389 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805399:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5389 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805410:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5390 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805417:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5390 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805423:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5390 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805471:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5389 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805477:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5389 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805482:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5389 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805489:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5389 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805494:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.805499:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5389 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805505:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5389 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805515:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdea00) 00010000:00010000:1.0:1763343032.805519:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.805523:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5389 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805529:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5389 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805542:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5390 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805548:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5390 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805553:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5390 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805558:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.805561:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5390 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805566:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5390 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805574:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ac00) 00010000:00010000:1.0:1763343032.805576:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.805579:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5390 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805588:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5390 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.805616:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5382 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bfd expref: 239 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.805645:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdea00) 00010000:00010000:1.0:1763343032.805648:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.805652:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5382 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bfd expref: 239 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.805666:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177a00, rc 0) 00000100:00100000:1.0:1763343032.805696:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56837:x1848997993451648:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 460us (565us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343032.805703:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9033 00000100:00100000:0.0:1763343032.808116:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.810020:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993451904 00000100:00100000:1.0:1763343032.810041:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993451904 00000100:00100000:1.0:1763343032.810136:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9034 00000100:00100000:1.0:1763343032.810148:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56835:x1848997993451904:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:1.0:1763343032.810218:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343032.810254:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae534a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8be8 expref: 238 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.810279:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:1.0:1763343032.810286:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343032.810325:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5397 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.810345:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5397 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.810355:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5397 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000040:00080000:1.0:1763343032.810688:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1351, 88 off114648 00000004:00080000:1.0:1763343032.810698:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226478076575ns, next at 1227177401661ns, rc = 0 00000040:00080000:1.0:1763343032.810746:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1352, 88 off114648 00000004:00080000:1.0:1763343032.810751:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226478130599ns, next at 1227177369372ns, rc = 0 00000040:00080000:1.0:1763343032.810950:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1354, 88 off114776 00000004:00080000:1.0:1763343032.810957:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226478335945ns, next at 1227177369372ns, rc = 0 00000040:00080000:1.0:1763343032.811057:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1353, 88 off114776 00000004:00080000:1.0:1763343032.811064:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226478442542ns, next at 1227177401661ns, rc = 0 00000001:00080000:2.0:1763343032.813253:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939725 is committed 00010000:00010000:3.0:1763343032.813410:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae532e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.813428:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae532e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.813437:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae532e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.813444:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.813450:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae532e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.813459:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae532e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.813481:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ac00) 00010000:00010000:3.0:1763343032.813485:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.813491:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae532e lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.813497:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae532e lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000100:00100000:0.0:1763343032.813851:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.813995:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993452032 00000100:00100000:1.0:1763343032.814011:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993452032 00000100:00100000:1.0:1763343032.814076:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9035 00000100:00100000:1.0:1763343032.814086:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56837:x1848997993452032:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.814114:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.814142:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae539e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c04 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.814216:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae53a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.814231:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae53a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343032.814243:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae53a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343032.814318:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343032.814325:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00080000:2.0:1763343032.814353:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 893 committed 00000004:00080000:2.0:1763343032.814362:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 892 committed 00010000:00010000:1.0:1763343032.814368:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae539e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c04 expref: 239 pid: 28422 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763343032.814370:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 891 committed 00000004:00080000:2.0:1763343032.814372:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 892 committed 00010000:00010000:1.0:1763343032.814389:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae53a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c04 expref: 232 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.814397:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde900) 00010000:00010000:1.0:1763343032.814399:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343032.814402:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343032.814487:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56837:x1848997993452032:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 402us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.814495:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9035 00000004:00010000:1.0:1763343032.814557:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f266606f reply state 000000007d88b5f8 transno 8589939725 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5397 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.814572:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5397 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.814577:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:1.0:1763343032.814580:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763343032.814583:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1763343032.814656:0:10041:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763343032.814670:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56835:x1848997993451904:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 4525us (6569us total) trans 8589939725 rc 0/0 00000100:00100000:1.0:1763343032.814677:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9034 00010000:00010000:1.0:1763343032.814698:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5397 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.814706:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5397 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.814712:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5397 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.814718:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.814722:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5397 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.814728:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5397 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.814737:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:1.0:1763343032.814740:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343032.814743:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5397 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343032.814748:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5397 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000100:00100000:2.0:1763343032.815033:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010232192:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343032.815069:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343032.815081:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010232320:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343032.815101:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343032.815127:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343032.815155:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010232192 00000100:00100000:3.0:1763343032.815160:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010232192 00000100:00100000:3.0:1763343032.815204:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010232320 00000100:00100000:3.0:1763343032.815208:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010232320 00000100:00100000:3.0:1763343032.815230:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6310 00000100:00100000:2.0:1763343032.815242:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6311 00000100:00100000:2.0:1763343032.815250:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3660:x1848998010232320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.815349:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343032.815360:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010232448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.815394:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.815421:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343032.815427:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010232576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343032.815455:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.815484:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010232448 00000100:00100000:0.0:1763343032.815488:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010232448 00000100:00100000:0.0:1763343032.815515:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010232576 00000100:00100000:0.0:1763343032.815517:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010232576 00000100:00100000:0.0:1763343032.815534:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6312 00000100:00100000:0.0:1763343032.815541:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3659:x1848998010232448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763343032.815656:0:28996:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343032.815660:0:28996:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343032.815662:0:28996:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343032.815664:0:28996:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343032.815667:0:28996:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343032.815676:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3659:x1848998010232448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (280us total) trans 21474838801 rc 0/0 00000100:00100000:0.0:1763343032.815684:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6312 00000100:00100000:2.0:1763343032.815689:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3660:x1848998010232320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 442us (563us total) trans 17179871502 rc 0/0 00000100:00100000:2.0:1763343032.815695:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6311 00000100:00100000:0.0:1763343032.815700:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6313 00000100:00100000:0.0:1763343032.815706:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3534a98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3658:x1848998010232576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343032.815763:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343032.815766:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.815768:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.815770:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.815772:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343032.815815:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3534a98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3658:x1848998010232576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (358us total) trans 21474838802 rc 0/0 00000100:00100000:0.0:1763343032.815821:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6313 00000004:00080000:0.0:1763343032.815874:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537b0fb80/2, rc 0, transno 21474838801 00000100:00100000:0.0:1763343032.815880:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010232448:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343032.816036:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c3a680/2, rc 0, transno 17179871502 00000100:00100000:0.0:1763343032.816041:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010232320:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343032.816153:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3658:x1848998010232192:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343032.816377:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537b0c380/2, rc 0, transno 21474838802 00000100:00100000:2.0:1763343032.816383:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010232576:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343032.819068:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x289:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343032.819081:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x289:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343032.819084:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x289:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343032.819086:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x289:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343032.819089:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x289:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343032.819202:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3658:x1848998010232192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3960us (4096us total) trans 17179871503 rc 0/0 00000100:00100000:0.0:1763343032.819218:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6310 00000004:00080000:2.0:1763343032.819244:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c38000/2, rc 0, transno 17179871503 00000100:00100000:2.0:1763343032.819251:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010232192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.819728:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.819797:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993452160 00000100:00100000:3.0:1763343032.819807:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993452160 00000100:00100000:3.0:1763343032.819859:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9036 00000100:00100000:3.0:1763343032.819869:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56837:x1848997993452160:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343032.819888:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.819911:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae53ac lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c0b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.819995:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae53b3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820012:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae53b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820025:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae53b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820041:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae53ba lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820047:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae53ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820053:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae53ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820099:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae53b3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820107:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae53b3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820114:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae53b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820122:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae53b3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820128:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.820133:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae53b3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820141:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae53b3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820155:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde900) 00010000:00010000:3.0:1763343032.820158:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.820163:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae53b3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820170:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae53b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820184:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae53ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820189:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae53ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820195:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae53ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820199:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.820202:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae53ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820208:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae53ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820218:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53a800) 00010000:00010000:3.0:1763343032.820220:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.820223:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae53ba lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820228:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae53ba lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.820261:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae53ac lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c0b expref: 232 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.820271:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde900) 00010000:00010000:3.0:1763343032.820273:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.820277:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae53ac lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c0b expref: 232 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.820286:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:3.0:1763343032.820346:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56837:x1848997993452160:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 478us (621us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343032.820353:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9036 00000100:00100000:0.0:1763343032.823255:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.823360:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993452288 00000100:00100000:1.0:1763343032.823373:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993452288 00000100:00100000:1.0:1763343032.823448:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9037 00000100:00100000:1.0:1763343032.823459:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56835:x1848997993452288:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.823489:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.823516:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae53c1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c12 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.823586:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae53c1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c12 expref: 232 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.823607:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae53c1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c12 expref: 232 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.824548:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:2.0:1763343032.824555:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343032.824560:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:2.0:1763343032.824680:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56835:x1848997993452288:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1219us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.824690:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9037 00000100:00100000:2.0:1763343032.827335:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.827434:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993452544 00000100:00100000:1.0:1763343032.827448:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993452544 00000100:00100000:1.0:1763343032.827517:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9038 00000100:00100000:1.0:1763343032.827529:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56837:x1848997993452544:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.827556:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.827560:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343032.827596:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae53a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c04 expref: 232 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.827656:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde900) 00010000:00010000:1.0:1763343032.827670:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343032.827691:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae53c8 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c19 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.827861:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae53cf lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.827877:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae53cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.827889:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae53cf lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.827903:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae53d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.827910:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae53d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.827917:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae53d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.828482:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae53dd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.828495:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae53dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.828503:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae53dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:2.0:1763343032.828518:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cb:0x0]: returning size 0 00010000:00010000:2.0:1763343032.828553:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae53cf lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.828560:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae53cf lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.828567:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae53cf lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.828574:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae53cf lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.828581:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3ee00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.828588:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae53cf lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.828597:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae53cf lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.828607:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdea00) 00010000:00010000:2.0:1763343032.828611:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.828616:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae53cf lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.828655:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae53cf lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00010000:2.0:1763343032.828669:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003158506c reply state 000000008b55428a transno 8589939726 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae53d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.828681:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae53d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.828692:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935e00) 00010000:00010000:2.0:1763343032.828694:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343032.828697:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343032.828730:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae53c8 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c19 expref: 234 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.828749:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae53dd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c19 expref: 233 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.828757:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3518935000) 00010000:00010000:2.0:1763343032.828759:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343032.828761:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3ea00, rc 0) 00000100:00100000:2.0:1763343032.828861:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56837:x1848997993452544:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1333us (1538us total) trans 8589939726 rc 0/0 00000100:00100000:2.0:1763343032.828871:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9038 00000100:00100000:0.0:1763343032.830725:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.830881:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993452672 00000100:00100000:3.0:1763343032.830894:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993452672 00000100:00100000:3.0:1763343032.830975:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9039 00000100:00100000:3.0:1763343032.830986:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56835:x1848997993452672:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343032.831012:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.831039:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae53eb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c20 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343032.831044:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343032.831357:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae53f2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.831373:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae53f2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.831386:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae53f2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:3.0:1763343032.831438:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ca:0x0]: returning size 5 00000004:00200000:3.0:1763343032.831444:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343032.831464:0:6523:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae53f2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.831717:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae53eb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c20 expref: 236 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.831739:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae53f2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c20 expref: 235 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.831748:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:3.0:1763343032.831752:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763343032.831756:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343032.831864:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56835:x1848997993452672:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 879us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.831873:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9039 00000100:00100000:3.0:1763343032.832053:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993452928 00000100:00100000:3.0:1763343032.832059:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993452928 00000100:00100000:3.0:1763343032.832098:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9040 00000100:00100000:3.0:1763343032.832107:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56837:x1848997993452928:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343032.832126:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.832139:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae53f9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c27 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.832224:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5400 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.832237:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae53dd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c19 expref: 236 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.832246:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5400 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.833741:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae53dd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c19 expref: 236 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.833766:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae53dd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c19 expref: 236 pid: 10041 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1763343032.833787:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010232704:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343032.833903:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c780 going to sleep for 11 seconds 00000100:00100000:0.0:1763343032.837327:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.837426:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993453056 00000100:00100000:1.0:1763343032.837439:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993453056 00000100:00100000:1.0:1763343032.837516:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6314 00000100:00100000:1.0:1763343032.837530:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993453056:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.837556:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.837585:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae5407 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c2e expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343032.837615:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x287:0x0] initial LVB size: 5, mtime: 0x691a7ab8, atime: 0x691a7ab8, ctime: 0x691a7ab8, blocks: 0x8 00010000:00010000:1.0:1763343032.837661:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.837663:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.837675:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae5407 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c2e expref: 17 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343032.837694:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae5407 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c2e expref: 17 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343032.837709:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343032.838383:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993453056:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 851us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.838394:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6314 00000100:00100000:3.0:1763343032.838920:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010232704:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343032.838955:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5400 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343032.839698:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.839800:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993453184 00000100:00100000:3.0:1763343032.839810:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993453184 00010000:00010000:3.0:1763343032.839849:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae53dd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c19 expref: 237 pid: 10041 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1763343032.839895:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2972 00000100:00100000:3.0:1763343032.839905:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:2430:x1848997993453184:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343032.839922:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343032.839930:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae53dd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c19 expref: 237 pid: 10041 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343032.839943:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae53dd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c19 expref: 237 pid: 10041 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343032.839983:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae53dd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c19 expref: 237 pid: 10041 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343032.840003:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3518935000) 00010000:00010000:3.0:1763343032.840008:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5400 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.840019:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5400 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.840027:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5400 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.840063:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343032.840132:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:2430:x1848997993453184:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 227us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.840140:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2972 00010000:00010000:0.0:1763343032.840250:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5400 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.840257:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5400 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343032.840301:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cb:0x0]: returning size 0 00000004:00080000:0.0:1763343032.840572:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x28b:0x0], index 1: 0 00000004:00080000:0.0:1763343032.840582:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x289:0x0], index 0: 0 00000004:00080000:0.0:1763343032.840589:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x28a:0x0], index 0: 0 00000004:00080000:0.0:1763343032.840595:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x28c:0x0], index 1: 0 00010000:00010000:0.0:1763343032.840796:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5400 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.840805:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5400 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.840813:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5400 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.840820:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.840825:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5400 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.840837:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5400 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.840849:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3518935000) 00010000:00010000:0.0:1763343032.840851:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343032.840856:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5400 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.840863:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5400 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343032.840920:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae53f9 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c27 expref: 236 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.840932:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3518935000) 00010000:00010000:0.0:1763343032.840935:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343032.840940:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae53f9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c27 expref: 236 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.840957:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93600, rc 0) 00000100:00100000:0.0:1763343032.841031:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56837:x1848997993452928:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8924us (9986us total) trans 8589939727 rc 301/301 00000100:00100000:0.0:1763343032.841041:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9040 00000100:00100000:0.0:1763343032.844928:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.845008:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993453440 00000100:00100000:1.0:1763343032.845024:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993453440 00000100:00100000:1.0:1763343032.845110:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3072 00000100:00100000:1.0:1763343032.845123:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56837:x1848997993453440:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343032.845561:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56837:x1848997993453440:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 438us (647us total) trans 8589939728 rc 0/0 00000100:00100000:1.0:1763343032.845572:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3072 00000100:00100000:1.0:1763343032.850946:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.851028:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993453696 00000100:00100000:0.0:1763343032.851044:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993453696 00000100:00100000:0.0:1763343032.851122:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3073 00000100:00100000:0.0:1763343032.851135:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56837:x1848997993453696:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343032.851489:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56837:x1848997993453696:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 355us (558us total) trans 8589939729 rc 0/0 00000100:00100000:0.0:1763343032.851498:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3073 00000100:00100000:2.0:1763343032.862431:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.862529:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993453952 00000100:00100000:0.0:1763343032.862545:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993453952 00000100:00100000:0.0:1763343032.862669:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9041 00000100:00100000:0.0:1763343032.862681:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:55941:x1848997993453952:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343032.862717:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.862795:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5415 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c35 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.862999:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae541c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863016:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae541c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863029:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae541c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863041:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae5423 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863050:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae5423 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863057:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae5423 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863137:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae542a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863145:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae542a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863151:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae542a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343032.863164:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cb:0x0]: returning size 0 00010000:00010000:2.0:1763343032.863284:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae541c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863293:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae541c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863299:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae541c lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863306:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae541c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863313:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.863318:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae541c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863326:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae541c lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863345:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935700) 00010000:00010000:2.0:1763343032.863349:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.863356:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae541c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863363:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae541c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863380:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae5423 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863386:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae5423 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863392:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae5423 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863450:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.863454:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae5423 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863461:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae5423 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863471:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935e00) 00010000:00010000:2.0:1763343032.863474:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.863478:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae5423 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863484:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae5423 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.863540:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5415 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c35 expref: 240 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.863565:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae542a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c35 expref: 239 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.863573:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343032.863576:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343032.863579:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3e200, rc 0) 00000100:00100000:2.0:1763343032.865161:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:55941:x1848997993453952:12345-192.168.204.21@tcp:101:bash.0 Request processed in 2469us (2744us total) trans 8589939730 rc 0/0 00000100:00100000:2.0:1763343032.865177:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9041 00000100:00100000:1.0:1763343032.868264:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.868345:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993454080 00000100:00100000:2.0:1763343032.868359:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993454080 00000100:00100000:2.0:1763343032.868431:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9042 00000100:00100000:2.0:1763343032.868442:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:55941:x1848997993454080:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343032.868475:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.868505:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5438 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c3c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.868556:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae543f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.868577:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae543f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.868591:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae543f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343032.868802:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5438 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c3c expref: 241 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.868833:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae543f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c3c expref: 240 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.868843:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343032.868847:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343032.868851:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f200, rc 0) 00000100:00100000:2.0:1763343032.868938:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993454080:12345-192.168.204.21@tcp:101:bash.0 Request processed in 498us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.868946:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9042 00000100:00100000:1.0:1763343032.871795:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.871914:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993454336 00000100:00100000:2.0:1763343032.871927:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993454336 00000100:00100000:2.0:1763343032.872006:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9043 00000100:00100000:2.0:1763343032.872019:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993454336:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:2.0:1763343032.872092:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343032.872125:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae542a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c35 expref: 240 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.872144:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343032.872149:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343032.872415:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5446 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1cb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.872436:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5446 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.872448:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5446 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000001:00080000:2.0:1763343032.872512:0:28422:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939731 00000004:00010000:2.0:1763343032.872542:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000f2d9cf1 reply state 0000000032b4f141 transno 8589939732 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5446 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.872555:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5446 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1cb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.872562:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343032.872565:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343032.872568:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343032.872738:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:55941:x1848997993454336:12345-192.168.204.21@tcp:36:bash.0 Request processed in 720us (956us total) trans 8589939732 rc 0/0 00000100:00100000:2.0:1763343032.872748:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9043 00000020:00080000:2.0:1763343032.872755:0:28422:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343032.881243:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.881439:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993454464 00000100:00100000:3.0:1763343032.881454:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993454464 00000100:00100000:3.0:1763343032.881535:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9044 00000100:00100000:3.0:1763343032.881547:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:55941:x1848997993454464:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343032.881581:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.881611:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae544d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c43 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.881890:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae544d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c43 expref: 243 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.881910:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae544d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c43 expref: 243 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.881933:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3518935800) 00010000:00010000:3.0:1763343032.881937:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343032.881943:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343032.882819:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:55941:x1848997993454464:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1269us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343032.882831:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9044 00000100:00100000:1.0:1763343032.885441:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.885541:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993454720 00000100:00100000:3.0:1763343032.885554:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993454720 00000100:00100000:3.0:1763343032.885675:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9045 00000100:00100000:3.0:1763343032.885689:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:55941:x1848997993454720:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343032.885717:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.885721:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343032.885757:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae544d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c43 expref: 243 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.885782:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3518935800) 00010000:00010000:3.0:1763343032.885790:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343032.885807:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5454 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c4a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.885871:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae545b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.885886:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae545b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.885897:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae545b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:0.0:1763343032.888681:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1355, 88 off114864 00000004:00080000:0.0:1763343032.888709:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226556086419ns, next at 1227177369372ns, rc = 0 00000040:00080000:0.0:1763343032.888761:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1354, 88 off114864 00000004:00080000:0.0:1763343032.888768:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226556146782ns, next at 1227177401661ns, rc = 0 00000040:00080000:0.0:1763343032.889891:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1355, 88 off114952 00000004:00080000:0.0:1763343032.889907:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226557285552ns, next at 1227177401661ns, rc = 0 00000040:00080000:0.0:1763343032.890096:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1356, 88 off114952 00000004:00080000:0.0:1763343032.890102:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226557480994ns, next at 1227177369372ns, rc = 0 00000001:00080000:1.0:1763343032.893851:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939733 is committed 00000004:00080000:1.0:1763343032.893868:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 894 committed 00000004:00080000:1.0:1763343032.893892:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 895 committed 00000004:00080000:1.0:1763343032.893905:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 894 committed 00000004:00080000:1.0:1763343032.893908:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 893 committed 00010000:00010000:2.0:1763343032.894260:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae53d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.894372:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae53d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.894380:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae53d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.894386:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.894391:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae53d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.894401:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae53d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.894422:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935e00) 00010000:00010000:2.0:1763343032.894427:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.894434:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae53d6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000100:00100000:0.0:1763343032.894512:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.894598:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993454848 00000100:00100000:1.0:1763343032.894611:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993454848 00010000:00010000:0.0:1763343032.894654:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae545b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c4a expref: 237 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.894667:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3518935800) 00010000:00010000:0.0:1763343032.894669:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343032.894691:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5454 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c4a expref: 237 pid: 6523 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343032.894719:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae545b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c4a expref: 236 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343032.894721:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6315 00000100:00100000:1.0:1763343032.894744:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993454848:12345-192.168.204.21@tcp:23:lfs.0 00010000:00010000:0.0:1763343032.894767:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3518935800) 00010000:00010000:0.0:1763343032.894772:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343032.894774:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:0.0:1763343032.894852:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:55941:x1848997993454720:12345-192.168.204.21@tcp:101:bash.0 Request processed in 9165us (9425us total) trans 8589939733 rc 0/0 00000100:00100000:0.0:1763343032.894868:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9045 00000100:00100000:1.0:1763343032.894870:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993454848:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 123us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.894882:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6315 00010000:00010000:2.0:1763343032.895150:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae53d6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343032.895183:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5446 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1cb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.895190:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5446 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1cb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.895197:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5446 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1cb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.895202:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3ee00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.895205:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5446 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1cb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.895212:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5446 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1cb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.895221:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343032.895223:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.895227:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5446 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1cb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.895233:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5446 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1cb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343032.895392:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343032.895412:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010232960:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343032.895473:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343032.895515:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010233088:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343032.895539:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343032.895573:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010232960 00000100:00100000:2.0:1763343032.895580:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010232960 00000100:00100000:2.0:1763343032.895616:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010233088 00000100:00100000:2.0:1763343032.895638:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010233088 00000100:00100000:2.0:1763343032.895661:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6316 00000100:00100000:2.0:1763343032.895669:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3657:x1848998010232960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343032.895890:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3657:x1848998010232960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 220us (416us total) trans 21474838803 rc 0/0 00000100:00100000:2.0:1763343032.895897:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6316 00000100:00100000:2.0:1763343032.895917:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6317 00000100:00100000:2.0:1763343032.895924:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3659:x1848998010233088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343032.896183:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3659:x1848998010233088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 259us (641us total) trans 21474838804 rc 0/0 00000100:00100000:2.0:1763343032.896190:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6317 00000004:00080000:2.0:1763343032.896432:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d6680/2, rc 0, transno 21474838804 00000100:00100000:2.0:1763343032.896439:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010233088:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763343032.896585:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3404ba6d80/2, rc 0, transno 21474838803 00000100:00100000:2.0:1763343032.896590:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010232960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343032.897115:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010232832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343032.897186:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343032.897323:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343032.897336:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010233216:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343032.897363:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343032.897414:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010232832 00000100:00100000:0.0:1763343032.897426:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010232832 00000100:00100000:0.0:1763343032.897492:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010233216 00000100:00100000:0.0:1763343032.897497:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010233216 00000100:00100000:2.0:1763343032.897504:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6318 00000100:00100000:2.0:1763343032.897525:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3660:x1848998010232832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.897536:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6319 00000100:00100000:0.0:1763343032.897549:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3658:x1848998010233216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.897811:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3658:x1848998010233216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 266us (446us total) trans 17179871505 rc 0/0 00000100:00100000:0.0:1763343032.897818:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6319 00000100:00100000:2.0:1763343032.898416:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3660:x1848998010232832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 898us (1226us total) trans 17179871504 rc 0/0 00000100:00100000:2.0:1763343032.898426:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6318 00000004:00080000:1.0:1763343032.898497:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c3b100/2, rc 0, transno 17179871504 00000100:00100000:1.0:1763343032.898503:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010232832:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343032.898574:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c39500/2, rc 0, transno 17179871505 00000100:00100000:3.0:1763343032.898578:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010233216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343032.898685:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.898727:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.898816:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993454976 00000100:00100000:2.0:1763343032.898823:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993454976 00000100:00100000:2.0:1763343032.898861:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993455104 00000100:00100000:2.0:1763343032.898864:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993455104 00000100:00100000:2.0:1763343032.898890:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6320 00000100:00100000:2.0:1763343032.898899:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993454976:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:2.0:1763343032.898999:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993454976:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 92us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.899007:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6320 00000100:00100000:2.0:1763343032.899023:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6321 00000100:00100000:2.0:1763343032.899030:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:55941:x1848997993455104:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343032.899040:0:15756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.899066:0:15756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e200/0x607405d401ae5462 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c51 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343032.899087:0:15756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343032.899105:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.899108:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.899118:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e200/0x607405d401ae5462 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c51 expref: 24 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.899135:0:15756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e200/0x607405d401ae5462 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c51 expref: 24 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.899148:0:15756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3e200, rc 0) 00000100:00100000:2.0:1763343032.899169:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:55941:x1848997993455104:12345-192.168.204.21@tcp:101:bash.0 Request processed in 140us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.899178:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6321 00000100:00100000:0.0:1763343032.902680:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.903133:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993455232 00000100:00100000:2.0:1763343032.903144:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993455232 00000100:00100000:2.0:1763343032.903207:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6322 00000100:00100000:2.0:1763343032.903217:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993455232:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343032.903236:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.903259:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5469 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c58 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343032.903285:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x289:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343032.903311:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.903313:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.903322:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c58 expref: 18 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.903336:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c58 expref: 18 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.903348:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3fa00, rc 0) 00000100:00100000:2.0:1763343032.903410:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:55941:x1848997993455232:12345-192.168.204.21@tcp:101:bash.0 Request processed in 194us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.903417:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6322 00000100:00100000:3.0:1763343032.903582:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.904701:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993455360 00000100:00100000:2.0:1763343032.904710:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993455360 00000100:00100000:2.0:1763343032.904772:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1552 00000100:00100000:2.0:1763343032.904782:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993455360:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:2.0:1763343032.904819:0:28424:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5470 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.904831:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.904833:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.904836:0:28424:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5470 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.904848:0:28424:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5470 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.904946:0:28424:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5470 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.904955:0:28424:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5470 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.904973:0:28424:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5470 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.904980:0:28424:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3ee00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343032.904984:0:28424:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5470 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.904993:0:28424:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5470 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.905007:0:28424:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5470 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.905022:0:28424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5470 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343032.905078:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993455360:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 297us (1497us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763343032.905084:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1552 00000100:00100000:0.0:1763343032.908569:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.908613:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.908689:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.908751:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993455744 00000100:00100000:1.0:1763343032.908763:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993455744 00000100:00100000:2.0:1763343032.908785:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993455488 00000100:00100000:2.0:1763343032.908793:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993455488 00002000:00010000:2.0:1763343032.908825:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/651 (0->18446744073709551615) 00000100:00100000:1.0:1763343032.908830:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9046 00002000:00100000:2.0:1763343032.908832:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3511f3a300 with x1848997993455488 ext(0->18446744073709551615) 00000100:00100000:1.0:1763343032.908844:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56835:x1848997993455744:12345-192.168.204.21@tcp:101:lfs.0 00002000:00010000:2.0:1763343032.908845:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3511f3a300. 00010000:00010000:1.0:1763343032.908867:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763343032.908868:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993455616 00000100:00100000:2.0:1763343032.908873:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993455616 00010000:00010000:1.0:1763343032.908888:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5477 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c5f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343032.908889:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/649 (0->18446744073709551615) 00002000:00100000:2.0:1763343032.908894:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3511f3b480 with x1848997993455616 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343032.908905:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3511f3b480. 00000100:00100000:2.0:1763343032.908924:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1553 00010000:00010000:1.0:1763343032.908927:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae547e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343032.908935:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2431:x1848997993455488:12345-192.168.204.21@tcp:10:bash.0 00010000:00010000:1.0:1763343032.908948:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae547e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.908975:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae547e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.909092:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5477 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c5f expref: 236 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.909112:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176e00/0x607405d401ae547e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c5f expref: 235 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.909122:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:1.0:1763343032.909126:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00002000:00010000:2.0:1763343032.909127:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x28b:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:1.0:1763343032.909131:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176e00, rc 0) 00002000:00010000:2.0:1763343032.909132:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x28b:0x0] updating lvb mtime from disk: 0 -> 1763343032 00002000:00010000:2.0:1763343032.909137:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x28b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343032.909139:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x28b:0x0] updating lvb ctime from disk: 0 -> 1763343032 00002000:00010000:2.0:1763343032.909142:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x28b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343032.909186:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56835:x1848997993455744:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 345us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.909195:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9046 00000100:00100000:3.0:1763343032.909210:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1554 00000100:00100000:3.0:1763343032.909221:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2431:x1848997993455616:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343032.909308:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x289:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343032.909311:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x289:0x0] updating lvb mtime from disk: 0 -> 1763343032 00002000:00010000:3.0:1763343032.909314:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x289:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343032.909316:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x289:0x0] updating lvb ctime from disk: 0 -> 1763343032 00002000:00010000:3.0:1763343032.909318:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x289:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343032.909826:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2431:x1848997993455488:12345-192.168.204.21@tcp:10:bash.0 Request processed in 891us (1264us total) trans 17179871506 rc 0/0 00000100:00100000:2.0:1763343032.909839:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1553 00002000:00010000:2.0:1763343032.909843:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/651 (0->18446744073709551615) 00002000:00100000:2.0:1763343032.909846:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3511f3a300 with x1848997993455488 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343032.909852:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3511f3a300. 00000100:00100000:3.0:1763343032.911105:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2431:x1848997993455616:12345-192.168.204.21@tcp:10:bash.0 Request processed in 1881us (2485us total) trans 21474838805 rc 0/0 00000100:00100000:3.0:1763343032.911116:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1554 00002000:00010000:3.0:1763343032.911121:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/649 (0->18446744073709551615) 00002000:00100000:3.0:1763343032.911124:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3511f3b480 with x1848997993455616 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343032.911130:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3511f3b480. 00000100:00100000:0.0:1763343032.916665:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.916740:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993456128 00000100:00100000:3.0:1763343032.916750:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993456128 00000100:00100000:3.0:1763343032.916810:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3074 00000100:00100000:3.0:1763343032.916821:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:55941:x1848997993456128:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:3.0:1763343032.917138:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:55941:x1848997993456128:12345-192.168.204.21@tcp:35:bash.0 Request processed in 318us (482us total) trans 8589939734 rc 0/0 00000100:00100000:3.0:1763343032.917147:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3074 00000100:00100000:0.0:1763343032.918309:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.918707:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993455872 00000100:00100000:3.0:1763343032.918716:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993455872 00000100:00100000:3.0:1763343032.919008:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1555 00000100:00100000:3.0:1763343032.919020:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2430:x1848997993455872:12345-192.168.204.21@tcp:4:lfs.0 00010000:00010000:3.0:1763343032.919056:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5485 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.919075:0:8415:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae5255 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b94 expref: 25 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343032.919083:0:8415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343032.919086:0:8415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343032.919090:0:8415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5485 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.919126:0:8415:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae5255 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b94 expref: 25 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343032.919145:0:8415:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae5255 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b94 expref: 25 pid: 28994 timeout: 1326 lvb_type: 1 00000100:00100000:3.0:1763343032.919159:0:8415:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8415:1848998010233344:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343032.919235:0:8415:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343032.928571:0:8415:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8415:1848998010233344:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343032.928607:0:8415:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5485 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343032.930892:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.931863:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.932043:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993456256 00000100:00100000:2.0:1763343032.932053:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993456256 00000100:00100000:2.0:1763343032.932108:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9047 00000100:00100000:2.0:1763343032.932117:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56838:x1848997993456256:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:2.0:1763343032.932140:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.932162:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae548c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c66 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.932223:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae5493 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932236:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae5493 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932246:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae5493 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932258:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae549a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932278:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae549a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932284:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae549a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932353:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae54a1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932361:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae54a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932366:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae54a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343032.932400:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cb:0x0]: returning size 5 00000004:00200000:2.0:1763343032.932404:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343032.932420:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae54a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932431:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae54a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932438:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae5493 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932444:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae5493 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932449:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae5493 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932454:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.932457:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae5493 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932464:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae5493 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932474:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:2.0:1763343032.932477:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.932481:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae5493 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932486:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae5493 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932497:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae549a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932502:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae549a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932507:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae549a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932511:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343032.932514:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae549a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932517:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae549a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932522:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935a00) 00010000:00010000:2.0:1763343032.932524:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343032.932527:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae549a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932531:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae549a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343032.932556:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae548c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c66 expref: 238 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.932573:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae54a1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c66 expref: 237 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.932579:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343032.932581:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343032.932583:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f800, rc 0) 00000100:00100000:2.0:1763343032.932690:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56838:x1848997993456256:12345-192.168.204.21@tcp:101:rm.0 Request processed in 568us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.932697:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9047 00000100:00100000:1.0:1763343032.933350:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993456384 00000100:00100000:1.0:1763343032.933357:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993456384 00010000:00010000:1.0:1763343032.933384:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae5255 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b94 expref: 26 pid: 28994 timeout: 1326 lvb_type: 1 00000100:00100000:1.0:1763343032.933424:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2973 00000100:00100000:1.0:1763343032.933433:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2430:x1848997993456384:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343032.933442:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343032.933459:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae5255 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x28a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b94 expref: 26 pid: 28994 timeout: 1326 lvb_type: 1 00010000:00010000:1.0:1763343032.933471:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae5255 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x28a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b94 expref: 26 pid: 28994 timeout: 1326 lvb_type: 1 00010000:00010000:1.0:1763343032.933494:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665cc00/0x607405d401ae5255 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x28a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b94 expref: 26 pid: 28994 timeout: 1326 lvb_type: 1 00010000:00010000:1.0:1763343032.933506:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.933509:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.933514:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.933522:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5485 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.933546:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343032.933578:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2430:x1848997993456384:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 146us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.933585:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2973 00010000:00010000:2.0:1763343032.933865:0:8415:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.933875:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343032.936109:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.936230:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993456640 00000100:00100000:1.0:1763343032.936241:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993456640 00000100:00100000:1.0:1763343032.936351:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9048 00000100:00100000:1.0:1763343032.936361:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56838:x1848997993456640:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:1.0:1763343032.936419:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343032.936447:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae545b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c4a expref: 237 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.936467:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae54a1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c66 expref: 236 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.936481:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae543f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c3c expref: 235 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.936491:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3518935800) 00010000:00010000:1.0:1763343032.936502:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343032.936533:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae54a8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.936546:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae54a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.936555:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae54a8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.936565:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae54af lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.936572:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae54af lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.936578:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae54af lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.936692:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54b6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.936700:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54b6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.936707:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54b6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:1.0:1763343032.936908:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1357, 64 off115016 00000040:00080000:1.0:1763343032.936930:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1356, 64 off115016 00000040:00080000:1.0:1763343032.936939:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1357, 64 off115080 00000040:00080000:1.0:1763343032.936948:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1358, 64 off115080 00010000:00010000:1.0:1763343032.937010:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae54bd lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1cb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937020:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae54bd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937027:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae54bd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937034:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae54bd lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1cb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937039:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae54bd lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1cb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937045:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae54bd lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1cb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937061:0:6523:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343032.937077:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54b6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937082:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54b6 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937088:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54b6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937094:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.937098:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54b6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937105:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54b6 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937113:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3403bdce00) 00010000:00010000:1.0:1763343032.937117:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343032.937121:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54b6 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937126:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54b6 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1cb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937230:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae54a8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937238:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae54a8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937243:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae54a8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937248:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae54a8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937252:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.937255:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae54a8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937261:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae54a8 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937269:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc400) 00010000:00010000:1.0:1763343032.937272:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.937274:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae54a8 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937279:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae54a8 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:1.0:1763343032.937295:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dce502c5 reply state 000000008b677320 transno 8589939735 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae54af lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937312:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae54af lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.937318:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdc300) 00010000:00010000:1.0:1763343032.937321:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343032.937323:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343032.937395:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56838:x1848997993456640:12345-192.168.204.21@tcp:36:rm.0 Request processed in 1034us (1292us total) trans 8589939735 rc 0/0 00000100:00100000:1.0:1763343032.937403:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9048 00000001:00080000:0.0:1763343032.937541:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871507 is committed 00000001:00080000:0.0:1763343032.937555:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871505 is committed 00010000:00010000:3.0:1763343032.937909:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343032.937916:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae54bd lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1cb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.937922:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343032.937925:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae54bd lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1cb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.937931:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae54bd lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1cb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.937940:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cb:0x0].0x0 (ffff9a3403bdce00) 00010000:00010000:3.0:1763343032.937942:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343032.937945:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae54bd lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1cb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.937950:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae54bd lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1cb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343032.937993:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343032.937995:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343032.937997:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1763343032.942070:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1763343032.942081:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb mtime from disk: 0 -> 1763343032 00002000:00010000:1.0:1763343032.942083:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb ctime from disk: 0 -> 1763343032 00002000:00010000:1.0:1763343032.942086:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763343032.942099:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5485 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.942111:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5485 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.942120:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5485 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.942127:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343032.942131:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5485 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.942139:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5485 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.942162:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5485 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.942169:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5485 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343032.942270:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993455872:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 23250us (23962us total) trans 17179871507 rc 0/0 00000100:00100000:1.0:1763343032.942280:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1555 00000100:00100000:2.0:1763343032.965288:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.966917:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993456896 00000100:00100000:0.0:1763343032.966930:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993456896 00000100:00100000:0.0:1763343032.967391:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9049 00000100:00100000:0.0:1763343032.967403:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56835:x1848997993456896:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343032.967463:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343032.967491:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae53f2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ca:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c20 expref: 236 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.967509:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:0.0:1763343032.967513:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343032.967577:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae54c4 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.967591:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae54c4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.967599:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae54c4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343032.967940:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.968945:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993457024 00000100:00100000:1.0:1763343032.968956:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993457024 00000100:00100000:1.0:1763343032.969646:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9050 00000100:00100000:1.0:1763343032.969657:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56839:x1848997993457024:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343032.969672:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.969692:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae54cb lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c6d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.969745:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54d2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969756:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969766:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54d2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969774:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae54d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969785:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae54d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969790:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae54d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969824:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54d2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969830:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54d2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969835:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969841:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54d2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969847:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.969850:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54d2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969856:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54d2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969867:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc400) 00010000:00010000:1.0:1763343032.969869:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.969873:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54d2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969878:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae54d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969891:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae54d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969897:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae54d9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969902:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae54d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969906:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343032.969909:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae54d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969914:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae54d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969919:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdc300) 00010000:00010000:1.0:1763343032.969921:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.969923:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae54d9 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969927:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae54d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343032.969947:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae54cb lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c6d expref: 237 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.969955:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc400) 00010000:00010000:1.0:1763343032.969957:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343032.969960:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae54cb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c6d expref: 237 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.969981:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176800, rc 0) 00000100:00100000:1.0:1763343032.970040:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56839:x1848997993457024:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 385us (2102us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343032.970048:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9050 00000004:00010000:0.0:1763343032.970395:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c416acf9 reply state 00000000aa7cc3dc transno 8589939736 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae54c4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.970410:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae54c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.970416:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:0.0:1763343032.970419:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343032.970422:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343032.970500:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56835:x1848997993456896:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 3100us (5221us total) trans 8589939736 rc 0/0 00000100:00100000:0.0:1763343032.970509:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9049 00000100:00100000:2.0:1763343032.975985:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.976035:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.976175:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993457280 00000100:00100000:1.0:1763343032.976186:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993457280 00000100:00100000:0.0:1763343032.976204:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993457152 00000100:00100000:0.0:1763343032.976211:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993457152 00000100:00100000:1.0:1763343032.976237:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6323 00000100:00100000:1.0:1763343032.976248:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:56835:x1848997993457280:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:0.0:1763343032.976256:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9051 00010000:00010000:1.0:1763343032.976266:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343032.976288:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae54e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c7b expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343032.976310:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28a:0x0] initial LVB size: 4096, mtime: 0x691a7ab8, atime: 0x0, ctime: 0x691a7ab8, blocks: 0x8 00010000:00010000:1.0:1763343032.976331:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.976333:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343032.976340:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae54e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c7b expref: 14 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.976356:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae54e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c7b expref: 14 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343032.976369:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00000100:00100000:1.0:1763343032.976421:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:56835:x1848997993457280:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 176us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343032.976428:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6323 00000100:00100000:0.0:1763343032.976482:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56839:x1848997993457152:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343032.976495:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.976513:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae54e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c74 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.976576:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae54ee lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976588:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae54ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976600:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae54ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976613:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae54f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976643:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae54f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976651:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae54f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976695:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae54ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976702:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae54ee lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976709:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae54ee lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976716:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.976720:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae54ee lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976727:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae54ee lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976737:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c5900) 00010000:00010000:0.0:1763343032.976741:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.976745:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae54ee lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976751:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae54ee lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976762:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae54f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976768:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae54f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976774:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae54f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976779:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343032.976782:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae54f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976788:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae54f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976800:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdc300) 00010000:00010000:0.0:1763343032.976803:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.976806:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae54f5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976812:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae54f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.976835:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae54e7 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c74 expref: 238 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.976845:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c5900) 00010000:00010000:0.0:1763343032.976848:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343032.976851:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae54e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c74 expref: 238 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.976863:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665cc00, rc 0) 00000100:00100000:0.0:1763343032.976888:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56839:x1848997993457152:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 624us (925us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343032.976895:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9051 00000100:00100000:1.0:1763343032.982130:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343032.982259:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993457408 00000100:00100000:2.0:1763343032.982269:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993457408 00000100:00100000:2.0:1763343032.982328:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6324 00000100:00100000:2.0:1763343032.982339:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:56835:x1848997993457408:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343032.982357:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343032.982375:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae54fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c82 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.982406:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae525c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b9b expref: 20 pid: 10294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343032.982414:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.982416:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343032.982420:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae54fc lrc: 4/0,0 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c82 expref: 20 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.982454:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae525c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b9b expref: 20 pid: 10294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343032.982467:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae525c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b9b expref: 20 pid: 10294 timeout: 1326 lvb_type: 1 00000100:00100000:2.0:1763343032.982481:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340465d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1848998010233472:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343032.982560:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343032.985438:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.985494:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993457536 00000100:00100000:0.0:1763343032.985506:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993457536 00000100:00100000:0.0:1763343032.985576:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9052 00000100:00100000:0.0:1763343032.985587:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56839:x1848997993457536:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343032.985643:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343032.985667:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae5503 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c89 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.985747:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae550a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.985761:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae550a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343032.985774:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae550a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343032.985824:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343032.985830:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343032.985862:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae5503 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c89 expref: 239 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.985880:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae550a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c89 expref: 238 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.985890:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c5e00) 00010000:00010000:0.0:1763343032.985894:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343032.985897:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c200, rc 0) 00000100:00100000:0.0:1763343032.985970:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56839:x1848997993457536:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 376us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343032.985977:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9052 00000100:00100000:3.0:1763343032.988816:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343032.988875:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993457664 00000100:00100000:0.0:1763343032.988885:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993457664 00000100:00100000:2.0:1763343032.988905:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340465d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1848998010233472:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343032.988930:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae525c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b9b expref: 21 pid: 10294 timeout: 1326 lvb_type: 1 00010000:00010000:2.0:1763343032.988942:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae54fc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c82 expref: 21 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343032.988973:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3ea00, rc 0) 00000100:00100000:0.0:1763343032.988982:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2974 00000100:00100000:0.0:1763343032.988993:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993457664:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343032.989008:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343032.989028:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae525c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x288:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b9b expref: 21 pid: 10294 timeout: 1326 lvb_type: 1 00000100:00100000:2.0:1763343032.989040:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:56835:x1848997993457408:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6701us (6917us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343032.989042:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae525c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x288:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b9b expref: 21 pid: 10294 timeout: 1326 lvb_type: 1 00000100:00100000:2.0:1763343032.989057:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6324 00010000:00010000:0.0:1763343032.989072:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae525c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x288:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8b9b expref: 20 pid: 10294 timeout: 1326 lvb_type: 1 00010000:00010000:0.0:1763343032.989086:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.989089:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343032.989094:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae54fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c82 expref: 19 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.989104:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae54fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c82 expref: 19 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343032.989136:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae54fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c82 expref: 19 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343032.989149:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1848998010233600:192.168.204.21@tcp:105: 00000100:00100000:0.0:1763343032.989202:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340468f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343032.993374:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343032.993460:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993457792 00000100:00100000:3.0:1763343032.993471:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993457792 00000100:00100000:3.0:1763343032.993533:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9053 00000100:00100000:3.0:1763343032.993544:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56839:x1848997993457792:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343032.993566:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343032.993590:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5511 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c90 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.993687:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5518 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993704:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5518 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993716:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5518 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993726:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae551f lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993734:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae551f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993741:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae551f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993781:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5518 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993789:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5518 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993795:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5518 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993801:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5518 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993808:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.993812:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5518 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993821:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5518 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993834:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c5e00) 00010000:00010000:3.0:1763343032.993838:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.993843:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5518 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993850:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5518 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993863:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae551f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993869:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae551f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993875:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae551f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993879:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343032.993883:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae551f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993889:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae551f lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993895:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdc300) 00010000:00010000:3.0:1763343032.993898:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.993901:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae551f lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993907:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae551f lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343032.993932:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5511 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c90 expref: 239 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.993943:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c5e00) 00010000:00010000:3.0:1763343032.993945:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343032.993949:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5511 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c90 expref: 239 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343032.993959:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:3.0:1763343032.994041:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56839:x1848997993457792:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 499us (687us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343032.994048:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9053 00000100:00100000:3.0:1763343032.998870:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343032.998950:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993457920 00000100:00100000:1.0:1763343032.998968:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993457920 00002000:00010000:1.0:1763343032.999007:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/650 (5->18446744073709551615) 00002000:00100000:1.0:1763343032.999012:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c3b800 with x1848997993457920 ext(5->18446744073709551615) 00002000:00010000:1.0:1763343032.999023:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537c3b800. 00000100:00100000:1.0:1763343032.999062:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1556 00000100:00100000:1.0:1763343032.999072:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993457920:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:1.0:1763343032.999379:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:1.0:1763343032.999383:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00002000:00010000:1.0:1763343032.999385:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343032.999387:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:1.0:1763343032.999389:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343032.999451:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993457920:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 379us (590us total) trans 17179871508 rc 0/0 00000100:00100000:1.0:1763343032.999458:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1556 00002000:00010000:1.0:1763343032.999462:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/650 (5->18446744073709551615) 00002000:00100000:1.0:1763343032.999465:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c3b800 with x1848997993457920 ext(5->18446744073709551615) 00002000:00010000:1.0:1763343032.999470:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537c3b800. 00000100:00100000:2.0:1763343032.999858:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1848998010233600:192.168.204.21@tcp:105: 00010000:00010000:2.0:1763343032.999879:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343032.999914:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993457664:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 10924us (11109us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343032.999922:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2974 00000100:00100000:3.0:1763343033.002833:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.002908:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993458048 00000100:00100000:2.0:1763343033.002918:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993458048 00000100:00080000:3.0:1763343033.003835:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1763343033.003899:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/648 (0->18446744073709551615) 00002000:00100000:2.0:1763343033.003904:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c38e00 with x1848997993458048 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343033.003917:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537c38e00. 00000100:00100000:2.0:1763343033.004003:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1557 00000100:00100000:2.0:1763343033.004014:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993458048:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:2.0:1763343033.004180:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343033.004183:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb mtime from disk: 0 -> 1763343032 00002000:00010000:2.0:1763343033.004186:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343033.004188:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb ctime from disk: 0 -> 1763343032 00002000:00010000:2.0:1763343033.004191:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343033.005182:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993458048:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 1166us (2354us total) trans 21474838806 rc 0/0 00000100:00100000:2.0:1763343033.005191:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1557 00002000:00010000:2.0:1763343033.005196:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/648 (0->18446744073709551615) 00002000:00100000:2.0:1763343033.005199:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c38e00 with x1848997993458048 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343033.005206:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537c38e00. 00000100:00100000:3.0:1763343033.007439:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.007522:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993458304 00000100:00100000:0.0:1763343033.007532:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993458304 00000100:00100000:0.0:1763343033.007607:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9054 00000100:00100000:0.0:1763343033.007653:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56839:x1848997993458304:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343033.007675:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.007678:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343033.007705:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae550a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c89 expref: 238 pid: 28422 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1763343033.007759:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1763343033.007790:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c5e00) 00010000:00010000:0.0:1763343033.007799:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343033.007814:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae5526 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c97 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.007992:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae552d lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008004:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae552d lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008014:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae552d lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008022:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5534 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008028:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5534 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008033:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5534 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008380:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae553b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008389:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae553b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008396:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae553b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343033.008404:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cd:0x0]: returning size 0 00010000:00010000:0.0:1763343033.008425:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae552d lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008432:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae552d lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008438:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae552d lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008443:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343033.008447:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae552d lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008453:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae552d lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008459:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c5900) 00010000:00010000:0.0:1763343033.008462:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343033.008464:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae552d lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008469:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae552d lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343033.008478:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000054945b31 reply state 0000000055e80386 transno 8589939737 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5534 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008486:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5534 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.008495:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdc300) 00010000:00010000:0.0:1763343033.008498:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343033.008500:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343033.008522:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae5526 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c97 expref: 240 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.008535:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae553b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c97 expref: 239 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.008541:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5000) 00010000:00010000:0.0:1763343033.008544:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343033.008546:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665ce00, rc 0) 00000100:00100000:0.0:1763343033.008891:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56839:x1848997993458304:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1273us (1459us total) trans 8589939737 rc 0/0 00000100:00100000:0.0:1763343033.008900:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9054 00000100:00100000:2.0:1763343033.011100:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.011189:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993458560 00000100:00100000:1.0:1763343033.011198:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993458560 00000100:00100000:1.0:1763343033.011304:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9055 00000100:00100000:1.0:1763343033.011315:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56835:x1848997993458560:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:1.0:1763343033.011407:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5549 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.011423:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5549 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.011433:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5549 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00010000:1.0:1763343033.011562:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000015655bd2 reply state 0000000032357c5a transno 8589939738 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5549 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.011575:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5549 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.011583:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:1.0:1763343033.011585:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343033.011590:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343033.011722:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56835:x1848997993458560:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 407us (630us total) trans 8589939738 rc 0/0 00000100:00100000:1.0:1763343033.011729:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9055 00000100:00100000:3.0:1763343033.015989:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.016215:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993458816 00000100:00100000:1.0:1763343033.016226:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993458816 00000100:00100000:1.0:1763343033.016282:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9056 00000100:00100000:1.0:1763343033.016292:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56839:x1848997993458816:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.016318:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.016339:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5550 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8c9e expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.016472:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5557 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.016489:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae553b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c97 expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.016497:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5557 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.016537:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae553b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c97 expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.016553:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae553b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c97 expref: 243 pid: 28422 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343033.016568:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406550380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010233728:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343033.018938:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe900 going to sleep for 11 seconds 00000100:00100000:0.0:1763343033.019466:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.019526:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993458944 00000100:00100000:3.0:1763343033.019536:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993458944 00000100:00100000:3.0:1763343033.019582:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6325 00000100:00100000:3.0:1763343033.019591:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2431:x1848997993458944:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:3.0:1763343033.019765:0:8408:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343033.019769:0:8408:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00002000:00010000:3.0:1763343033.019772:0:8408:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb atime from disk: 1763343032 -> 1763343032 00002000:00010000:3.0:1763343033.019774:0:8408:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:3.0:1763343033.019776:0:8408:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343033.019834:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2431:x1848997993458944:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 243us (372us total) trans 21474838807 rc 0/0 00000100:00100000:3.0:1763343033.019841:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6325 00000100:00100000:2.0:1763343033.025231:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.025290:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406550380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010233728:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.025318:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5557 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:0.0:1763343033.025996:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993459072 00000100:00100000:0.0:1763343033.026006:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993459072 00010000:00010000:0.0:1763343033.026047:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae553b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c97 expref: 244 pid: 28422 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343033.026093:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2975 00000100:00100000:0.0:1763343033.026101:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:2430:x1848997993459072:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343033.026117:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343033.026124:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae553b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c97 expref: 244 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.026140:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae553b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c97 expref: 244 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.026163:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae553b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c97 expref: 244 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.026180:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5000) 00010000:00010000:0.0:1763343033.026186:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5557 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.026196:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5557 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.026203:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5557 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.026234:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343033.026311:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5557 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.026321:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5557 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343033.026336:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000004:00200000:1.0:1763343033.026344:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cd:0x0]: returning size 0 00000100:00100000:3.0:1763343033.026531:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993459328 00000100:00100000:3.0:1763343033.026536:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993459328 00000004:00080000:1.0:1763343033.026615:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x28b:0x0], index 0: 0 00000004:00080000:1.0:1763343033.026647:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x28d:0x0], index 1: 0 00000004:00080000:1.0:1763343033.026653:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x28e:0x0], index 1: 0 00000004:00080000:1.0:1763343033.026657:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x28c:0x0], index 0: 0 00010000:00010000:1.0:1763343033.026763:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5557 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.026772:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5557 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.026778:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5557 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.026788:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.026792:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5557 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.026800:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5557 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.026810:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5000) 00010000:00010000:1.0:1763343033.026813:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343033.026817:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5557 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.026823:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5557 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.026867:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5550 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c9e expref: 245 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.026878:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5000) 00010000:00010000:1.0:1763343033.026880:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343033.026884:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5550 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c9e expref: 245 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.026898:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:3.0:1763343033.027020:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3075 00000100:00100000:3.0:1763343033.027029:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56835:x1848997993459328:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:3.0:1763343033.027077:0:6526:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1ca:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5358 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bef expref: 244 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.027110:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343033.027123:0:6526:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae53c1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c12 expref: 244 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.027131:0:6526:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343033.027164:0:6526:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae53c1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c12 expref: 244 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.027177:0:6526:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae53c1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c12 expref: 244 pid: 10041 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1763343033.027191:0:6526:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340683b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1848998010233856:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343033.027235:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:2430:x1848997993459072:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1132us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.027243:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2975 00000100:00100000:1.0:1763343033.029448:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56839:x1848997993458816:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 13146us (13457us total) trans 8589939739 rc 301/301 00000100:00100000:1.0:1763343033.029461:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9056 00000100:00100000:3.0:1763343033.029942:0:6526:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343033.032921:0:6526:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340683b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1848998010233856:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343033.032949:0:6526:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00000100:00100000:2.0:1763343033.033682:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.033714:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.033774:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993459712 00000100:00100000:0.0:1763343033.033782:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993459712 00010000:00010000:0.0:1763343033.033817:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae53c1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c12 expref: 243 pid: 10041 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343033.033856:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2976 00000100:00100000:0.0:1763343033.033864:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:2430:x1848997993459712:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343033.033880:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343033.033887:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae53c1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c12 expref: 243 pid: 10041 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.033898:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae53c1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c12 expref: 243 pid: 10041 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.033919:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae53c1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c12 expref: 243 pid: 10041 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.033936:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:0.0:1763343033.033942:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343033.033953:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343033.033971:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343033.034003:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343033.034029:0:6526:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343033.034044:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00000100:00100000:0.0:1763343033.034057:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:2430:x1848997993459712:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 192us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.034065:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2976 00000100:00100000:3.0:1763343033.034124:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993459584 00000100:00100000:3.0:1763343033.034128:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993459584 00000100:00100000:3.0:1763343033.034160:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3076 00000100:00100000:3.0:1763343033.034167:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56839:x1848997993459584:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343033.034382:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56839:x1848997993459584:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 214us (702us total) trans 8589939740 rc 0/0 00000100:00100000:3.0:1763343033.034389:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3076 00000040:00080000:1.0:1763343033.034419:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1358, 88 off115168 00000004:00080000:1.0:1763343033.034430:0:6526:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226701808897ns, next at 1227177401661ns, rc = 0 00000040:00080000:1.0:1763343033.034461:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1359, 88 off115168 00000004:00080000:1.0:1763343033.034469:0:6526:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226701847568ns, next at 1227177369372ns, rc = 0 00000040:00080000:1.0:1763343033.034484:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1360, 88 off115256 00000004:00080000:1.0:1763343033.034488:0:6526:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226701867270ns, next at 1227177369372ns, rc = 0 00000040:00080000:1.0:1763343033.034499:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1359, 88 off115256 00000004:00080000:1.0:1763343033.034503:0:6526:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226701882143ns, next at 1227177401661ns, rc = 0 00000100:00100000:0.0:1763343033.038705:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.038759:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993459968 00000100:00100000:0.0:1763343033.038773:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993459968 00000100:00100000:0.0:1763343033.038862:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3077 00000100:00100000:0.0:1763343033.038875:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56839:x1848997993459968:12345-192.168.204.21@tcp:35:lfs.0 00000001:00080000:3.0:1763343033.039062:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939741 is committed 00000004:00080000:3.0:1763343033.039075:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 897 committed 00000004:00080000:3.0:1763343033.039086:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 896 committed 00000004:00080000:3.0:1763343033.039095:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 895 committed 00000004:00080000:3.0:1763343033.039098:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 896 committed 00000100:00100000:0.0:1763343033.039221:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56839:x1848997993459968:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 347us (531us total) trans 8589939742 rc 0/0 00000100:00100000:0.0:1763343033.039239:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3077 00000100:00100000:0.0:1763343033.039272:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343033.039294:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010233984:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343033.039361:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343033.039367:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.039388:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010234368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.039425:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010234112:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.039469:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.039483:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010234240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.039526:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010233984 00000100:00100000:2.0:1763343033.039534:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343033.039536:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010233984 00000100:00100000:0.0:1763343033.039594:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010234112 00000100:00100000:0.0:1763343033.039598:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010234112 00000100:00100000:2.0:1763343033.039609:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010234240 00000100:00100000:2.0:1763343033.039644:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010234240 00000100:00100000:0.0:1763343033.039657:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6326 00000100:00100000:0.0:1763343033.039669:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3657:x1848998010233984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343033.039695:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:649 count 1 00000100:00100000:2.0:1763343033.039707:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6327 00000100:00100000:2.0:1763343033.039722:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3659:x1848998010234112:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1763343033.039730:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae556c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1763343033.039754:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:650 count 1 00010000:00010000:0.0:1763343033.039757:0:28993:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c58 expref: 20 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.039770:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343033.039772:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343033.039778:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae556c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343033.039798:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343033.039809:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5573 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.039819:0:28993:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c58 expref: 20 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.039828:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.039832:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.039839:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5573 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.039840:0:28993:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c58 expref: 20 pid: 8408 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343033.039885:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5573 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.039888:0:28993:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010234496:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343033.039910:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5573 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.039920:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5573 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.039951:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343033.039987:0:28993:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340468f900 going to sleep for 11 seconds 00000100:00100000:0.0:1763343033.040013:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6328 00000100:00100000:0.0:1763343033.040026:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3660:x1848998010234240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343033.040165:0:27833:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343033.040170:0:27833:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343033.040182:0:27833:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb atime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343033.040185:0:27833:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343033.040188:0:27833:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x287:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:3.0:1763343033.040209:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343033.040220:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5573 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.040233:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343033.040241:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5573 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343033.040241:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3659:x1848998010234112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 519us (766us total) trans 21474838808 rc 0/0 00000100:00100000:0.0:1763343033.040259:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3660:x1848998010234240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (725us total) trans 21474838809 rc 0/0 00000100:00100000:2.0:1763343033.040279:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6327 00010000:00010000:3.0:1763343033.040280:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5573 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.040292:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6328 00010000:00010000:3.0:1763343033.040312:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5573 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1763343033.040330:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1763343033.040351:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343033.040353:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae54af lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.040365:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae54af lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.040372:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae54af lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343033.040401:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010234368 00000100:00100000:0.0:1763343033.040408:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010234368 00000100:00100000:0.0:1763343033.040454:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6329 00000100:00100000:0.0:1763343033.040461:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3658:x1848998010234368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343033.040494:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010234752:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.040538:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1763343033.040540:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343033.040545:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343033.040548:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.040551:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343033.040553:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x288:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:2.0:1763343033.040590:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c251500/2, rc 0, transno 21474838808 00000100:00100000:2.0:1763343033.040600:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010234112:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.040605:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3658:x1848998010234368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 141us (250us total) trans 21474838810 rc 0/0 00000100:00100000:2.0:1763343033.040616:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343033.040616:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6329 00000100:00100000:2.0:1763343033.040671:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010234880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343033.040689:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010234752 00000100:00100000:0.0:1763343033.040696:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010234752 00000100:00100000:2.0:1763343033.040715:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343033.040747:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010234880 00000100:00100000:0.0:1763343033.040753:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010234880 00000100:00100000:2.0:1763343033.040776:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6330 00000100:00100000:0.0:1763343033.040787:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6331 00000100:00100000:2.0:1763343033.040794:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3659:x1848998010234752:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343033.040803:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1848998010234880:12345-0@lo:2:osp-syn-1-0.0 00002000:00080000:2.0:1763343033.040824:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:652 count 1 00002000:00010000:2.0:1763343033.040856:0:15756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343033.040863:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ee00/0x607405d401ae557a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.040874:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.040876:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.040880:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ee00/0x607405d401ae557a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.040894:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ee00/0x607405d401ae557a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343033.040897:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x289:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343033.040905:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x289:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343033.040913:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x289:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.040921:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x289:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343033.040932:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x289:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1763343033.040936:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ee00/0x607405d401ae557a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.040947:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ee00/0x607405d401ae557a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.040979:0:15756:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343033.040993:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3659:x1848998010234880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (279us total) trans 17179871509 rc 0/0 00000100:00100000:0.0:1763343033.041001:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6331 00000100:00080000:0.0:1763343033.041028:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763343033.041045:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010234624:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343033.041084:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1763343033.041145:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c252d80/2, rc 0, transno 21474838810 00000100:00100000:0.0:1763343033.041153:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010234368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.041166:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343033.041176:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010235008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.041186:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3659:x1848998010234752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 397us (647us total) trans 17179871510 rc 0/0 00000100:00100000:2.0:1763343033.041195:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6330 00000100:00100000:0.0:1763343033.041218:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.041222:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010234624 00000100:00100000:2.0:1763343033.041232:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010234624 00000100:00100000:0.0:1763343033.041256:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010235008 00000100:00100000:0.0:1763343033.041263:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010235008 00000100:00100000:2.0:1763343033.041276:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6332 00000100:00100000:2.0:1763343033.041294:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3658:x1848998010234624:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343033.041302:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6333 00002000:00080000:2.0:1763343033.041310:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:651 count 1 00000100:00100000:0.0:1763343033.041318:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3658:x1848998010235008:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763343033.041329:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae5581 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.041347:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e200/0x607405d401ae5462 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c51 expref: 14 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.041354:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343033.041355:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343033.041359:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae5581 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.041396:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e200/0x607405d401ae5462 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c51 expref: 14 pid: 15756 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343033.041404:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343033.041410:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00010000:00010000:2.0:1763343033.041414:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e200/0x607405d401ae5462 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c51 expref: 14 pid: 15756 timeout: 1326 lvb_type: 0 00002000:00010000:0.0:1763343033.041415:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.041423:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:0.0:1763343033.041436:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x28a:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:3.0:1763343033.041470:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5573 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343033.041478:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010235136:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343033.041481:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3658:x1848998010235008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 166us (262us total) trans 17179871511 rc 0/0 00000100:00100000:0.0:1763343033.041509:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6333 00010000:00010000:3.0:1763343033.041533:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343033.041540:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ee00/0x607405d401ae557a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763343033.041557:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c250380/2, rc 0, transno 21474838809 00010000:00010000:3.0:1763343033.041562:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3ee00 already unused, calling callback (ffffffffc0d8ab40) 00000100:00100000:0.0:1763343033.041568:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010234240:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1763343033.041570:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ee00/0x607405d401ae557a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.041584:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ee00/0x607405d401ae557a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343033.041589:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c300 going to sleep for 11 seconds 00010000:00010000:3.0:1763343033.041609:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ee00/0x607405d401ae557a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.041609:0:3658:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871505 gen 2 00010000:00010000:2.0:1763343033.041649:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343033.041650:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340664aa00, transno 17179871466 00010000:00010000:3.0:1763343033.041653:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ee00/0x607405d401ae557a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763343033.041668:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad3b80, transno 17179871467 00010000:00010000:3.0:1763343033.041677:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343033.041681:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406649180, transno 17179871468 00010000:00010000:3.0:1763343033.041682:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343033.041687:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad3800, transno 17179871469 00010000:00010000:3.0:1763343033.041688:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343033.041694:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340664bb80, transno 17179871470 00000004:00080000:0.0:1763343033.041698:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f38e00, transno 17179871471 00000004:00080000:0.0:1763343033.041703:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340664a300, transno 17179871472 00000004:00080000:0.0:1763343033.041708:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340664ad80, transno 17179871473 00000004:00080000:0.0:1763343033.041712:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f39c00, transno 17179871475 00000004:00080000:0.0:1763343033.041715:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f39880, transno 17179871476 00000004:00080000:0.0:1763343033.041718:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f39f80, transno 17179871477 00000004:00080000:0.0:1763343033.041722:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f39180, transno 17179871478 00000004:00080000:0.0:1763343033.041727:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340465ea00, transno 17179871481 00000004:00080000:0.0:1763343033.041733:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052ace00, transno 17179871482 00000004:00080000:0.0:1763343033.041739:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b6300, transno 17179871483 00000004:00080000:0.0:1763343033.041744:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b7480, transno 17179871484 00000004:00080000:0.0:1763343033.041749:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478e300, transno 17179871488 00000004:00080000:0.0:1763343033.041753:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478ca80, transno 17179871489 00000004:00080000:0.0:1763343033.041757:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478c000, transno 17179871490 00000004:00080000:0.0:1763343033.041760:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478fb80, transno 17179871491 00000004:00080000:0.0:1763343033.041763:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3538754700, transno 17179871492 00000004:00080000:0.0:1763343033.041765:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3538755500, transno 17179871493 00000004:00080000:0.0:1763343033.041769:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3538755180, transno 17179871494 00000004:00080000:0.0:1763343033.041772:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3538754e00, transno 17179871495 00000004:00080000:0.0:1763343033.041775:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c38700, transno 17179871497 00000004:00080000:0.0:1763343033.041778:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c38a80, transno 17179871498 00000004:00080000:0.0:1763343033.041782:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c3aa00, transno 17179871499 00000004:00080000:0.0:1763343033.041785:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c3bb80, transno 17179871500 00000004:00080000:0.0:1763343033.041788:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c3a680, transno 17179871502 00000004:00080000:0.0:1763343033.041791:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c38000, transno 17179871503 00000004:00080000:0.0:1763343033.041794:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c3b100, transno 17179871504 00000004:00080000:0.0:1763343033.041797:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c39500, transno 17179871505 00000100:00100000:0.0:1763343033.041804:0:3658:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a3405b7c000 x1848998010235008/t17179871511(17179871511) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343049 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763343033.041814:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7c000/2, rc 0, transno 17179871511 00000100:00100000:0.0:1763343033.041819:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010235008:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1763343033.042458:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.042466:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae54af lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.042477:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae54af lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.042493:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdc300) 00010000:00010000:1.0:1763343033.042496:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.042501:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae54af lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.042509:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae54af lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.042531:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae54c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042537:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae54c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042544:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae54c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042550:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.042552:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae54c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042559:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae54c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042568:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:1.0:1763343033.042570:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.042573:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae54c4 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042579:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae54c4 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042590:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5534 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042597:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5534 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042606:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5534 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042611:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.042614:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5534 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042636:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5534 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042644:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdc300) 00010000:00010000:1.0:1763343033.042647:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.042650:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5534 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042656:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5534 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042678:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5549 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042686:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5549 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042691:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5549 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042696:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.042699:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5549 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042704:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5549 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042712:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:1.0:1763343033.042715:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.042717:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5549 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.042723:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5549 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:1.0:1763343033.042786:0:6526:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000d08147f reply state 00000000a6b7ce04 transno 8589939741 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343033.042802:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343033.042809:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:1.0:1763343033.042812:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763343033.042816:0:6526:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343033.042824:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:1.0:1763343033.042826:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343033.042834:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5358 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bef expref: 232 pid: 28422 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1763343033.042959:0:6526:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763343033.043001:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56835:x1848997993459328:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 15972us (16664us total) trans 8589939741 rc 0/0 00000100:00100000:1.0:1763343033.043012:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3075 00000004:00080000:0.0:1763343033.045059:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7ca80/2, rc 0, transno 17179871509 00000100:00100000:0.0:1763343033.045092:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010234880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343033.045111:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7f800/2, rc 0, transno 17179871510 00000100:00100000:0.0:1763343033.045115:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010234752:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1763343033.045155:0:32357:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 4 in progress, 1 in flight, 30 done 00010000:00010000:0.0:1763343033.045182:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343033.045201:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343033.045209:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343033.045216:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343033.045221:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343033.045229:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343033.045249:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:0.0:1763343033.045252:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343033.045256:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343033.045263:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5565 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 00000100:00100000:2.0:1763343033.048240:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010235136:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343033.048274:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:2.0:1763343033.048278:0:15756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae5581 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343033.048318:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.048344:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.048442:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993460352 00000100:00100000:1.0:1763343033.048454:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993460352 00000100:00100000:0.0:1763343033.048454:0:28993:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010234496:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343033.048485:0:28993:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae556c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.048517:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993460224 00010000:00010000:1.0:1763343033.048519:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c58 expref: 21 pid: 8408 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343033.048522:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993460224 00000100:00100000:1.0:1763343033.048579:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2977 00000100:00100000:1.0:1763343033.048590:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993460352:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343033.048609:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343033.048615:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5469 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c58 expref: 21 pid: 8408 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1763343033.048647:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c58 expref: 21 pid: 8408 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1763343033.048677:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5469 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c58 expref: 21 pid: 8408 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1763343033.048696:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.048698:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.048703:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae556c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.048715:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae556c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.048743:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343033.048825:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993460352:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 236us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.048834:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2977 00000100:00100000:1.0:1763343033.048933:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993460096 00000100:00100000:1.0:1763343033.048937:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993460096 00000100:00100000:1.0:1763343033.048993:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9057 00000100:00100000:1.0:1763343033.049001:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+231:56835:x1848997993460096:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.049035:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.049058:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5588 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ca5 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.049147:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5588 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ca5 expref: 232 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.049163:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176800/0x607405d401ae5588 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ca5 expref: 232 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.049185:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:1.0:1763343033.049189:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343033.049193:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176800, rc 0) 00000100:00100000:1.0:1763343033.049239:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+232:56835:x1848997993460096:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 239us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.049247:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9057 00010000:00010000:1.0:1763343033.049299:0:28993:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae556c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.049309:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae556c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.049320:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae556c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.049327:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae556c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.049353:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343033.049397:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343033.049407:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae556c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.049418:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343033.049423:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae556c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.049434:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae556c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.049447:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae556c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.049453:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae556c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.049473:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343033.049476:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343033.049478:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1763343033.049499:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1763343033.049534:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e200/0x607405d401ae5462 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c51 expref: 15 pid: 15756 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343033.049574:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2978 00000100:00100000:0.0:1763343033.049586:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993460224:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343033.049600:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343033.049607:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e200/0x607405d401ae5462 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c51 expref: 15 pid: 15756 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343033.049733:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3657:x1848998010233984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10066us (10368us total) trans 21474838811 rc 0/0 00000100:00100000:1.0:1763343033.049744:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6326 00000004:00080000:3.0:1763343033.049775:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c251c00/2, rc 0, transno 21474838811 00000100:00100000:3.0:1763343033.049783:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010233984:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1763343033.049969:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e200/0x607405d401ae5462 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c51 expref: 15 pid: 15756 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.049987:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e200/0x607405d401ae5462 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c51 expref: 15 pid: 15756 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.049997:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.049999:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.050002:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae5581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.050011:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae5581 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.050034:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343033.050067:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993460224:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 484us (1722us total) trans 0 rc 0/0 00010000:00010000:2.0:1763343033.050073:0:15756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae5581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.050079:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2978 00010000:00010000:2.0:1763343033.050096:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae5581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.050109:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae5581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.050118:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae5581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.050159:0:15756:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343033.050862:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343033.050871:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae5581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.050880:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343033.050885:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae5581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.050894:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae5581 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.050912:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae5581 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.050920:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae5581 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.050944:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343033.050947:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343033.050949:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343033.051091:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3658:x1848998010234624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9802us (10003us total) trans 17179871512 rc 0/0 00000100:00100000:2.0:1763343033.051101:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6332 00000004:00080000:0.0:1763343033.051407:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7e680/2, rc 0, transno 17179871512 00000100:00100000:0.0:1763343033.051415:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010234624:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343033.054673:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.054720:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.054781:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993460608 00000100:00100000:3.0:1763343033.054795:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993460608 00000100:00100000:2.0:1763343033.054846:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993460864 00000100:00100000:2.0:1763343033.054851:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993460864 00000100:00100000:2.0:1763343033.054914:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3078 00000100:00100000:2.0:1763343033.054925:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56835:x1848997993460864:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343033.055094:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9058 00000100:00100000:0.0:1763343033.055102:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:55941:x1848997993460608:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343033.055115:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.055146:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae558f lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8cac expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.055290:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5596 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.055312:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5596 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.055324:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5596 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.055339:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae559d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.055345:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae559d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.055351:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae559d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.055404:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae55a4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.055413:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae55a4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.055420:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae55a4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343033.055432:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cd:0x0]: returning size 0 00000004:00080000:2.0:1763343033.055434:0:6526:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1ca:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763343033.055515:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1360, 64 off115320 00010000:00010000:0.0:1763343033.055517:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5596 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.055529:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5596 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.055537:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5596 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.055543:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665da00 already unused, calling callback (ffffffffc19a2550) 00000040:00080000:2.0:1763343033.055545:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1361, 64 off115320 00010000:00010000:0.0:1763343033.055551:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5596 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00000040:00080000:2.0:1763343033.055557:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1362, 64 off115384 00010000:00010000:0.0:1763343033.055562:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5596 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00000040:00080000:2.0:1763343033.055569:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1361, 64 off115384 00010000:00010000:0.0:1763343033.055579:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c5900) 00010000:00010000:0.0:1763343033.055584:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343033.055591:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5596 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.055598:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5596 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.055612:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae559d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.055786:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae55b2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343033.055794:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae559d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.055801:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae55b2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343033.055804:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae559d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.055818:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ca00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.055819:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae55b2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343033.055823:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae559d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.055831:0:6526:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae55b2 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343033.055834:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae559d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.055844:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae55b2 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343033.055850:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c5e00) 00010000:00010000:2.0:1763343033.055851:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae55b2 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343033.055858:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343033.055863:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae559d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.055875:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae559d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.055884:0:6526:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343033.055908:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343033.055917:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae55b2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343033.055925:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343033.055929:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae55b2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343033.055935:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae55b2 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343033.055947:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ca:0x0].0x0 (ffff9a3538bf7a00) 00010000:00010000:3.0:1763343033.055950:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343033.055954:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae55b2 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343033.055968:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae55b2 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1ca:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343033.055983:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343033.055984:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343033.055986:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343033.056073:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae558f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cac expref: 237 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.056093:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae55a4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cac expref: 236 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.056102:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:0.0:1763343033.056105:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343033.056109:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d000, rc 0) 00000100:00100000:2.0:1763343033.056155:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56835:x1848997993460864:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1229us (1430us total) trans 8589939744 rc 0/0 00000100:00100000:2.0:1763343033.056167:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3078 00000100:00100000:0.0:1763343033.058973:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:55941:x1848997993460608:12345-192.168.204.21@tcp:101:bash.0 Request processed in 3841us (4286us total) trans 8589939743 rc 0/0 00000100:00100000:0.0:1763343033.058990:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9058 00000100:00100000:1.0:1763343033.062268:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.062437:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993460992 00000100:00100000:0.0:1763343033.062455:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993460992 00000100:00100000:0.0:1763343033.062544:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9059 00000100:00100000:0.0:1763343033.062558:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:55941:x1848997993460992:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343033.062593:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.062666:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae55b9 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8cb3 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.063018:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae55c0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.063038:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae55c0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.063054:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae55c0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.063215:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae55b9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cb3 expref: 237 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.063239:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae55c0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cb3 expref: 236 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.063248:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:2.0:1763343033.063252:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343033.063255:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3fc00, rc 0) 00000100:00100000:2.0:1763343033.063340:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:55941:x1848997993460992:12345-192.168.204.21@tcp:101:bash.0 Request processed in 785us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.063349:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9059 00000100:00100000:3.0:1763343033.064067:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.065719:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993461248 00000100:00100000:2.0:1763343033.065739:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993461248 00000100:00100000:2.0:1763343033.065811:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9060 00000100:00100000:2.0:1763343033.065822:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56835:x1848997993461248:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.065848:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.065873:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae55c7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8cba expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.066019:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae55ce lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.066036:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae55ce lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.066049:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae55ce lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343033.066061:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cd:0x0]: returning size 0 00010000:00010000:2.0:1763343033.066192:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae55c7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cba expref: 239 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.066210:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae55ce lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cba expref: 238 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.066220:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:2.0:1763343033.066223:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763343033.066227:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f800, rc 0) 00000100:00100000:2.0:1763343033.066306:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56835:x1848997993461248:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 485us (2244us total) trans 8589939745 rc 0/0 00000100:00100000:2.0:1763343033.066314:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9060 00000100:00100000:1.0:1763343033.070715:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.070773:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993461504 00000100:00100000:2.0:1763343033.070788:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993461504 00000100:00100000:2.0:1763343033.070875:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9061 00000100:00100000:2.0:1763343033.070888:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:55941:x1848997993461504:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:2.0:1763343033.070985:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343033.071024:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae55a4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cac expref: 238 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.071053:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:2.0:1763343033.071060:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.071321:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae55dc lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.071340:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae55dc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.071352:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae55dc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000001:00080000:2.0:1763343033.071411:0:28422:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939746 00000004:00010000:2.0:1763343033.071439:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003d2dfc13 reply state 000000003b8d82ea transno 8589939747 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae55dc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.071453:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae55dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.071459:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:2.0:1763343033.071462:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343033.071466:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343033.072339:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993461504:12345-192.168.204.21@tcp:36:bash.0 Request processed in 1445us (1712us total) trans 8589939747 rc 0/0 00000100:00100000:3.0:1763343033.072350:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.072359:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9061 00000020:00080000:2.0:1763343033.072370:0:28422:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343033.072657:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993461632 00000100:00100000:2.0:1763343033.072669:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993461632 00000100:00100000:2.0:1763343033.072717:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9062 00000100:00100000:2.0:1763343033.072726:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56835:x1848997993461632:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.072749:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.072768:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae55e3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8cc1 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.072902:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae55ea lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.072916:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae55ea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.072926:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae55ea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343033.072952:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cd:0x0]: returning size 0 00000004:00200000:2.0:1763343033.072957:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343033.072991:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae55ea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.073019:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae55e3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc1 expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.073040:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae55ea lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc1 expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.073050:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:2.0:1763343033.073052:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343033.073056:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f000, rc 0) 00000100:00100000:2.0:1763343033.073111:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56835:x1848997993461632:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 384us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.073118:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9062 00000100:00100000:1.0:1763343033.075856:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.076159:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993461888 00000100:00100000:2.0:1763343033.076173:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993461888 00000100:00100000:2.0:1763343033.076232:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9063 00000100:00100000:2.0:1763343033.076242:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:55941:x1848997993461888:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343033.076273:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.076276:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343033.076307:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae55ce lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cba expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.076331:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:2.0:1763343033.076336:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.076350:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae55f1 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8cc8 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.076405:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.076420:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae55ea lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc1 expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.076430:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.076473:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae55ea lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc1 expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.076489:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae55ea lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc1 expref: 241 pid: 28422 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343033.076503:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b90700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010235264:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343033.076823:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3538beac00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343033.078551:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.078774:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993462016 00000100:00100000:2.0:1763343033.078787:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993462016 00000100:00100000:2.0:1763343033.078858:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6334 00000100:00100000:2.0:1763343033.078869:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993462016:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.078891:0:15756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.078916:0:15756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e400/0x607405d401ae55ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ccf expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343033.078944:0:15756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343033.078978:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.078981:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.078991:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e400/0x607405d401ae55ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ccf expref: 15 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.079009:0:15756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e400/0x607405d401ae55ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ccf expref: 15 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.079029:0:15756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3e400, rc 0) 00000100:00100000:2.0:1763343033.079105:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993462016:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 237us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.079113:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6334 00000100:00100000:1.0:1763343033.080708:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b90700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010235264:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.080747:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343033.081303:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.081371:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.081374:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993462144 00000100:00100000:0.0:1763343033.081386:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993462144 00010000:00010000:0.0:1763343033.081434:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae55ea lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc1 expref: 242 pid: 28422 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343033.081489:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2979 00000100:00100000:0.0:1763343033.081502:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:2431:x1848997993462144:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343033.081519:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343033.081527:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae55ea lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc1 expref: 242 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.081540:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae55ea lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc1 expref: 242 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.081576:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae55ea lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc1 expref: 242 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.081598:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:0.0:1763343033.081605:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.081617:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.081649:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.081693:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343033.081749:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:2431:x1848997993462144:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 249us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.081756:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2979 00000100:00100000:1.0:1763343033.081802:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993462272 00000100:00100000:1.0:1763343033.081808:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993462272 00000100:00100000:1.0:1763343033.081852:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6335 00000100:00100000:1.0:1763343033.081860:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993462272:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.081878:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.081883:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.081898:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343033.081902:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae5606 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8cd6 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343033.081930:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343033.081948:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.081950:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.081958:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae5606 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cd6 expref: 21 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343033.081996:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae5606 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cd6 expref: 21 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343033.082011:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:1.0:1763343033.082036:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993462272:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 178us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.082042:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6335 00000040:00080000:3.0:1763343033.082236:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1362, 88 off115472 00000004:00080000:3.0:1763343033.082246:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226749624173ns, next at 1227177401661ns, rc = 0 00000040:00080000:3.0:1763343033.082288:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1363, 88 off115472 00000004:00080000:3.0:1763343033.082294:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226749672910ns, next at 1227177369372ns, rc = 0 00000040:00080000:3.0:1763343033.082308:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1364, 88 off115560 00000004:00080000:3.0:1763343033.082312:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226749691092ns, next at 1227177369372ns, rc = 0 00000040:00080000:3.0:1763343033.082321:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1363, 88 off115560 00000004:00080000:3.0:1763343033.082324:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226749703690ns, next at 1227177401661ns, rc = 0 00000100:00100000:3.0:1763343033.091317:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.091798:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993462400 00000100:00100000:0.0:1763343033.091812:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993462400 00000001:00080000:3.0:1763343033.094352:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939748 is committed 00000004:00080000:3.0:1763343033.094375:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 899 committed 00000004:00080000:3.0:1763343033.094402:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 898 committed 00000004:00080000:3.0:1763343033.094413:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 897 committed 00000004:00080000:3.0:1763343033.094416:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 898 committed 00010000:00010000:2.0:1763343033.094603:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae55dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.094637:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae55dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.094646:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae55dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.094654:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.094660:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae55dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.094668:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae55dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.094689:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:2.0:1763343033.094692:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.094698:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae55dc lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.094704:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae55dc lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1cd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343033.094883:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010235776:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.094992:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.095042:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343033.095048:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010235392:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.095068:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.095095:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010235648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.095115:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.095130:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343033.095134:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010235520:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.095149:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.095178:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010235776 00000100:00100000:2.0:1763343033.095185:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010235776 00000100:00100000:2.0:1763343033.095235:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010235392 00000100:00100000:2.0:1763343033.095238:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010235392 00000100:00100000:2.0:1763343033.095252:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010235648 00000100:00100000:2.0:1763343033.095254:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010235648 00000100:00100000:2.0:1763343033.095266:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010235520 00000100:00100000:2.0:1763343033.095268:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010235520 00000100:00100000:2.0:1763343033.095289:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6336 00000100:00100000:2.0:1763343033.095297:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3657:x1848998010235776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763343033.095520:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x28e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343033.095525:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x28e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343033.095528:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x28e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343033.095530:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x28e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343033.095533:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x28e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343033.095574:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3657:x1848998010235776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 276us (583us total) trans 17179871513 rc 0/0 00000100:00100000:2.0:1763343033.095581:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6336 00000100:00100000:2.0:1763343033.095599:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6337 00000100:00100000:2.0:1763343033.095604:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3657:x1848998010235392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343033.095670:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:649 count 1 00010000:00010000:2.0:1763343033.095693:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae560d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.095716:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae5312 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bda expref: 14 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.095725:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343033.095728:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343033.095732:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae560d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.095763:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae5312 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bda expref: 14 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.095781:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae5312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bda expref: 14 pid: 28993 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343033.095795:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1848998010235904:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343033.095873:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3538beac00 going to sleep for 11 seconds 00000100:00100000:2.0:1763343033.095891:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6338 00000100:00100000:2.0:1763343033.095898:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3660:x1848998010235648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.095997:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3660:x1848998010235648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (881us total) trans 17179871514 rc 0/0 00000100:00100000:2.0:1763343033.096004:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6338 00000100:00100000:2.0:1763343033.096016:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6339 00000100:00100000:2.0:1763343033.096022:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3660:x1848998010235520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343033.096033:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:650 count 1 00010000:00010000:2.0:1763343033.096044:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae5614 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.096055:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae54e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c7b expref: 14 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.096063:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343033.096065:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343033.096067:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae5614 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.096083:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae54e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c7b expref: 14 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.096093:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae54e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c7b expref: 14 pid: 28993 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343033.096103:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010236032:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343033.096124:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c300 going to sleep for 11 seconds 00000004:00080000:2.0:1763343033.096173:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b90000/2, rc 0, transno 17179871513 00000100:00100000:2.0:1763343033.096179:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010235776:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343033.096196:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b93b80/2, rc 0, transno 17179871514 00000100:00100000:2.0:1763343033.096200:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010235648:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763343033.096280:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc8 expref: 235 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.096291:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:2.0:1763343033.096294:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343033.096310:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae55f1 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc8 expref: 235 pid: 28422 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343033.096328:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc8 expref: 234 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.096360:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:2.0:1763343033.096370:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343033.096372:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3e800, rc 0) 00000100:00100000:2.0:1763343033.096398:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:55941:x1848997993461888:12345-192.168.204.21@tcp:101:bash.0 Request processed in 20158us (20559us total) trans 8589939748 rc 0/0 00000100:00100000:2.0:1763343033.096410:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9063 00000100:00100000:2.0:1763343033.096435:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9064 00000100:00100000:2.0:1763343033.096443:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56835:x1848997993462400:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.096457:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.096471:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae561b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8cdd expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.096505:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae561b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cdd expref: 234 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.096515:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae561b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cdd expref: 234 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.096525:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:2.0:1763343033.096528:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343033.096530:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f000, rc 0) 00000100:00100000:2.0:1763343033.096547:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56835:x1848997993462400:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 106us (5247us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.096554:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9064 00000100:00100000:1.0:1763343033.097289:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010236416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343033.097333:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343033.097364:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343033.097368:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010236288:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343033.097384:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343033.097406:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010236416 00000100:00100000:1.0:1763343033.097413:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010236416 00000100:00100000:1.0:1763343033.097443:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010236288 00000100:00100000:1.0:1763343033.097445:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010236288 00000100:00100000:1.0:1763343033.097459:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6340 00000100:00100000:1.0:1763343033.097465:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3660:x1848998010236416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343033.097596:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3660:x1848998010236416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (261us total) trans 21474838812 rc 0/0 00000100:00100000:1.0:1763343033.097601:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6340 00000100:00100000:1.0:1763343033.097615:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6341 00000100:00100000:1.0:1763343033.097637:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3660:x1848998010236288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343033.097649:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:648 count 1 00010000:00010000:1.0:1763343033.097665:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae5622 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.097681:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae54fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c82 expref: 20 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.097689:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343033.097691:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343033.097694:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae5622 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.097715:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae54fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c82 expref: 20 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.097726:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae54fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c82 expref: 20 pid: 8408 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343033.097737:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34050f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010236672:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343033.097774:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe900 going to sleep for 11 seconds 00000100:00100000:1.0:1763343033.097792:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010236544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343033.097815:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343033.097832:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343033.097836:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010236160:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343033.097853:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343033.097869:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010236544 00000100:00100000:1.0:1763343033.097873:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010236544 00000100:00100000:1.0:1763343033.097892:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010236160 00000100:00100000:1.0:1763343033.097894:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010236160 00000100:00100000:1.0:1763343033.097912:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6342 00000100:00100000:1.0:1763343033.097916:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3657:x1848998010236544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763343033.098003:0:8408:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x28c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343033.098007:0:8408:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x28c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343033.098009:0:8408:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x28c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343033.098011:0:8408:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x28c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343033.098013:0:8408:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x28c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343033.098039:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3657:x1848998010236544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 122us (224us total) trans 21474838813 rc 0/0 00000100:00100000:1.0:1763343033.098045:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6342 00000100:00100000:1.0:1763343033.098057:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6343 00000100:00100000:1.0:1763343033.098062:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3657:x1848998010236160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343033.098071:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:647 count 1 00010000:00010000:1.0:1763343033.098081:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae5629 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.098093:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae5407 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c2e expref: 20 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343033.098100:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.098101:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.098104:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae5629 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.098121:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae5407 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c2e expref: 20 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343033.098129:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae5407 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c2e expref: 20 pid: 28993 timeout: 1326 lvb_type: 1 00000100:00100000:1.0:1763343033.098139:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1848998010236800:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343033.098160:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe240 going to sleep for 11 seconds 00000004:00080000:1.0:1763343033.098204:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c252300/2, rc 0, transno 21474838813 00000100:00100000:1.0:1763343033.098210:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010236544:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343033.098225:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c250700/2, rc 0, transno 21474838812 00000100:00100000:1.0:1763343033.098229:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010236416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343033.111954:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.112004:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.112063:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993462528 00000100:00100000:0.0:1763343033.112074:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993462528 00000100:00100000:1.0:1763343033.112092:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34050f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010236672:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.112127:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae5622 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.112134:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae5312 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bda expref: 15 pid: 28993 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343033.112179:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993462656 00000100:00100000:0.0:1763343033.112183:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993462656 00000100:00100000:1.0:1763343033.112197:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1848998010236800:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343033.112202:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae54e0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c7b expref: 16 pid: 28993 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1763343033.112214:0:8408:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae5629 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.112234:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2980 00000100:00100000:0.0:1763343033.112247:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993462528:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763343033.112254:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:0.0:1763343033.112270:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343033.112278:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae5312 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bda expref: 16 pid: 28993 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343033.112286:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:0.0:1763343033.112299:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae5312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bda expref: 16 pid: 28993 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343033.112332:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993462912 00010000:00010000:0.0:1763343033.112332:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.112336:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1763343033.112337:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993462912 00010000:00010000:0.0:1763343033.112344:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae560d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.112357:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae54fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c82 expref: 21 pid: 8408 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.112358:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae560d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343033.112384:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993463040 00000100:00100000:1.0:1763343033.112388:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993463040 00010000:00010000:0.0:1763343033.112395:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343033.112402:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae5407 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c2e expref: 22 pid: 28993 timeout: 1326 lvb_type: 1 00000100:00100000:1.0:1763343033.112419:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2981 00000100:00100000:1.0:1763343033.112427:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993462656:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343033.112436:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343033.112442:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae54e0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c7b expref: 16 pid: 28993 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1763343033.112452:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae54e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c7b expref: 16 pid: 28993 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1763343033.112466:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.112469:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1763343033.112472:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993462528:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 226us (532us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343033.112474:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae5614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.112490:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae5614 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.112490:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2980 00010000:00010000:1.0:1763343033.112507:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343033.112517:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2982 00000100:00100000:1.0:1763343033.112533:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2432:x1848997993462656:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 104us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.112534:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2432:x1848997993462912:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763343033.112549:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2981 00010000:00010000:0.0:1763343033.112557:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343033.112566:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae54fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c82 expref: 22 pid: 8408 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343033.112568:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2983 00000100:00100000:1.0:1763343033.112579:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2432:x1848997993463040:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343033.112584:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae54fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c82 expref: 22 pid: 8408 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1763343033.112597:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343033.112604:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae5407 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c2e expref: 22 pid: 28993 timeout: 1326 lvb_type: 1 00010000:00010000:0.0:1763343033.112608:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae54fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c82 expref: 22 pid: 8408 timeout: 1326 lvb_type: 0 00010000:00010000:1.0:1763343033.112667:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae5407 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c2e expref: 22 pid: 28993 timeout: 1326 lvb_type: 1 00010000:00010000:0.0:1763343033.112677:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.112681:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.112685:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae5622 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.112687:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae5407 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c2e expref: 21 pid: 28993 timeout: 1326 lvb_type: 1 00010000:00010000:0.0:1763343033.112705:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae5622 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.112711:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.112716:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.112719:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae5629 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.112728:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae5629 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.112731:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343033.112752:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343033.112758:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2432:x1848997993462912:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 232us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.112767:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2982 00000100:00100000:1.0:1763343033.112778:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2432:x1848997993463040:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 199us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.112786:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2983 00010000:00010000:0.0:1763343033.112800:0:8410:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae5622 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.112811:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae5622 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.112812:0:8408:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae5629 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.112832:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae5629 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.112836:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae5622 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.112858:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae5622 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.112861:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae5629 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.112875:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae5629 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.112885:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1763343033.112893:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763343033.113211:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3660:x1848998010236288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15588us (15823us total) trans 21474838814 rc 0/0 00000100:00100000:0.0:1763343033.113221:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6341 00010000:00010000:0.0:1763343033.113244:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343033.113251:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae5622 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.113261:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343033.113265:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae5622 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.113276:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae5622 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.113289:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae5622 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.113302:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177a00/0x607405d401ae5622 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.113321:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343033.113324:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae5629 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.113330:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343033.113333:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae5629 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.113340:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae5629 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.113349:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae5629 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.113356:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae5629 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.113368:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343033.113370:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343033.113372:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343033.113410:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406551880/2, rc 0, transno 21474838814 00000100:00100000:0.0:1763343033.113417:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010236288:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763343033.113668:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae5312 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8bda expref: 14 pid: 28993 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343033.113682:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1848998010235904:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343033.113705:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae560d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.113719:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae560d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.113726:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae560d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.113734:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae560d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.113741:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae560d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.113758:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343033.113931:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3657:x1848998010235392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18325us (18860us total) trans 17179871515 rc 0/0 00000100:00100000:2.0:1763343033.113938:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6337 00010000:00010000:2.0:1763343033.113981:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343033.113987:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae560d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.113995:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343033.113998:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae560d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.114006:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae560d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.114024:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae560d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.114031:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae560d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.114047:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343033.114049:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343033.114050:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763343033.114075:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b92300/2, rc 0, transno 17179871515 00000100:00100000:2.0:1763343033.114081:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010235392:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1763343033.114118:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343033.114383:0:28996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae54e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8c7b expref: 13 pid: 28993 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1763343033.114397:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010236032:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343033.114413:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae5614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.114421:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae5614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.114434:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae5614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.114443:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae5614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.114450:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae5614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.114466:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343033.114739:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3660:x1848998010235520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18714us (19586us total) trans 17179871516 rc 0/0 00000100:00100000:3.0:1763343033.114747:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6339 00010000:00010000:3.0:1763343033.114767:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343033.114773:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae5614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.114781:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fa00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343033.114785:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae5614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.114792:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae5614 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.114805:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae5614 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.114817:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae5614 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.114833:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343033.114835:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343033.114836:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343033.114856:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b92a00/2, rc 0, transno 17179871516 00000100:00100000:3.0:1763343033.114861:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010235520:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343033.114956:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.114995:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.115018:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.115521:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993462784 00000100:00100000:2.0:1763343033.115531:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993462784 00000100:00100000:2.0:1763343033.115584:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993463168 00000100:00100000:2.0:1763343033.115588:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993463168 00000100:00100000:2.0:1763343033.115638:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6344 00000100:00100000:2.0:1763343033.115649:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:55941:x1848997993462784:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343033.115677:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763343033.115683:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6345 00000100:00100000:0.0:1763343033.115695:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993463168:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.115704:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5630 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ce4 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.115705:0:8410:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.115716:0:8410:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae5637 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x28b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ceb expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343033.115739:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343033.115764:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.115767:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.115787:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5630 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ce4 expref: 22 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.115816:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5630 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ce4 expref: 22 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.115828:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3ee00, rc 0) 00000100:00100000:0.0:1763343033.115847:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010236928:192.168.204.21@tcp:106: 00000100:00100000:2.0:1763343033.115892:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:55941:x1848997993462784:12345-192.168.204.21@tcp:101:bash.0 Request processed in 244us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.115900:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6344 00000100:00100000:2.0:1763343033.115944:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993463296 00000100:00100000:2.0:1763343033.115948:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993463296 00000100:00100000:2.0:1763343033.115997:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 406 00000100:00100000:2.0:1763343033.116005:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5fe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:2430:x1848997993463296:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343033.116017:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343033.116040:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae561b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cdd expref: 234 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.116059:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:2.0:1763343033.116065:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343033.116520:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340468f900 going to sleep for 11 seconds 00000100:00100000:2.0:1763343033.117471:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5fe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:2430:x1848997993463296:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1457us (2441us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.117484:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 406 00000100:00100000:1.0:1763343033.118145:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3657:x1848998010236160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20077us (20284us total) trans 21474838815 rc 0/0 00000100:00100000:1.0:1763343033.118156:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6343 00000004:00080000:2.0:1763343033.118280:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406550000/2, rc 0, transno 21474838815 00000100:00100000:2.0:1763343033.118288:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010236160:0@lo:6:osp-syn-0-0.0 00002000:00010000:1.0:1763343033.121987:0:8410:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x28b:0x0] updating lvb mtime: 0 -> 1763343032 00002000:00010000:1.0:1763343033.122001:0:8410:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x28b:0x0] updating lvb atime: 0 -> 1763343032 00002000:00010000:1.0:1763343033.122004:0:8410:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x28b:0x0] updating lvb ctime: 0 -> 1763343032 00000100:00100000:1.0:1763343033.122038:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010236928:192.168.204.21@tcp:106: 00010000:00010000:1.0:1763343033.122087:0:8410:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae5637 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ceb expref: 21 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343033.122118:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae5637 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ceb expref: 21 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343033.122133:0:8410:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665ca00, rc 0) 00000100:00100000:1.0:1763343033.122217:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993463168:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6524us (7219us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343033.122230:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6345 00000100:00100000:1.0:1763343033.123786:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.124377:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993463424 00000100:00100000:0.0:1763343033.124392:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993463424 00000100:00100000:0.0:1763343033.124475:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6346 00000100:00100000:0.0:1763343033.124488:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:55941:x1848997993463424:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343033.124514:0:8410:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.124543:0:8410:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae563e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8cf2 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343033.124575:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343033.124603:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.124605:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.124641:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae563e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf2 expref: 14 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.124663:0:8410:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae563e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf2 expref: 14 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.124686:0:8410:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c400, rc 0) 00000100:00100000:0.0:1763343033.124769:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:55941:x1848997993463424:12345-192.168.204.21@tcp:101:bash.0 Request processed in 283us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.124777:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6346 00000100:00100000:3.0:1763343033.127148:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.127354:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993463680 00000100:00100000:2.0:1763343033.127364:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993463680 00000100:00100000:2.0:1763343033.127419:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3079 00000100:00100000:2.0:1763343033.127430:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+233:56835:x1848997993463680:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343033.127703:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56835:x1848997993463680:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 273us (564us total) trans 8589939749 rc 0/0 00000100:00100000:2.0:1763343033.127714:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3079 00000100:00100000:0.0:1763343033.131899:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.131969:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.132051:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993463936 00000100:00100000:1.0:1763343033.132070:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993463936 00002000:00010000:1.0:1763343033.132128:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/653 (0->18446744073709551615) 00002000:00100000:1.0:1763343033.132134:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3409a4dc00 with x1848997993463936 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343033.132150:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3409a4dc00. 00000100:00100000:1.0:1763343033.132195:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993463808 00000100:00100000:1.0:1763343033.132198:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993463808 00002000:00010000:1.0:1763343033.132212:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/651 (0->18446744073709551615) 00002000:00100000:1.0:1763343033.132215:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3409a4ed80 with x1848997993463808 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343033.132223:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3409a4ed80. 00000100:00100000:1.0:1763343033.132263:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1558 00000100:00100000:1.0:1763343033.132274:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993463936:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:1.0:1763343033.132527:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x28d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343033.132531:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x28d:0x0] updating lvb mtime from disk: 0 -> 1763343032 00002000:00010000:1.0:1763343033.132533:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x28d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343033.132536:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x28d:0x0] updating lvb ctime from disk: 0 -> 1763343032 00002000:00010000:1.0:1763343033.132538:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x28d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343033.132662:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1559 00000100:00100000:1.0:1763343033.132674:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993463936:12345-192.168.204.21@tcp:10:bash.0 Request processed in 398us (783us total) trans 17179871517 rc 0/0 00000100:00100000:2.0:1763343033.132685:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993463808:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:1.0:1763343033.132692:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1558 00002000:00010000:1.0:1763343033.132703:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/653 (0->18446744073709551615) 00002000:00100000:1.0:1763343033.132707:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3409a4dc00 with x1848997993463936 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343033.132712:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3409a4dc00. 00002000:00010000:2.0:1763343033.132894:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x28b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343033.132899:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x28b:0x0] updating lvb mtime from disk: 1763343032 -> 1763343032 00002000:00010000:2.0:1763343033.132902:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x28b:0x0] updating lvb atime from disk: 1763343032 -> 0 00002000:00010000:2.0:1763343033.132904:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x28b:0x0] updating lvb ctime from disk: 1763343032 -> 1763343032 00002000:00010000:2.0:1763343033.132906:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x28b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343033.132982:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993463808:12345-192.168.204.21@tcp:10:bash.0 Request processed in 306us (1010us total) trans 21474838816 rc 0/0 00000100:00100000:2.0:1763343033.132990:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1559 00002000:00010000:2.0:1763343033.132995:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/651 (0->18446744073709551615) 00002000:00100000:2.0:1763343033.132998:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3409a4ed80 with x1848997993463808 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343033.133005:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3409a4ed80. 00000100:00100000:0.0:1763343033.133400:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.133840:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993464192 00000100:00100000:3.0:1763343033.133852:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993464192 00000100:00100000:3.0:1763343033.133915:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9065 00000100:00100000:3.0:1763343033.133923:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+234:56835:x1848997993464192:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343033.133950:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.133990:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5645 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8cf9 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.134088:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae564c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134105:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae564c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134119:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae564c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134132:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5653 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134147:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5653 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134153:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5653 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134300:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae565a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134310:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae565a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134317:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae565a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343033.134329:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cd:0x0]: returning size 2 00010000:00010000:3.0:1763343033.134413:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae564c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134421:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae564c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134428:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae564c lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134445:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae564c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134452:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.134456:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae564c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134464:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae564c lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134481:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8800) 00010000:00010000:3.0:1763343033.134485:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.134490:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae564c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134496:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae564c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134513:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5653 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134518:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5653 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134524:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5653 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134529:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.134532:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5653 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134538:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5653 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134545:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8600) 00010000:00010000:3.0:1763343033.134547:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.134550:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5653 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134556:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5653 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.134600:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5645 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf9 expref: 237 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.134616:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae565a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf9 expref: 236 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.134695:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:3.0:1763343033.134698:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343033.134701:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:3.0:1763343033.134767:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56835:x1848997993464192:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 844us (1370us total) trans 8589939750 rc 0/0 00000100:00100000:3.0:1763343033.134775:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9065 00000100:00100000:0.0:1763343033.145748:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.148008:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993464448 00000100:00100000:3.0:1763343033.148027:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993464448 00000100:00100000:0.0:1763343033.148293:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.148684:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993464576 00000100:00100000:1.0:1763343033.148690:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993464576 00000100:00100000:1.0:1763343033.148750:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3080 00000100:00100000:1.0:1763343033.148760:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56835:x1848997993464576:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:1.0:1763343033.148967:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56835:x1848997993464576:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 200us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.148975:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3080 00000100:00100000:3.0:1763343033.150293:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3081 00000100:00100000:3.0:1763343033.150307:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:55941:x1848997993464448:12345-192.168.204.21@tcp:35:bash.0 00000001:00080000:3.0:1763343033.150602:0:14879:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939751 00000100:00100000:2.0:1763343033.150833:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:55941:x1848997993464448:12345-192.168.204.21@tcp:35:bash.0 Request processed in 517us (5091us total) trans 8589939752 rc 0/0 00000100:00100000:2.0:1763343033.150847:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3081 00000020:00080000:2.0:1763343033.150854:0:14879:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343033.154875:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.158104:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993464832 00000100:00100000:2.0:1763343033.158119:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993464832 00000100:00100000:2.0:1763343033.158197:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9066 00000100:00100000:2.0:1763343033.158208:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56835:x1848997993464832:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.158229:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.158252:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5668 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d00 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.158361:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae566f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.158376:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae566f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.158387:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae566f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343033.158398:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cd:0x0]: returning size 5 00010000:00010000:2.0:1763343033.158503:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5668 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d00 expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.158523:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae566f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d00 expref: 240 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.158531:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:2.0:1763343033.158534:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343033.158538:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f800, rc 0) 00000100:00100000:2.0:1763343033.158615:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56835:x1848997993464832:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 409us (3755us total) trans 8589939753 rc 0/0 00000100:00100000:2.0:1763343033.158644:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9066 00000100:00100000:3.0:1763343033.165150:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.165397:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993465088 00000100:00100000:0.0:1763343033.165412:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993465088 00000100:00100000:0.0:1763343033.165492:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3082 00000100:00100000:0.0:1763343033.165506:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56835:x1848997993465088:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:0.0:1763343033.165603:0:6527:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1cd:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae566f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d00 expref: 240 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.165675:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae567d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343033.165691:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae55c0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cb3 expref: 240 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.165700:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae565a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf9 expref: 240 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.165714:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc8 expref: 240 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.165722:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae567d lrc: 6/0,1 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343033.165765:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc8 expref: 240 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.165781:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc8 expref: 240 pid: 28422 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343033.165799:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010237056:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343033.166847:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae565a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf9 expref: 240 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.166863:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae565a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf9 expref: 240 pid: 10041 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343033.166877:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010237184:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343033.167341:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:0.0:1763343033.167991:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae55c0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cb3 expref: 240 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.168006:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae55c0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cb3 expref: 240 pid: 28422 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343033.168021:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a350121aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010237312:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343033.168067:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340468fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1763343033.169062:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993465344 00000100:00100000:2.0:1763343033.169076:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993465344 00000100:00100000:2.0:1763343033.169817:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9067 00000100:00100000:2.0:1763343033.169835:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56840:x1848997993465344:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:2.0:1763343033.169908:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343033.169928:0:28422:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc8 expref: 241 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343033.169975:0:28422:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae565a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf9 expref: 241 pid: 10041 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343033.169989:0:28422:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae55c0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cb3 expref: 241 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:2.0:1763343033.170000:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:2.0:1763343033.170007:0:28422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae567d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.170019:0:28422:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae567d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.170028:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae567d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.170056:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.170092:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5684 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170102:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5684 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170110:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5684 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170121:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae568b lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170131:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae568b lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170137:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae568b lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170252:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5692 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170261:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5692 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170268:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5692 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00080000:2.0:1763343033.170570:0:28422:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1cd:0x0] is inserted into orphan list, open count = 2 00010000:00010000:2.0:1763343033.170724:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5692 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170733:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5692 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170740:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5692 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170747:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fa00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.170751:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5692 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170760:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5692 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170770:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:2.0:1763343033.170773:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343033.170777:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5692 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170783:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5692 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170802:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5684 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170808:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5684 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170813:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5684 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170819:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.170822:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5684 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170828:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5684 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170835:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:2.0:1763343033.170838:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.170841:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5684 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170846:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5684 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:2.0:1763343033.170862:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ad557972 reply state 00000000c5e24700 transno 8589939754 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae568b lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170874:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae568b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.170882:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935d00) 00010000:00010000:2.0:1763343033.170884:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343033.170887:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343033.170996:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56840:x1848997993465344:12345-192.168.204.21@tcp:36:rm.0 Request processed in 1164us (3654us total) trans 8589939754 rc 0/0 00000100:00100000:2.0:1763343033.171006:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9067 00010000:00010000:0.0:1763343033.175178:0:6527:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@00000000682248c4 x1848998010237056) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc8 expref: 242 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.175211:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae55f8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cc8 expref: 242 pid: 28422 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343033.175233:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010237056:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343033.175248:0:6527:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@000000003eea4262 x1848998010237184) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae565a lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf9 expref: 241 pid: 10041 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.175259:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae565a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf9 expref: 241 pid: 10041 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343033.175270:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010237184:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343033.175280:0:6527:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@000000000db0c50f x1848998010237312) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae55c0 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cb3 expref: 240 pid: 28422 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.175291:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae55c0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cb3 expref: 240 pid: 28422 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343033.175302:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a350121aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010237312:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343033.175339:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:0.0:1763343033.175349:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae567d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343033.175364:0:6527:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae567d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343033.175370:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae567d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00000004:00020000:0.0:1763343033.175590:0:6527:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0000-mdtlov: can not set all stale mirrors for [0x200000405:0x1cd:0x0]: rc = -1 00010000:00010000:0.0:1763343033.175765:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae567d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343033.175775:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae567d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343033.175783:0:6527:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae567d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343033.175790:0:6527:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343033.175795:0:6527:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae567d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343033.175804:0:6527:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae567d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343033.175821:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:0.0:1763343033.175824:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1763343033.175829:0:6527:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae567d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343033.175836:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae567d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1cd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343033.175849:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a34037c5b00) 00010000:00010000:0.0:1763343033.175853:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343033.175859:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae566f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d00 expref: 239 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.176090:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56835:x1848997993465088:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 10586us (10955us total) trans 8589939755 rc -1/-1 00000100:00100000:0.0:1763343033.176103:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3082 00000100:00100000:3.0:1763343033.180002:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.180347:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993465472 00000100:00100000:0.0:1763343033.180362:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993465472 00000100:00100000:0.0:1763343033.180450:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9068 00000100:00100000:0.0:1763343033.180462:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56835:x1848997993465472:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343033.180502:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.180532:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae5699 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d07 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.180612:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae5699 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d07 expref: 240 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.180664:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c000/0x607405d401ae5699 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d07 expref: 240 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.180688:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a3541141200) 00010000:00010000:0.0:1763343033.180692:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343033.180698:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c000, rc 0) 00000100:00100000:0.0:1763343033.180784:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56835:x1848997993465472:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 323us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.180792:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9068 00000100:00100000:3.0:1763343033.188107:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.188198:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993465728 00000100:00100000:0.0:1763343033.188215:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993465728 00000100:00100000:3.0:1763343033.189461:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3083 00000100:00100000:3.0:1763343033.189491:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56835:x1848997993465728:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:3.0:1763343033.189893:0:14879:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1cd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763343033.189991:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1364, 64 off115624 00000040:00080000:3.0:1763343033.190016:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1365, 64 off115624 00000040:00080000:3.0:1763343033.190025:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1366, 64 off115688 00000040:00080000:3.0:1763343033.190033:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1365, 64 off115688 00010000:00010000:3.0:1763343033.190106:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae56a0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343033.190505:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae56a0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343033.190523:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae56a0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343033.190532:0:14879:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae56a0 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343033.190539:0:14879:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae56a0 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343033.190546:0:14879:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae56a0 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343033.190577:0:14879:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343033.190641:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343033.190651:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae56a0 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343033.190660:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343033.190666:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae56a0 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343033.190675:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae56a0 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343033.190693:0:13198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cd:0x0].0x0 (ffff9a3541141200) 00010000:00010000:0.0:1763343033.190697:0:13198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343033.190703:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae56a0 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343033.190712:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae56a0 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343033.190787:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.190790:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.190792:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343033.191793:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56835:x1848997993465728:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 2304us (3690us total) trans 8589939756 rc 0/0 00000100:00100000:2.0:1763343033.191808:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3083 00000100:00100000:1.0:1763343033.197040:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.197406:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993465856 00000100:00100000:2.0:1763343033.197421:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993465856 00000100:00100000:2.0:1763343033.197517:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9069 00000100:00100000:2.0:1763343033.197529:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56841:x1848997993465856:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.197565:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.197598:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae56a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d0e expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.197728:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae56ae lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197748:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae56ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197762:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae56ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197774:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae56b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197787:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae56b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197793:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae56b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197844:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae56ae lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197851:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae56ae lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197858:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae56ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197865:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fa00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.197870:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae56ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197879:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae56ae lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197894:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:2.0:1763343033.197898:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.197905:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae56ae lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197912:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae56ae lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197925:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae56b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197931:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae56b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197937:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae56b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197942:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.197945:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae56b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197951:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae56b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197968:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935d00) 00010000:00010000:2.0:1763343033.197971:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.197974:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae56b5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.197980:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae56b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.198012:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae56a7 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d0e expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.198022:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:2.0:1763343033.198025:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.198028:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae56a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d0e expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.198041:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3e200, rc 0) 00000100:00100000:2.0:1763343033.198137:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56841:x1848997993465856:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 609us (1111us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343033.198146:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9069 00000100:00100000:3.0:1763343033.203836:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.204191:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993465984 00000100:00100000:1.0:1763343033.204206:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993465984 00000100:00100000:1.0:1763343033.204291:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9070 00000100:00100000:1.0:1763343033.204304:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56841:x1848997993465984:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.204334:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.204370:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae56bc lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d15 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.204467:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae56c3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204484:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae56c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204497:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae56c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204508:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56ca lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204516:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204521:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204584:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae56c3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204591:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae56c3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204596:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae56c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204602:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae56c3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204608:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.204613:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae56c3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204646:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae56c3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204660:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc200) 00010000:00010000:1.0:1763343033.204664:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.204669:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae56c3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204676:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae56c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204692:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204697:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56ca lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204702:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204707:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.204710:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204715:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56ca lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204721:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935d00) 00010000:00010000:1.0:1763343033.204724:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.204727:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56ca lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204731:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56ca lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.204762:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae56bc lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d15 expref: 242 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.204773:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc200) 00010000:00010000:1.0:1763343033.204775:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.204778:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae56bc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d15 expref: 242 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.204794:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:1.0:1763343033.204886:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56841:x1848997993465984:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 582us (1063us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343033.204895:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9070 00000100:00100000:3.0:1763343033.214053:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.215012:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.215076:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993466112 00000100:00100000:1.0:1763343033.215091:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993466112 00000100:00100000:1.0:1763343033.215174:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993466368 00000100:00100000:1.0:1763343033.215178:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993466368 00000100:00100000:1.0:1763343033.215220:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9071 00000100:00100000:1.0:1763343033.215233:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56841:x1848997993466112:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:0.0:1763343033.215251:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9072 00000100:00100000:0.0:1763343033.215268:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56842:x1848997993466368:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.215276:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.215278:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.215311:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae56d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d23 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.215318:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae56d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d1c expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.215393:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae56df lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343033.215398:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae56e6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.215415:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae56df lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.215431:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae56df lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343033.215432:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae56e6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.215450:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae56e6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.215465:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae56ed lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.215472:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae56ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.215479:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae56ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343033.215507:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343033.215515:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343033.215525:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae56e6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.215534:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae56e6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.215540:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae56e6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.215547:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae56e6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.215554:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343033.215560:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae56e6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.215572:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae56e6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.215574:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae56d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d1c expref: 245 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.215592:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141900) 00010000:00010000:0.0:1763343033.215597:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343033.215603:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae56e6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.215605:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae56df lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d1c expref: 244 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.215616:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae56e6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.215645:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141900) 00010000:00010000:1.0:1763343033.215649:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343033.215653:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00010000:00010000:0.0:1763343033.215668:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae56ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.215675:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae56ed lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.215681:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae56ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.215686:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343033.215690:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae56ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.215697:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae56ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.215705:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935d00) 00010000:00010000:0.0:1763343033.215708:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343033.215712:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae56ed lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.215717:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae56ed lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000100:00100000:1.0:1763343033.215736:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56841:x1848997993466112:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 505us (1698us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343033.215743:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae56d1 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d23 expref: 244 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343033.215752:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9071 00010000:00010000:0.0:1763343033.215759:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141900) 00010000:00010000:0.0:1763343033.215763:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343033.215768:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae56d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d23 expref: 244 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.215783:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c200, rc 0) 00000100:00100000:0.0:1763343033.215807:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56842:x1848997993466368:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 546us (805us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343033.215813:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9072 00000100:00100000:0.0:1763343033.223899:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.224038:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993466624 00000100:00100000:2.0:1763343033.224052:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993466624 00000100:00100000:1.0:1763343033.224153:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9073 00000100:00100000:1.0:1763343033.224168:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56841:x1848997993466624:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.224198:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.224202:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343033.224241:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae56df lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d1c expref: 242 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.224398:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541141900) 00010000:00010000:1.0:1763343033.224415:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343033.224538:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae56f4 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d2a expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.224713:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56fb lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.224730:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56fb lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.224743:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56fb lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.224756:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5702 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.224764:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5702 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.224770:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5702 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.225264:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5709 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.225280:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5709 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.225288:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5709 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343033.225299:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cf:0x0]: returning size 0 00010000:00010000:1.0:1763343033.225331:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56fb lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.225339:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56fb lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.225346:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56fb lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.225352:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56fb lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.225358:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.225364:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56fb lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.225372:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56fb lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.225382:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc200) 00010000:00010000:1.0:1763343033.225386:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.225390:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56fb lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.225397:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae56fb lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00010000:1.0:1763343033.225414:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000db0c50f reply state 000000001ad46ed4 transno 8589939757 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5702 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.225425:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5702 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.225431:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935d00) 00010000:00010000:1.0:1763343033.225433:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343033.225436:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343033.225470:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae56f4 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d2a expref: 244 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.225491:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5709 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d2a expref: 243 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.225498:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a3403bdcd00) 00010000:00010000:1.0:1763343033.225501:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343033.225504:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00000100:00100000:1.0:1763343033.225608:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56841:x1848997993466624:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1442us (1723us total) trans 8589939757 rc 0/0 00000100:00100000:1.0:1763343033.225663:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9073 00000100:00100000:2.0:1763343033.229247:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.229426:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993466880 00000100:00100000:1.0:1763343033.229441:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993466880 00000100:00100000:1.0:1763343033.229521:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9074 00000100:00100000:1.0:1763343033.229534:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56841:x1848997993466880:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.229566:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.229596:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5717 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d31 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.229830:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae571e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.229848:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5709 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d2a expref: 245 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.229859:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae571e lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.229904:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5709 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d2a expref: 245 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.229920:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5709 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d2a expref: 245 pid: 10041 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343033.229935:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010237440:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343033.230050:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe300 going to sleep for 11 seconds 00000100:00100000:2.0:1763343033.232176:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.232396:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010237440:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.232431:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae571e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343033.232553:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993467008 00000100:00100000:3.0:1763343033.232563:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993467008 00010000:00010000:3.0:1763343033.232608:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5709 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d2a expref: 246 pid: 10041 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1763343033.232698:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2984 00000100:00100000:3.0:1763343033.232709:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:2429:x1848997993467008:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343033.232728:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343033.232740:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5709 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d2a expref: 246 pid: 10041 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343033.232759:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5709 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d2a expref: 246 pid: 10041 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343033.232791:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5709 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d2a expref: 246 pid: 10041 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343033.232812:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a3403bdcd00) 00010000:00010000:3.0:1763343033.232817:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae571e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.232828:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae571e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.232836:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae571e lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.232869:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343033.232941:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:2429:x1848997993467008:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 233us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343033.232950:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2984 00010000:00010000:1.0:1763343033.232986:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae571e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.232998:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae571e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343033.233038:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cf:0x0]: returning size 0 00000004:00080000:1.0:1763343033.233310:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x28f:0x0], index 1: 0 00000004:00080000:1.0:1763343033.233321:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x28d:0x0], index 0: 0 00000004:00080000:1.0:1763343033.233329:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x28e:0x0], index 0: 0 00000004:00080000:1.0:1763343033.233335:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x290:0x0], index 1: 0 00010000:00010000:1.0:1763343033.233487:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae571e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.233497:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae571e lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.233505:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae571e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.233511:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.233516:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae571e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.233524:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae571e lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.233535:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a3403bdcd00) 00010000:00010000:1.0:1763343033.233538:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343033.233543:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae571e lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.233549:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae571e lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.233615:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5717 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d31 expref: 245 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.233699:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a3403bdcd00) 00010000:00010000:1.0:1763343033.233702:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343033.233706:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5717 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d31 expref: 245 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.233721:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343033.233761:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56841:x1848997993466880:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4229us (4530us total) trans 8589939758 rc 301/301 00000100:00100000:1.0:1763343033.233769:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9074 00000100:00100000:2.0:1763343033.236898:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.237015:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993467264 00000100:00100000:0.0:1763343033.237030:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993467264 00000100:00100000:0.0:1763343033.237110:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3084 00000100:00100000:0.0:1763343033.237122:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56841:x1848997993467264:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343033.237574:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56841:x1848997993467264:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 453us (690us total) trans 8589939759 rc 0/0 00000100:00100000:0.0:1763343033.237582:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3084 00000100:00100000:2.0:1763343033.240025:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.240142:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.240246:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993467776 00000100:00100000:1.0:1763343033.240259:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993467776 00000100:00100000:1.0:1763343033.240312:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3085 00000100:00100000:1.0:1763343033.240323:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56841:x1848997993467776:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343033.240608:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56841:x1848997993467776:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 287us (596us total) trans 8589939760 rc 0/0 00000100:00100000:1.0:1763343033.240616:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3085 00000100:00100000:3.0:1763343033.242535:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993467520 00000100:00100000:3.0:1763343033.242554:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993467520 00000100:00100000:3.0:1763343033.242686:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9075 00000100:00100000:3.0:1763343033.242696:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56842:x1848997993467520:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343033.242721:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.242752:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae572c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d38 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.242848:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5733 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.242866:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5733 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.242879:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5733 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.242891:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae573a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.242899:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae573a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.242905:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae573a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243066:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5741 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243075:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5741 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243082:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5741 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343033.243094:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cf:0x0]: returning size 0 00010000:00010000:3.0:1763343033.243205:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5733 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243213:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5733 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243219:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5733 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243226:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5733 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243235:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.243240:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5733 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243248:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5733 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243262:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8800) 00010000:00010000:3.0:1763343033.243266:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.243271:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5733 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243278:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5733 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243296:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae573a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243302:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae573a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243307:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae573a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243312:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.243314:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae573a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243320:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae573a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243327:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935d00) 00010000:00010000:3.0:1763343033.243330:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.243334:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae573a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243340:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae573a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.243386:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae572c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d38 expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.243406:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5741 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d38 expref: 248 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.243414:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:3.0:1763343033.243416:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343033.243419:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343033.243514:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56842:x1848997993467520:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 818us (3370us total) trans 8589939761 rc 0/0 00000100:00100000:3.0:1763343033.243522:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9075 00000100:00100000:1.0:1763343033.247939:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.248016:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.248162:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993467904 00000100:00100000:1.0:1763343033.248170:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.248175:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993467904 00000100:00100000:2.0:1763343033.248236:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993468032 00000100:00100000:2.0:1763343033.248240:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993468032 00000100:00100000:1.0:1763343033.248253:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6347 00000100:00100000:1.0:1763343033.248278:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2431:x1848997993467904:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.248302:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.248332:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae574f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d3f expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343033.248364:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1763343033.248382:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6348 00000100:00100000:2.0:1763343033.248390:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2431:x1848997993468032:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.248390:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.248393:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.248399:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.248403:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae574f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d3f expref: 22 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.248414:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae5756 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d46 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.248423:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae574f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d3f expref: 22 pid: 28993 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1763343033.248430:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x290:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343033.248439:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00010000:00010000:2.0:1763343033.248440:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.248442:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.248446:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae5756 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d46 expref: 16 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.248457:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae5756 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d46 expref: 16 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.248464:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3ea00, rc 0) 00000100:00100000:1.0:1763343033.248507:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2431:x1848997993467904:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 232us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.248515:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6347 00000100:00100000:2.0:1763343033.248669:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2431:x1848997993468032:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 280us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.248680:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6348 00000100:00100000:2.0:1763343033.248702:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993468160 00000100:00100000:2.0:1763343033.248707:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993468160 00000100:00100000:2.0:1763343033.248735:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9076 00000100:00100000:2.0:1763343033.248740:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:55941:x1848997993468160:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343033.248759:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.248776:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae575d lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d4d expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.248816:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5764 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.248831:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5764 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.248843:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5764 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.249004:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae575d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d4d expref: 250 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.249023:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5764 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d4d expref: 249 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.249032:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:2.0:1763343033.249036:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343033.249040:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f000, rc 0) 00000100:00100000:2.0:1763343033.249079:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:55941:x1848997993468160:12345-192.168.204.21@tcp:101:bash.0 Request processed in 337us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.249089:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9076 00000100:00100000:1.0:1763343033.251313:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.251802:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993468416 00000100:00100000:3.0:1763343033.251818:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993468416 00000100:00100000:3.0:1763343033.251891:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9077 00000100:00100000:3.0:1763343033.251903:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:55941:x1848997993468416:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:3.0:1763343033.251989:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343033.252026:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5741 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d38 expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.252048:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:3.0:1763343033.252055:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343033.252312:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae576b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.252331:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae576b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.252342:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae576b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000001:00080000:3.0:1763343033.252398:0:10041:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939762 00000004:00010000:3.0:1763343033.252425:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000038f0a7b9 reply state 000000002db42ba8 transno 8589939763 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae576b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.252675:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae576b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.252682:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:3.0:1763343033.252685:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343033.252688:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343033.252728:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.252813:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:55941:x1848997993468416:12345-192.168.204.21@tcp:36:bash.0 Request processed in 911us (1512us total) trans 8589939763 rc 0/0 00000100:00100000:2.0:1763343033.252817:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993468544 00000100:00100000:3.0:1763343033.252821:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9077 00000100:00100000:2.0:1763343033.252823:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993468544 00000020:00080000:3.0:1763343033.252828:0:10041:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343033.253911:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9078 00000100:00100000:2.0:1763343033.253928:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56842:x1848997993468544:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.253955:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.253985:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5772 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d54 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.254051:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5772 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d54 expref: 252 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.254066:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5772 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d54 expref: 252 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.254086:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:2.0:1763343033.254088:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343033.254092:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3e200, rc 0) 00000100:00100000:2.0:1763343033.254251:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56842:x1848997993468544:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 327us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.254259:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9078 00000100:00100000:1.0:1763343033.259675:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.259754:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.260336:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993468672 00000100:00100000:3.0:1763343033.260351:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993468672 00000100:00100000:2.0:1763343033.260396:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993468800 00000100:00100000:2.0:1763343033.260401:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993468800 00000100:00100000:3.0:1763343033.260439:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9079 00000100:00100000:2.0:1763343033.260451:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9080 00000100:00100000:3.0:1763343033.260455:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:55941:x1848997993468672:12345-192.168.204.21@tcp:101:bash.0 00000100:00100000:2.0:1763343033.260457:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56842:x1848997993468800:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.260493:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.260527:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5779 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d62 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.260539:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.260553:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5780 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d5b expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.260608:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5780 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d5b expref: 255 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.260617:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae5787 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.260653:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5780 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d5b expref: 255 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.260675:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:3.0:1763343033.260679:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343033.260684:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92a00, rc 0) 00010000:00010000:2.0:1763343033.260715:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae5787 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.260725:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae5787 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.260739:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae578e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.260746:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae578e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.260751:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae578e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:3.0:1763343033.260758:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:55941:x1848997993468672:12345-192.168.204.21@tcp:101:bash.0 Request processed in 310us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343033.260765:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9079 00010000:00010000:2.0:1763343033.260855:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5795 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.260863:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5795 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.260870:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5795 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343033.260911:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cf:0x0]: returning size 0 00000004:00200000:2.0:1763343033.260916:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343033.260940:0:10042:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5795 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.260950:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5795 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.260970:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae5787 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.260977:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae5787 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.260984:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae5787 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.260993:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae5787 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.260999:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.261004:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae5787 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.261012:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae5787 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.261023:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935a00) 00010000:00010000:2.0:1763343033.261026:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.261030:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae5787 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.261036:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae5787 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.261050:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae578e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.261056:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae578e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.261061:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae578e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.261067:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.261069:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae578e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.261074:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae578e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.261080:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935d00) 00010000:00010000:2.0:1763343033.261083:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.261086:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae578e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.261090:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae578e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.261116:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae5779 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d62 expref: 255 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.261132:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5795 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d62 expref: 254 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.261138:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:2.0:1763343033.261140:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343033.261143:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3e800, rc 0) 00000100:00100000:2.0:1763343033.261187:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56842:x1848997993468800:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 729us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.261194:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9080 00000100:00100000:1.0:1763343033.265537:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.265666:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993469056 00000100:00100000:2.0:1763343033.265690:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993469056 00000100:00100000:2.0:1763343033.265769:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9081 00000100:00100000:2.0:1763343033.265783:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:55941:x1848997993469056:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343033.265811:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.265815:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1763343033.265851:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5780 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d5b expref: 254 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.265875:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5772 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d54 expref: 253 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.265888:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:2.0:1763343033.265895:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.265914:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae579c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d69 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.265993:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.266012:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5795 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d62 expref: 253 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.266023:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.266066:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5795 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d62 expref: 253 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.266081:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5795 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d62 expref: 253 pid: 10042 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343033.266102:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010237568:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343033.266214:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3538beac00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343033.268369:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.270198:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993469312 00000100:00100000:3.0:1763343033.270217:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993469312 00000100:00100000:3.0:1763343033.270307:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9082 00000100:00100000:3.0:1763343033.270320:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56842:x1848997993469312:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343033.270349:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.270379:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae57aa lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d70 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343033.270595:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010237568:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343033.270676:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.270711:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae57b1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.271179:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae57b1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.271198:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae57b1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343033.271216:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cf:0x0]: returning size 0 00010000:00010000:2.0:1763343033.271387:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae57aa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d70 expref: 257 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.271410:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae57b1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d70 expref: 256 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.271420:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:2.0:1763343033.271424:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763343033.271429:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6000, rc 0) 00000100:00100000:2.0:1763343033.271514:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56842:x1848997993469312:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1196us (3159us total) trans 8589939764 rc 0/0 00000100:00100000:2.0:1763343033.271524:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9082 00000100:00100000:1.0:1763343033.272591:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.273145:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993469440 00000100:00100000:3.0:1763343033.273160:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993469440 00010000:00010000:3.0:1763343033.273217:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5795 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d62 expref: 256 pid: 10042 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343033.273872:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2985 00000100:00100000:0.0:1763343033.273896:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:2429:x1848997993469440:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343033.273922:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343033.273932:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5795 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d62 expref: 256 pid: 10042 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.273948:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5795 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d62 expref: 256 pid: 10042 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.273990:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae5795 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d62 expref: 256 pid: 10042 timeout: 1326 lvb_type: 0 00010000:00010000:0.0:1763343033.274014:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:0.0:1763343033.274021:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.274035:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.274044:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.274086:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343033.274159:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:2429:x1848997993469440:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 273us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.274168:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2985 00010000:00010000:2.0:1763343033.274501:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.274511:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000040:00080000:2.0:1763343033.274863:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1367, 88 off115776 00000004:00080000:2.0:1763343033.274874:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226942252671ns, next at 1227177369372ns, rc = 0 00000040:00080000:2.0:1763343033.274921:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1366, 88 off115776 00000004:00080000:2.0:1763343033.274926:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226942304958ns, next at 1227177401661ns, rc = 0 00000040:00080000:2.0:1763343033.274948:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1367, 88 off115864 00000004:00080000:2.0:1763343033.274953:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1226942332247ns, next at 1227177401661ns, rc = 0 00000040:00080000:2.0:1763343033.274973:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1368, 88 off115864 00000004:00080000:2.0:1763343033.274977:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1226942356052ns, next at 1227177369372ns, rc = 0 00000100:00100000:1.0:1763343033.276495:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.276932:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993469568 00000100:00100000:2.0:1763343033.276945:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993469568 00000100:00100000:2.0:1763343033.277027:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9083 00000100:00100000:2.0:1763343033.277039:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56842:x1848997993469568:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.277079:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.277105:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae57bf lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d77 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.277236:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae57c6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.277251:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 2/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.277260:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae57c6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.277287:0:6523:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.277299:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae57c6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000001:00080000:3.0:1763343033.283503:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939765 is committed 00000004:00080000:3.0:1763343033.283522:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 900 committed 00000004:00080000:3.0:1763343033.283542:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 901 committed 00000004:00080000:3.0:1763343033.283561:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 900 committed 00000004:00080000:3.0:1763343033.283563:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 899 committed 00000100:00100000:1.0:1763343033.283796:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010237824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343033.283900:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343033.283950:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343033.283965:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010237952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343033.283991:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343033.284035:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010237824 00000100:00100000:1.0:1763343033.284044:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010237824 00000100:00100000:1.0:1763343033.284095:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010237952 00000100:00100000:1.0:1763343033.284097:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010237952 00000100:00100000:1.0:1763343033.284118:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6349 00000100:00100000:1.0:1763343033.284127:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e6ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3659:x1848998010237824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343033.284161:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:652 count 1 00010000:00010000:1.0:1763343033.284198:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177600/0x607405d401ae57cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.284223:0:28993:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae5606 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cd6 expref: 21 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343033.284232:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.284235:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.284239:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177600/0x607405d401ae57cd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.284271:0:28993:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae5606 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cd6 expref: 21 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343033.284287:0:28993:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae5606 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cd6 expref: 21 pid: 28993 timeout: 1326 lvb_type: 1 00000100:00100000:1.0:1763343033.284299:0:28993:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538755500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010238208:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343033.284374:0:28993:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe300 going to sleep for 11 seconds 00010000:00010000:0.0:1763343033.284601:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae568b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.284612:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae568b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.284654:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae568b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.284662:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343033.284668:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae568b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.284678:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae568b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.284699:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935d00) 00010000:00010000:0.0:1763343033.284703:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343033.284708:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae568b lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.284721:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae568b lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.284741:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5702 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343033.284748:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5702 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343033.284755:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5702 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343033.284760:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343033.284763:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5702 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343033.284769:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5702 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343033.284776:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935d00) 00010000:00010000:0.0:1763343033.284779:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343033.284782:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5702 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343033.284788:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5702 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343033.284807:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae576b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343033.284813:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae576b lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343033.284824:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae576b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343033.284830:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343033.284833:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae576b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343033.284839:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae576b lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343033.284843:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010237696:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1763343033.284849:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:0.0:1763343033.284853:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343033.284857:0:3644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae57c6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.284868:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae576b lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343033.284874:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae576b lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343033.284887:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343033.284910:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343033.284916:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010238080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343033.284934:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343033.286103:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010237696 00000100:00100000:0.0:1763343033.286119:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010237696 00000100:00100000:0.0:1763343033.286179:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010238080 00000100:00100000:0.0:1763343033.286183:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010238080 00000100:00100000:0.0:1763343033.286211:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6350 00000100:00100000:0.0:1763343033.286222:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3659:x1848998010237952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.286470:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3659:x1848998010237952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 249us (2477us total) trans 21474838817 rc 0/0 00000100:00100000:0.0:1763343033.286479:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6350 00000100:00100000:0.0:1763343033.286500:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6351 00000100:00100000:0.0:1763343033.286506:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3658:x1848998010237696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343033.286520:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:651 count 1 00010000:00010000:0.0:1763343033.286543:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae57d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.286566:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5630 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ce4 expref: 21 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.286575:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343033.286578:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343033.286582:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae57d4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.286644:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5630 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ce4 expref: 21 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.286657:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5630 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ce4 expref: 21 pid: 8407 timeout: 1326 lvb_type: 0 00000100:00100000:0.0:1763343033.286686:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3501219500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010238336:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343033.286759:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340468f780 going to sleep for 11 seconds 00000100:00100000:0.0:1763343033.286881:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6352 00000100:00100000:0.0:1763343033.286892:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3658:x1848998010238080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343033.286979:0:28995:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x28e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343033.286982:0:28995:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x28e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.286985:0:28995:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x28e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.286987:0:28995:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x28e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.286991:0:28995:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x28e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343033.287037:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3658:x1848998010238080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 149us (2102us total) trans 21474838818 rc 0/0 00000100:00100000:0.0:1763343033.287045:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6352 00000004:00080000:3.0:1763343033.287086:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478e680/2, rc 0, transno 21474838818 00000004:00080000:0.0:1763343033.287089:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478df80/2, rc 0, transno 21474838817 00000100:00100000:3.0:1763343033.287098:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010238080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.287098:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010237952:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763343033.293880:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d69 expref: 238 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.293903:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:0.0:1763343033.293907:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343033.293911:0:10042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae57c6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.293922:0:10042:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae57c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.293928:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae57c6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.294007:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae579c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d69 expref: 238 pid: 10042 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343033.294033:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d69 expref: 237 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.294076:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6200, rc 0) 00000100:00100000:0.0:1763343033.294182:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:55941:x1848997993469056:12345-192.168.204.21@tcp:101:bash.0 Request processed in 28400us (28658us total) trans 8589939765 rc 0/0 00000100:00100000:0.0:1763343033.294192:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9081 00010000:00010000:1.0:1763343033.294603:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae57c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.294613:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae57c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343033.294700:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cf:0x0]: returning size 2 00000004:00200000:1.0:1763343033.294706:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343033.294731:0:6523:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae57c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.294762:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae57bf lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d77 expref: 237 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.294777:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae57c6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d77 expref: 236 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.294784:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:1.0:1763343033.294787:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763343033.294789:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6800, rc 0) 00000100:00100000:1.0:1763343033.295175:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56842:x1848997993469568:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 17792us (18348us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.295183:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9083 00000100:00100000:0.0:1763343033.295281:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010238464:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343033.295351:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343033.295428:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010238464 00000100:00100000:1.0:1763343033.295438:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010238464 00000100:00100000:1.0:1763343033.295494:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6353 00000100:00100000:1.0:1763343033.295502:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3658:x1848998010238464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763343033.295533:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:653 count 1 00010000:00010000:1.0:1763343033.295559:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae57db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.295578:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae563e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf2 expref: 15 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.295587:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343033.295589:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343033.295594:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae57db lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.295659:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae563e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf2 expref: 15 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343033.295985:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.296011:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993469696 00000100:00100000:3.0:1763343033.296016:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993469696 00010000:00010000:3.0:1763343033.296046:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae5606 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cd6 expref: 22 pid: 28993 timeout: 1326 lvb_type: 1 00000100:00100000:3.0:1763343033.296075:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2986 00000100:00100000:3.0:1763343033.296084:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993469696:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763343033.296115:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010238720:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.296152:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343033.296198:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1763343033.296198:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010238720 00000100:00100000:2.0:1763343033.296204:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010238720 00010000:00010000:3.0:1763343033.296208:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae5606 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x28c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cd6 expref: 22 pid: 28993 timeout: 1326 lvb_type: 1 00010000:00010000:3.0:1763343033.296226:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae5606 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x28c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cd6 expref: 22 pid: 28993 timeout: 1326 lvb_type: 1 00000100:00100000:2.0:1763343033.296235:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6354 00000100:00100000:2.0:1763343033.296244:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3659:x1848998010238720:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763343033.296253:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343033.296256:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00080000:2.0:1763343033.296260:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:654 count 1 00010000:00010000:3.0:1763343033.296262:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177600/0x607405d401ae57cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.296276:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae57e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.296280:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177600/0x607405d401ae57cd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.296302:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e400/0x607405d401ae55ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ccf expref: 15 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343033.296309:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.296311:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.296315:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.296317:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae57e2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.296339:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e400/0x607405d401ae55ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ccf expref: 15 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.296351:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e400/0x607405d401ae55ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ccf expref: 15 pid: 15756 timeout: 1326 lvb_type: 1 00000100:00100000:3.0:1763343033.296360:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993469696:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 274us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.296370:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010238848:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343033.296371:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2986 00000100:00100000:2.0:1763343033.296425:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35011ca840 going to sleep for 11 seconds 00000100:00100000:3.0:1763343033.296447:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.296466:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993469824 00000100:00100000:3.0:1763343033.296471:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993469824 00000100:00100000:2.0:1763343033.296479:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010238976:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763343033.296489:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5630 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ce4 expref: 22 pid: 8407 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1763343033.296515:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2987 00000100:00100000:2.0:1763343033.296516:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343033.296526:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993469824:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343033.296537:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343033.296542:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5630 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ce4 expref: 22 pid: 8407 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343033.296549:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010238976 00010000:00010000:3.0:1763343033.296553:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5630 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ce4 expref: 22 pid: 8407 timeout: 1326 lvb_type: 0 00000100:00100000:2.0:1763343033.296555:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010238976 00010000:00010000:3.0:1763343033.296571:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343033.296574:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343033.296578:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae57d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343033.296587:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6355 00010000:00010000:3.0:1763343033.296597:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae57d4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343033.296598:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3660:x1848998010238976:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763343033.296643:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343033.296667:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993469824:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 143us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343033.296675:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2987 00000100:00100000:2.0:1763343033.296851:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3660:x1848998010238976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 254us (337us total) trans 17179871518 rc 0/0 00000100:00100000:2.0:1763343033.296859:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6355 00010000:00010000:1.0:1763343033.296953:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae563e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf2 expref: 15 pid: 8410 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343033.296974:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538755180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010238592:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343033.297004:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abed80 going to sleep for 11 seconds 00010000:00010000:1.0:1763343033.297048:0:28993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae5606 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cd6 expref: 21 pid: 28993 timeout: 1326 lvb_type: 1 00000100:00100000:1.0:1763343033.297062:0:28993:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538755500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010238208:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.297083:0:28993:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d177600/0x607405d401ae57cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.297092:0:28993:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d177600/0x607405d401ae57cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.297098:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177600/0x607405d401ae57cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.297108:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177600/0x607405d401ae57cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.297115:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177600/0x607405d401ae57cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.297135:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343033.297357:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e6ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3659:x1848998010237824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13230us (13457us total) trans 21474838819 rc 0/0 00000100:00100000:1.0:1763343033.297364:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6349 00010000:00010000:1.0:1763343033.297501:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343033.297509:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d177600/0x607405d401ae57cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.297532:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343033.297537:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177600/0x607405d401ae57cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.297546:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177600/0x607405d401ae57cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.297563:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d177600/0x607405d401ae57cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.297570:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177600/0x607405d401ae57cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.297588:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.297589:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.297591:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.297847:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae5630 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ce4 expref: 20 pid: 8407 timeout: 1326 lvb_type: 0 00000100:00100000:1.0:1763343033.297865:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3501219500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010238336:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.297883:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae57d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.297923:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343033.297938:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010239104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343033.297990:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343033.298029:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010239104 00000004:00080000:2.0:1763343033.299008:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478fb80/2, rc 0, transno 21474838819 00000100:00100000:2.0:1763343033.299020:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010237824:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.299522:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010239104 00000100:00100000:0.0:1763343033.299602:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6356 00000100:00100000:0.0:1763343033.299612:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3658:x1848998010239104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343033.299843:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x290:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343033.299847:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x290:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.299850:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x290:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.299852:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x290:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.299854:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x290:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343033.299938:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010239104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 326us (1946us total) trans 17179871519 rc 0/0 00000100:00100000:0.0:1763343033.299947:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6356 00000004:00080000:2.0:1763343033.300133:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c3ad80/2, rc 0, transno 17179871519 00000100:00100000:2.0:1763343033.300140:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010239104:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343033.301205:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f39180/2, rc 0, transno 17179871518 00000100:00100000:3.0:1763343033.301217:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010238976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.301227:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.301273:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993469952 00000100:00100000:3.0:1763343033.301281:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993469952 00000100:00100000:3.0:1763343033.301332:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9084 00000100:00100000:3.0:1763343033.301341:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:56842:x1848997993469952:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343033.301364:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.301387:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae57e9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d7e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.301461:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae57e9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d7e expref: 237 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.301480:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae57e9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d7e expref: 237 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.301504:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:3.0:1763343033.301508:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343033.301514:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343033.301576:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56842:x1848997993469952:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 235us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343033.301583:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9084 00010000:00010000:1.0:1763343033.301684:0:8410:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae57d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.301702:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae57d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.301716:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae57d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.301725:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae57d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.301755:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343033.302053:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3658:x1848998010237696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15546us (17166us total) trans 21474838820 rc 0/0 00000100:00100000:1.0:1763343033.302063:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6351 00010000:00010000:3.0:1763343033.302243:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343033.302251:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae57d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763343033.302258:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478c000/2, rc 0, transno 21474838820 00010000:00010000:3.0:1763343033.302259:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343033.302267:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae57d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343033.302268:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010237696:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1763343033.302284:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae57d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.302306:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae57d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.302314:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae57d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.302334:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343033.302336:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343033.302338:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343033.305185:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.305339:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.305395:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993470208 00000100:00100000:1.0:1763343033.305406:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993470208 00010000:00010000:1.0:1763343033.305457:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e400/0x607405d401ae55ff lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ccf expref: 16 pid: 15756 timeout: 1326 lvb_type: 1 00000100:00100000:0.0:1763343033.305460:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993470080 00000100:00100000:0.0:1763343033.305466:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993470080 00000100:00100000:1.0:1763343033.305516:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2988 00000100:00100000:0.0:1763343033.305516:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6357 00000100:00100000:1.0:1763343033.305532:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993470208:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1763343033.305534:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993470080:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343033.305557:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343033.305558:0:8410:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.305567:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e400/0x607405d401ae55ff lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ccf expref: 17 pid: 15756 timeout: 1326 lvb_type: 1 00010000:00010000:0.0:1763343033.305585:0:8410:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae57f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d85 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.305586:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e400/0x607405d401ae55ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ccf expref: 17 pid: 15756 timeout: 1326 lvb_type: 1 00000100:00100000:2.0:1763343033.305616:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010238848:192.168.204.21@tcp:104: 00002000:00010000:0.0:1763343033.305645:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343033.305666:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3e400/0x607405d401ae55ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ccf expref: 18 pid: 15756 timeout: 1326 lvb_type: 1 00010000:00010000:0.0:1763343033.305669:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.305674:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.305688:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.305689:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae57f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d85 expref: 17 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.305693:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.305700:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae57e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.305711:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae57e2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.305712:0:8410:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae57f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d85 expref: 17 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.305738:0:8410:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665ca00, rc 0) 00010000:00010000:1.0:1763343033.305749:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343033.305805:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993470208:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 276us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.305814:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2988 00000100:00100000:0.0:1763343033.305945:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:55941:x1848997993470080:12345-192.168.204.21@tcp:101:bash.0 Request processed in 416us (2389us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.305951:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6357 00000100:00100000:3.0:1763343033.306183:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538755180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010238592:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343033.306205:0:8408:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae57db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.306239:0:15756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae57e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.306252:0:15756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae57e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.306261:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae57e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.306271:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae57e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.306279:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae57e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.306309:0:15756:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343033.306613:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343033.306655:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae57e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.306677:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343033.306682:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae57e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.306692:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae57e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.306710:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae57e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.306717:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae57e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.306736:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343033.306738:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343033.306740:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343033.307220:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010238720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10973us (11064us total) trans 17179871520 rc 0/0 00000100:00100000:2.0:1763343033.307230:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6354 00000004:00080000:3.0:1763343033.308114:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f39c00/2, rc 0, transno 17179871520 00000100:00100000:3.0:1763343033.308127:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010238720:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343033.309107:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.309166:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.309193:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.309225:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993470336 00000100:00100000:1.0:1763343033.309237:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993470336 00000100:00100000:3.0:1763343033.309287:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993470592 00010000:00010000:1.0:1763343033.309288:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae563e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf2 expref: 16 pid: 8410 timeout: 1326 lvb_type: 0 00000100:00100000:3.0:1763343033.309294:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993470592 00000100:00100000:3.0:1763343033.309387:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2989 00000100:00100000:3.0:1763343033.309399:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993470336:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343033.309420:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343033.309427:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae563e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf2 expref: 16 pid: 8410 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343033.309454:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae563e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf2 expref: 16 pid: 8410 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343033.309483:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae563e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8cf2 expref: 16 pid: 8410 timeout: 1326 lvb_type: 0 00010000:00010000:3.0:1763343033.309499:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343033.309501:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343033.309507:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae57db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.309518:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae57db lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.309548:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343033.309608:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2432:x1848997993470336:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 211us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343033.309614:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2989 00000100:00100000:0.0:1763343033.309668:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 407 00000100:00100000:0.0:1763343033.309683:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:2432:x1848997993470592:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343033.309690:0:8408:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae57db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.309695:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343033.309704:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae57db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.309718:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae57e9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d7e expref: 237 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.309722:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae57db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.309739:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae57db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.309742:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:0.0:1763343033.309751:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343033.309758:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343033.309776:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:2432:x1848997993470592:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 99us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.309784:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 407 00000100:00100000:0.0:1763343033.309854:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993470464 00000100:00100000:0.0:1763343033.309860:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993470464 00000100:00100000:0.0:1763343033.309890:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6358 00000100:00100000:0.0:1763343033.309898:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993470464:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343033.309917:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.309935:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae57f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d8c expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.310007:0:28993:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3501218e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:28993:1848998010239232:192.168.204.21@tcp:106: 00010000:00010000:1.0:1763343033.310288:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343033.310298:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae57db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.310317:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343033.310323:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae57db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.310333:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae57db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.310353:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae57db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.310360:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae57db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.310379:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.310381:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.310383:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343033.311563:0:28993:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340468f900 going to sleep for 11 seconds 00000100:00100000:3.0:1763343033.311829:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010238464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16320us (16471us total) trans 17179871521 rc 0/0 00000100:00100000:3.0:1763343033.311842:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6353 00000004:00080000:0.0:1763343033.311976:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f38e00/2, rc 0, transno 17179871521 00000100:00100000:0.0:1763343033.311983:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010238464:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.312146:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.313285:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993470720 00000100:00100000:3.0:1763343033.313300:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993470720 00000100:00100000:3.0:1763343033.313365:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6359 00000100:00100000:3.0:1763343033.313376:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:55941:x1848997993470720:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343033.313399:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.313427:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae57fe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d93 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343033.313457:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343033.313484:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343033.313486:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343033.313496:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae57fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d93 expref: 21 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.313512:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae57fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d93 expref: 21 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.313530:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343033.313586:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:55941:x1848997993470720:12345-192.168.204.21@tcp:101:bash.0 Request processed in 212us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343033.313592:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6359 00000100:00100000:0.0:1763343033.317947:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.318008:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00002000:00010000:0.0:1763343033.318237:0:28993:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x28f:0x0] updating lvb mtime: 0 -> 1763343033 00002000:00010000:0.0:1763343033.318242:0:28993:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x28f:0x0] updating lvb atime: 0 -> 1763343033 00002000:00010000:0.0:1763343033.318248:0:28993:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x28f:0x0] updating lvb ctime: 0 -> 1763343033 00000100:00100000:0.0:1763343033.318273:0:28993:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3501218e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:28993:1848998010239232:192.168.204.21@tcp:106: 00010000:00010000:0.0:1763343033.318322:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae57f7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d8c expref: 16 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343033.318351:0:28993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae57f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d8c expref: 16 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343033.318366:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665da00, rc 0) 00000100:00100000:0.0:1763343033.318444:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993470464:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8546us (9277us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343033.318455:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6358 00000100:00100000:3.0:1763343033.318543:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993470848 00000100:00100000:1.0:1763343033.318544:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993470976 00000100:00100000:3.0:1763343033.318554:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993470848 00000100:00100000:1.0:1763343033.318554:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993470976 00002000:00010000:3.0:1763343033.318606:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/655 (0->18446744073709551615) 00002000:00010000:1.0:1763343033.318607:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/653 (0->18446744073709551615) 00002000:00100000:3.0:1763343033.318614:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a350121b480 with x1848997993470848 ext(0->18446744073709551615) 00002000:00100000:1.0:1763343033.318616:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3501219180 with x1848997993470976 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343033.318665:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3501219180. 00002000:00010000:3.0:1763343033.318668:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a350121b480. 00000100:00100000:3.0:1763343033.318694:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1560 00000100:00100000:3.0:1763343033.318703:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993470848:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:1.0:1763343033.318743:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1561 00000100:00100000:1.0:1763343033.318753:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993470976:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343033.318934:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x28f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343033.318935:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x28d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343033.318940:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x28f:0x0] updating lvb mtime from disk: 1763343033 -> 1763343033 00002000:00010000:1.0:1763343033.318941:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x28d:0x0] updating lvb mtime from disk: 0 -> 1763343033 00002000:00010000:3.0:1763343033.318944:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x28f:0x0] updating lvb atime from disk: 1763343033 -> 0 00002000:00010000:1.0:1763343033.318947:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x28d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343033.318949:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x28f:0x0] updating lvb ctime from disk: 1763343033 -> 1763343033 00002000:00010000:1.0:1763343033.318952:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x28d:0x0] updating lvb ctime from disk: 0 -> 1763343033 00002000:00010000:3.0:1763343033.318954:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x28f:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1763343033.318967:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x28d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343033.319014:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993470848:12345-192.168.204.21@tcp:10:bash.0 Request processed in 311us (1083us total) trans 17179871522 rc 0/0 00000100:00100000:3.0:1763343033.319022:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1560 00002000:00010000:3.0:1763343033.319025:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/655 (0->18446744073709551615) 00002000:00100000:3.0:1763343033.319028:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a350121b480 with x1848997993470848 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343033.319032:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a350121b480. 00000100:00100000:1.0:1763343033.320549:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993470976:12345-192.168.204.21@tcp:10:bash.0 Request processed in 1786us (2530us total) trans 21474838821 rc 0/0 00000100:00100000:1.0:1763343033.320563:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1561 00002000:00010000:1.0:1763343033.320569:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/653 (0->18446744073709551615) 00002000:00100000:1.0:1763343033.320573:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3501219180 with x1848997993470976 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343033.320582:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3501219180. 00000100:00100000:3.0:1763343033.327767:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.327809:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.327826:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993471488 00000100:00100000:0.0:1763343033.327842:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993471488 00000100:00100000:3.0:1763343033.328236:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993471232 00000100:00100000:3.0:1763343033.328241:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993471232 00000100:00100000:2.0:1763343033.328333:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9085 00000100:00100000:2.0:1763343033.328347:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56842:x1848997993471232:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.328381:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.328412:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5805 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8d9a expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.328507:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3086 00000100:00100000:0.0:1763343033.328519:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fb8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:55941:x1848997993471488:12345-192.168.204.21@tcp:35:bash.0 00010000:00010000:2.0:1763343033.328522:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae580c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.328541:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae580c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.328560:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae580c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.328575:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5813 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.328582:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5813 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.328588:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5813 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.328813:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae581a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.328824:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae581a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.328832:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae581a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343033.328844:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cf:0x0]: returning size 5 00010000:00010000:2.0:1763343033.328911:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae580c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:0.0:1763343033.328919:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fb8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993471488:12345-192.168.204.21@tcp:35:bash.0 Request processed in 401us (1166us total) trans 8589939766 rc 0/0 00010000:00010000:2.0:1763343033.328923:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae580c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00000100:00100000:0.0:1763343033.328934:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3086 00010000:00010000:2.0:1763343033.328935:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae580c lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.328945:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae580c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.328965:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.328971:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae580c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.328978:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae580c lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.328993:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935a00) 00010000:00010000:2.0:1763343033.328997:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.329002:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae580c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.329009:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae580c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.329023:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5813 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.329029:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5813 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.329034:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5813 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.329038:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.329041:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5813 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.329047:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5813 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.329054:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935800) 00010000:00010000:2.0:1763343033.329057:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.329060:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5813 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.329069:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5813 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.329108:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5805 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d9a expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.329124:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae581a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d9a expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.329130:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:2.0:1763343033.329133:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343033.329136:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7200, rc 0) 00000100:00100000:2.0:1763343033.329171:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56842:x1848997993471232:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 829us (1365us total) trans 8589939767 rc 0/0 00000100:00100000:2.0:1763343033.329179:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9085 00000100:00100000:2.0:1763343033.338572:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.338723:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993471616 00000100:00100000:0.0:1763343033.338739:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993471616 00000100:00100000:0.0:1763343033.338814:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3087 00000100:00100000:0.0:1763343033.338827:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56842:x1848997993471616:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:0.0:1763343033.339070:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56842:x1848997993471616:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 244us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.339079:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3087 00000100:00100000:3.0:1763343033.345057:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.346593:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993471872 00000100:00100000:0.0:1763343033.346614:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993471872 00000100:00100000:0.0:1763343033.346723:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3088 00000100:00100000:0.0:1763343033.346736:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56843:x1848997993471872:12345-192.168.204.21@tcp:35:rm.0 00000100:00100000:0.0:1763343033.355358:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56843:x1848997993471872:12345-192.168.204.21@tcp:35:rm.0 Request processed in 8603us (10296us total) trans 8589939768 rc 0/0 00000100:00100000:0.0:1763343033.355380:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3088 00000100:00100000:3.0:1763343033.355483:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.355537:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993472128 00000100:00100000:0.0:1763343033.355550:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993472128 00000100:00100000:0.0:1763343033.355610:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9086 00000100:00100000:0.0:1763343033.355664:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56842:x1848997993472128:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343033.355695:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.355726:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5828 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8da1 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.355899:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae582f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.355918:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae582f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.355935:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae582f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:0.0:1763343033.355951:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1cf:0x0]: returning size 5 00010000:00010000:0.0:1763343033.356348:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5828 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8da1 expref: 243 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.356367:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae582f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8da1 expref: 242 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.356377:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:0.0:1763343033.356380:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343033.356384:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d800, rc 0) 00000100:00100000:0.0:1763343033.356463:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56842:x1848997993472128:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 842us (980us total) trans 8589939769 rc 0/0 00000100:00100000:0.0:1763343033.356469:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9086 00000100:00100000:2.0:1763343033.364140:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.364772:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993472384 00000100:00100000:1.0:1763343033.364789:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993472384 00000100:00100000:1.0:1763343033.364871:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3089 00000100:00100000:1.0:1763343033.364886:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56842:x1848997993472384:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:1.0:1763343033.364996:0:6527:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1cf:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae582f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8da1 expref: 242 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.365056:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae583d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.365071:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5764 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d4d expref: 242 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.365080:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae581a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d9a expref: 242 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.365088:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d69 expref: 242 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.365096:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae583d lrc: 6/0,1 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.365136:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d69 expref: 242 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.365149:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d69 expref: 242 pid: 10042 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.365165:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538755880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010239360:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.365290:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae581a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d9a expref: 242 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.365298:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae581a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d9a expref: 242 pid: 10042 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.365307:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538756a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010239488:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.365336:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5764 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d4d expref: 242 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.365344:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5764 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d4d expref: 242 pid: 10042 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.365352:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538757b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010239616:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343033.365375:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe300 going to sleep for 11 seconds 00000100:00100000:0.0:1763343033.366793:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.366985:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993472640 00000100:00100000:2.0:1763343033.366999:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993472640 00000100:00100000:2.0:1763343033.367103:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9087 00000100:00100000:2.0:1763343033.367113:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56843:x1848997993472640:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:2.0:1763343033.367191:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:2.0:1763343033.367210:0:10042:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d69 expref: 243 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.367243:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae57b1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d70 expref: 243 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.367273:0:10042:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae581a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d9a expref: 242 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.367287:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae57c6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d77 expref: 242 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.367299:0:10042:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5764 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d4d expref: 241 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.367312:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:2.0:1763343033.367319:0:10042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae583d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.367329:0:10042:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae583d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.367336:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae583d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.367359:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.367395:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5844 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.367406:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5844 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.367414:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5844 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.367427:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae584b lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.367437:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae584b lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.367443:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae584b lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.367554:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5852 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.367563:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5852 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.367571:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5852 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00080000:2.0:1763343033.367909:0:10042:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1cf:0x0] is inserted into orphan list, open count = 2 00010000:00010000:2.0:1763343033.368025:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5852 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368034:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5852 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368041:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5852 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368048:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.368053:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5852 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368061:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5852 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368072:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:2.0:1763343033.368076:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343033.368080:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5852 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368087:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5852 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368103:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5844 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368109:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5844 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368115:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5844 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368120:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5844 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368125:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.368128:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5844 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368134:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5844 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368141:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935a00) 00010000:00010000:2.0:1763343033.368144:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.368146:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5844 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368478:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5844 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:2.0:1763343033.368498:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001261f741 reply state 0000000065adb7c9 transno 8589939770 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae584b lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368512:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae584b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.368519:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935800) 00010000:00010000:2.0:1763343033.368522:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343033.368526:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343033.368647:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56843:x1848997993472640:12345-192.168.204.21@tcp:36:rm.0 Request processed in 1509us (1842us total) trans 8589939770 rc 0/0 00000100:00100000:2.0:1763343033.368657:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9087 00010000:00010000:1.0:1763343033.369463:0:6527:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@00000000dc18ab38 x1848998010239360) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d69 expref: 242 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.369485:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae57a3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d69 expref: 242 pid: 10042 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.369501:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538755880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010239360:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.369516:0:6527:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@000000005f5ab484 x1848998010239488) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae581a lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d9a expref: 241 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.369526:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae581a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d9a expref: 241 pid: 10042 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.369536:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538756a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010239488:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.369546:0:6527:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@00000000a549780e x1848998010239616) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5764 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d4d expref: 240 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.369556:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5764 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1cf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d4d expref: 240 pid: 10042 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.369565:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538757b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010239616:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.369602:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:1.0:1763343033.369611:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae583d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.369650:0:6527:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae583d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.369657:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae583d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00000004:00020000:1.0:1763343033.369837:0:6527:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0000-mdtlov: can not set all stale mirrors for [0x200000405:0x1cf:0x0]: rc = -1 00010000:00010000:1.0:1763343033.369868:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae583d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.369876:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae583d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.369882:0:6527:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae583d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.369889:0:6527:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.369894:0:6527:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae583d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.369900:0:6527:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae583d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.369913:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:1.0:1763343033.369916:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1763343033.369920:0:6527:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae583d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.369925:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae583d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1cf:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.369938:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:1.0:1763343033.369941:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343033.369945:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae582f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8da1 expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343033.370152:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56842:x1848997993472384:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 5268us (6025us total) trans 8589939771 rc -1/-1 00000100:00100000:1.0:1763343033.370164:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3089 00000100:00100000:0.0:1763343033.381311:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.381487:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993472768 00000100:00100000:2.0:1763343033.381502:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993472768 00000100:00100000:2.0:1763343033.381577:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9088 00000100:00100000:2.0:1763343033.381588:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56842:x1848997993472768:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.381655:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.381689:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5859 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8da8 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.381765:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5859 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8da8 expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.381782:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f200/0x607405d401ae5859 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1cf:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8da8 expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.381802:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a3518935a00) 00010000:00010000:2.0:1763343033.381806:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343033.381810:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f200, rc 0) 00000100:00100000:2.0:1763343033.381881:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56842:x1848997993472768:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 295us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.381894:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9088 00000100:00100000:3.0:1763343033.389952:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.390021:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.390170:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993472896 00000100:00100000:1.0:1763343033.390184:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993472896 00000100:00100000:1.0:1763343033.390275:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9089 00000100:00100000:1.0:1763343033.390290:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56844:x1848997993472896:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.390320:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.390352:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5860 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8daf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.390444:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5867 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390462:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5867 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390478:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5867 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390493:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae586e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390501:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae586e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390509:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae586e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390564:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5867 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390572:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5867 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390579:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5867 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390586:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5867 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390593:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.390598:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5867 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390605:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5867 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390664:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc300) 00010000:00010000:1.0:1763343033.390668:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.390674:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5867 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390682:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5867 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390698:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae586e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390705:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae586e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390712:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae586e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390717:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.390720:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae586e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390726:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae586e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390734:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935800) 00010000:00010000:1.0:1763343033.390737:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.390740:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae586e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390745:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae586e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.390776:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5860 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8daf expref: 241 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.390787:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc300) 00010000:00010000:1.0:1763343033.390789:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.390792:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5860 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8daf expref: 241 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.390809:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00000100:00100000:1.0:1763343033.390890:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56844:x1848997993472896:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 604us (954us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343033.390898:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9089 00000100:00100000:2.0:1763343033.392584:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993473152 00000100:00100000:2.0:1763343033.392603:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993473152 00000100:00100000:2.0:1763343033.392717:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3090 00000100:00100000:2.0:1763343033.392728:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56842:x1848997993473152:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:2.0:1763343033.393056:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1cf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763343033.393146:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1369, 64 off115928 00000040:00080000:2.0:1763343033.393174:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1368, 64 off115928 00000040:00080000:2.0:1763343033.393183:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1369, 64 off115992 00000040:00080000:2.0:1763343033.393191:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1370, 64 off115992 00010000:00010000:2.0:1763343033.393276:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5875 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.393296:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5875 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.393309:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5875 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.393318:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5875 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.393325:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5875 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.393332:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5875 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.393357:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343033.393607:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56842:x1848997993473152:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 878us (3583us total) trans 8589939772 rc 0/0 00000100:00100000:2.0:1763343033.393652:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3090 00010000:00010000:1.0:1763343033.393815:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343033.393823:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5875 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.393831:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343033.393835:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5875 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.393844:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5875 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.393858:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1cf:0x0].0x0 (ffff9a3518935a00) 00010000:00010000:1.0:1763343033.393861:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343033.393867:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5875 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.393873:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5875 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.393886:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.393888:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.393890:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343033.394195:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.395935:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993473280 00000100:00100000:2.0:1763343033.395965:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993473280 00000100:00100000:1.0:1763343033.398543:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9090 00000100:00100000:1.0:1763343033.398614:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56844:x1848997993473280:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.398664:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.398701:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae587c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8db6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.398798:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5883 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.398815:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5883 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.398831:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5883 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.398843:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae588a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.398850:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae588a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.398856:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae588a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.398912:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5883 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.398920:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5883 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.398926:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5883 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.398933:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5883 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.398938:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.398943:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5883 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.398950:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5883 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.398976:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc400) 00010000:00010000:1.0:1763343033.398980:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.398986:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5883 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.398992:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5883 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.399009:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae588a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.399015:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae588a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.399021:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae588a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.399026:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.399028:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae588a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.399034:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae588a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.399040:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935800) 00010000:00010000:1.0:1763343033.399043:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.399046:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae588a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.399052:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae588a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.399084:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae587c lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8db6 expref: 242 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.399095:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc400) 00010000:00010000:1.0:1763343033.399099:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.399102:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae587c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8db6 expref: 242 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.399119:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:1.0:1763343033.401376:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56844:x1848997993473280:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2800us (7167us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343033.401393:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9090 00000100:00100000:3.0:1763343033.405755:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.405934:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993473408 00000100:00100000:1.0:1763343033.405948:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993473408 00000100:00100000:1.0:1763343033.406040:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9091 00000100:00100000:1.0:1763343033.406053:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56844:x1848997993473408:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.406085:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.406115:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5891 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8dbd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.406201:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5898 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.406218:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5898 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.406232:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5898 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343033.406286:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343033.406293:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343033.406337:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5891 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dbd expref: 243 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.406372:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5898 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dbd expref: 242 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.406383:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc300) 00010000:00010000:1.0:1763343033.406387:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343033.406391:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177600, rc 0) 00000100:00100000:1.0:1763343033.406473:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56844:x1848997993473408:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 423us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.406482:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9091 00000100:00100000:0.0:1763343033.411373:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.411491:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993473536 00000100:00100000:2.0:1763343033.411505:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993473536 00000100:00100000:2.0:1763343033.412046:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9092 00000100:00100000:2.0:1763343033.412060:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56844:x1848997993473536:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.412088:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.412119:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae589f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8dc4 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.412209:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae58a6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412225:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae58a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412237:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae58a6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412249:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58ad lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412256:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412263:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412321:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae58a6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412332:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae58a6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412339:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae58a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412345:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae58a6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412351:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.412356:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae58a6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412363:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae58a6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412378:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc300) 00010000:00010000:2.0:1763343033.412381:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.412387:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae58a6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412393:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae58a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412409:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412415:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58ad lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412420:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412425:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.412428:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412432:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58ad lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412438:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935800) 00010000:00010000:2.0:1763343033.412441:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.412443:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58ad lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412448:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58ad lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.412480:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae589f lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dc4 expref: 243 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.412491:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc300) 00010000:00010000:2.0:1763343033.412493:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.412496:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae589f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dc4 expref: 243 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.412504:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3fa00, rc 0) 00000100:00100000:2.0:1763343033.414570:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56844:x1848997993473536:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2498us (3195us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343033.414586:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9092 00000100:00100000:0.0:1763343033.419527:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.419801:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993473792 00000100:00100000:2.0:1763343033.419816:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993473792 00000100:00100000:2.0:1763343033.419895:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9093 00000100:00100000:2.0:1763343033.419906:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56844:x1848997993473792:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.419937:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.419941:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343033.420017:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5898 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dbd expref: 242 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.420043:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc300) 00010000:00010000:2.0:1763343033.420057:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.420083:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae58b4 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8dcb expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.420219:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae58bb lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420234:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae58bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420245:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae58bb lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420257:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae58c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420264:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae58c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420271:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae58c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420792:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae58c9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420802:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae58c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420811:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae58c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343033.420822:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d0:0x0]: returning size 0 00010000:00010000:2.0:1763343033.420854:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae58bb lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420862:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae58bb lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420868:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae58bb lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420875:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae58bb lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420880:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.420885:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae58bb lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420893:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae58bb lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420902:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935000) 00010000:00010000:2.0:1763343033.420906:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.420910:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae58bb lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420916:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae58bb lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:2.0:1763343033.420929:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dde0a275 reply state 000000003aa94f0d transno 8589939773 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae58c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420946:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae58c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.420952:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935800) 00010000:00010000:2.0:1763343033.420968:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343033.420971:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343033.421004:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae58b4 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dcb expref: 244 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.421022:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae58c9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dcb expref: 243 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.421029:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3518935700) 00010000:00010000:2.0:1763343033.421032:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343033.421034:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3e400, rc 0) 00000100:00100000:2.0:1763343033.421136:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56844:x1848997993473792:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1230us (1623us total) trans 8589939773 rc 0/0 00000100:00100000:2.0:1763343033.421145:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9093 00000100:00100000:0.0:1763343033.424459:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.426589:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993474048 00000100:00100000:1.0:1763343033.426613:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993474048 00000100:00100000:0.0:1763343033.427474:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9094 00000100:00100000:0.0:1763343033.427491:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56845:x1848997993474048:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343033.427524:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.427552:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae58d7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8dd2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.427722:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae58de lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.427742:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae58de lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.427756:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae58de lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343033.427769:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d0:0x0]: returning size 0 00010000:00010000:0.0:1763343033.427911:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae58d7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dd2 expref: 247 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.427930:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae58de lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dd2 expref: 246 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.427940:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3518935700) 00010000:00010000:0.0:1763343033.427943:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343033.427948:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665dc00, rc 0) 00000100:00100000:0.0:1763343033.428057:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56845:x1848997993474048:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 570us (3614us total) trans 8589939774 rc 0/0 00000100:00100000:0.0:1763343033.428065:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9094 00000100:00100000:0.0:1763343033.431002:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.431222:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993474304 00000100:00100000:2.0:1763343033.431235:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993474304 00000100:00100000:2.0:1763343033.431316:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9095 00000100:00100000:2.0:1763343033.431326:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56844:x1848997993474304:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.431352:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.431378:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae58ec lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8dd9 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.431556:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.431575:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae58c9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dcb expref: 247 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.431584:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae58de lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dd2 expref: 247 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.431593:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.431688:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae58de lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dd2 expref: 247 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.431705:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae58de lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dd2 expref: 247 pid: 6523 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343033.431721:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c38000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010239744:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343033.431833:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae58c9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dcb expref: 247 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.431843:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae58c9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dcb expref: 247 pid: 10042 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343033.431852:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010239872:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343033.431879:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34050d5000 going to sleep for 11 seconds 00000100:00100000:3.0:1763343033.436610:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.436703:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.437163:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993474560 00000100:00100000:0.0:1763343033.437177:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993474560 00000100:00100000:0.0:1763343033.437259:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3091 00000100:00100000:0.0:1763343033.437281:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fb8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56845:x1848997993474560:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343033.437648:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fb8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56845:x1848997993474560:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 341us (1023us total) trans 8589939775 rc 0/0 00000100:00100000:0.0:1763343033.437657:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3091 00000100:00100000:1.0:1763343033.437794:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993474688 00000100:00100000:1.0:1763343033.437799:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993474688 00010000:00010000:1.0:1763343033.437830:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae58de lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dd2 expref: 249 pid: 6523 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.437871:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2990 00000100:00100000:1.0:1763343033.437878:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:2432:x1848997993474688:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343033.437894:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343033.437901:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae58de lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dd2 expref: 249 pid: 6523 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.437914:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae58de lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dd2 expref: 249 pid: 6523 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.437942:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3518935700) 00010000:00010000:1.0:1763343033.437948:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.437969:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343033.437997:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:2432:x1848997993474688:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 120us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.438004:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2990 00010000:00010000:2.0:1763343033.438690:0:10042:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@000000006d5ae774 x1848998010239744) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae58de lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dd2 expref: 248 pid: 6523 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.438718:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae58de lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dd2 expref: 248 pid: 6523 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343033.438735:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c38000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010239744:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343033.438750:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010239872:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343033.438775:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3518935700) 00010000:00010000:2.0:1763343033.438781:0:10042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.438792:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:0.0:1763343033.440141:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.440365:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993474816 00000100:00100000:2.0:1763343033.440376:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993474816 00010000:00010000:2.0:1763343033.440420:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae58c9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dcb expref: 248 pid: 10042 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.440726:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2991 00000100:00100000:1.0:1763343033.440739:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:2430:x1848997993474816:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343033.440758:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343033.440764:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae58c9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dcb expref: 248 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.440779:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae58c9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dcb expref: 248 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.440803:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae58c9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dcb expref: 248 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.440824:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3518935700) 00010000:00010000:1.0:1763343033.440830:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.440840:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.440848:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.440887:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343033.440967:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:2430:x1848997993474816:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 230us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.440976:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2991 00010000:00010000:3.0:1763343033.441559:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.441570:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343033.441602:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d0:0x0]: returning size 0 00000004:00080000:3.0:1763343033.441887:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x28f:0x0], index 0: 0 00000004:00080000:3.0:1763343033.441896:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x291:0x0], index 1: 0 00000004:00080000:3.0:1763343033.441902:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x292:0x0], index 1: 0 00000004:00080000:3.0:1763343033.441906:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x290:0x0], index 0: 0 00010000:00010000:3.0:1763343033.442055:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.442064:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.442072:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.442078:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.442082:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.442091:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.442105:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3518935700) 00010000:00010000:3.0:1763343033.442108:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343033.442113:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.442119:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae58f3 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.442186:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae58ec lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dd9 expref: 247 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.442197:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3518935700) 00010000:00010000:3.0:1763343033.442199:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343033.442203:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae58ec lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dd9 expref: 247 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.442220:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3fa00, rc 0) 00000100:00100000:3.0:1763343033.442293:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56844:x1848997993474304:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 10967us (11305us total) trans 8589939776 rc 301/301 00000100:00100000:3.0:1763343033.442306:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9095 00000100:00100000:2.0:1763343033.442605:0:32358:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32358:1848998010240000:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1763343033.442687:0:32358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.442727:0:32358:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34050d5000 going to sleep for 11 seconds 00000100:00100000:1.0:1763343033.442971:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.443895:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993475072 00000100:00100000:2.0:1763343033.443908:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993475072 00000100:00100000:2.0:1763343033.443971:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9096 00000100:00100000:2.0:1763343033.443982:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56845:x1848997993475072:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.444007:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.444033:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5901 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8de0 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.444121:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5908 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444135:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5908 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444148:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5908 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444159:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae590f lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444166:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae590f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444172:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae590f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444292:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5916 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444299:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5916 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444305:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5916 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444398:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5908 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444405:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5908 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444411:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5908 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444417:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5908 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444423:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.444428:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5908 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444435:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5908 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444447:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935000) 00010000:00010000:2.0:1763343033.444449:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.444454:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5908 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444460:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae5908 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444475:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae590f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444480:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae590f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444486:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae590f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444491:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.444494:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae590f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444500:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae590f lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444512:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935800) 00010000:00010000:2.0:1763343033.444514:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.444517:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae590f lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444523:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae590f lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.444558:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae5901 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8de0 expref: 249 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.444575:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5916 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8de0 expref: 248 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.444581:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3518935500) 00010000:00010000:2.0:1763343033.444584:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343033.444586:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7200, rc 0) 00000100:00100000:2.0:1763343033.444682:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56845:x1848997993475072:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 702us (1711us total) trans 8589939777 rc 0/0 00000100:00100000:2.0:1763343033.444691:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9096 00000100:00100000:3.0:1763343033.446124:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010240000 00000100:00100000:3.0:1763343033.446138:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010240000 00000100:00100000:3.0:1763343033.446359:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6360 00000100:00100000:3.0:1763343033.446371:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:32358:x1848998010240000:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1763343033.446424:0:28993:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 674 00000100:00100000:1.0:1763343033.452010:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.452128:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.452208:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993475328 00000100:00100000:2.0:1763343033.452222:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993475328 00000100:00100000:2.0:1763343033.452297:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3092 00000100:00100000:3.0:1763343033.452311:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:32358:x1848998010240000:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5939us (9620us total) trans 17179871523 rc 0/0 00000100:00100000:3.0:1763343033.452326:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6360 00000100:00100000:2.0:1763343033.452350:0:32358:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32358:1848998010240000:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1763343033.452352:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993475456 00000100:00100000:3.0:1763343033.452359:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993475456 00000004:00080000:2.0:1763343033.452374:0:32358:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x292:0x0]-[0x2c0000401:0x2c1:0x0] 00000100:00100000:2.0:1763343033.452400:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56844:x1848997993475328:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343033.452412:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6361 00000100:00100000:3.0:1763343033.452424:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993475456:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343033.452441:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.452475:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae5924 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8de7 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343033.452505:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x292:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343033.452524:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343033.452527:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343033.452538:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae5924 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8de7 expref: 17 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343033.452561:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae5924 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8de7 expref: 17 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343033.452595:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343033.452670:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993475456:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 248us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343033.452677:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6361 00000100:00100000:2.0:1763343033.452731:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56844:x1848997993475328:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 424us (740us total) trans 8589939778 rc 0/0 00000100:00100000:2.0:1763343033.452739:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3092 00000100:00100000:1.0:1763343033.456157:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.456215:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.456394:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993475584 00000100:00100000:2.0:1763343033.456409:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993475584 00000100:00100000:2.0:1763343033.456484:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6362 00000100:00100000:2.0:1763343033.456495:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993475584:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.456518:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.456548:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6200/0x607405d401ae592b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8dee expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343033.456578:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x290:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343033.456603:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.456605:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.456616:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6200/0x607405d401ae592b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dee expref: 23 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.456674:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6200/0x607405d401ae592b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dee expref: 23 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.456689:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6200, rc 0) 00000100:00100000:2.0:1763343033.456754:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2429:x1848997993475584:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 261us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.456761:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6362 00000100:00100000:0.0:1763343033.456836:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993475840 00000100:00100000:0.0:1763343033.456841:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993475840 00000100:00100000:0.0:1763343033.456884:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3093 00000100:00100000:0.0:1763343033.456891:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56844:x1848997993475840:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343033.457129:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56844:x1848997993475840:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 237us (986us total) trans 8589939779 rc 0/0 00000100:00100000:0.0:1763343033.457136:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3093 00000100:00100000:0.0:1763343033.463849:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.464301:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993476096 00000100:00100000:2.0:1763343033.464314:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993476096 00000100:00100000:2.0:1763343033.464396:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3094 00000100:00100000:2.0:1763343033.464408:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56845:x1848997993476096:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343033.465742:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.466034:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56845:x1848997993476096:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1626us (2199us total) trans 8589939780 rc 0/0 00000100:00100000:2.0:1763343033.466048:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3094 00000100:00100000:0.0:1763343033.466146:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993476352 00000100:00100000:0.0:1763343033.466154:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993476352 00000100:00100000:0.0:1763343033.466207:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9097 00000100:00100000:0.0:1763343033.466216:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:55941:x1848997993476352:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343033.466236:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.466240:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343033.466286:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5916 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8de0 expref: 251 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.466311:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3518935500) 00010000:00010000:0.0:1763343033.466325:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343033.466344:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae5932 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8df5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.466469:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5939 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.466484:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5939 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.466495:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5939 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343033.466511:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d0:0x0]: returning size 0 00010000:00010000:0.0:1763343033.466592:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae5932 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8df5 expref: 253 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.466608:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5939 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8df5 expref: 252 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.466615:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:0.0:1763343033.466646:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1763343033.466650:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d000, rc 0) 00000100:00100000:0.0:1763343033.466706:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:55941:x1848997993476352:12345-192.168.204.21@tcp:101:bash.0 Request processed in 491us (974us total) trans 8589939781 rc 0/0 00000100:00100000:0.0:1763343033.466714:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9097 00000100:00100000:1.0:1763343033.470252:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.471145:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993476608 00000100:00100000:2.0:1763343033.471160:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993476608 00000100:00100000:2.0:1763343033.471256:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9098 00000100:00100000:2.0:1763343033.471279:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56845:x1848997993476608:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.471315:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.471347:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5947 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8dfc expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.471454:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae594e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471471:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae594e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471484:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae594e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471495:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5955 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471503:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5955 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471509:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5955 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471682:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae595c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471700:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae595c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471706:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae595c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471712:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae595c lrc: 3/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471717:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.471722:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae595c lrc: 3/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471729:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae595c lrc: 4/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471741:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:2.0:1763343033.471746:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae595c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471753:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae595c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343033.471773:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d0:0x0]: returning size 0 00010000:00010000:2.0:1763343033.471880:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae594e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471886:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae594e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471891:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae594e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471897:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae594e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471903:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.471906:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae594e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471912:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae594e lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471919:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935000) 00010000:00010000:2.0:1763343033.471922:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.471925:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae594e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471930:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae594e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471940:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5955 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471946:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5955 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471962:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5955 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471967:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.471970:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5955 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471975:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5955 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471982:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935800) 00010000:00010000:2.0:1763343033.471984:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.471988:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5955 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.471993:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5955 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.472040:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5947 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dfc expref: 254 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.472051:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935000) 00010000:00010000:2.0:1763343033.472054:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343033.472058:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5947 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dfc expref: 254 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.472073:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6800, rc 0) 00000100:00100000:2.0:1763343033.472170:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56845:x1848997993476608:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 903us (1936us total) trans 8589939782 rc 301/301 00000100:00100000:2.0:1763343033.472179:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9098 00000100:00100000:3.0:1763343033.473420:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.473844:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993476736 00000100:00100000:0.0:1763343033.473856:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993476736 00000100:00100000:0.0:1763343033.473913:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9099 00000100:00100000:0.0:1763343033.473924:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:55941:x1848997993476736:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343033.473960:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.473981:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae596a lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e03 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.474017:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5971 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.474031:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5971 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.474044:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5971 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.474177:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae596a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e03 expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.474195:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5971 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e03 expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.474204:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:0.0:1763343033.474207:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343033.474210:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665da00, rc 0) 00000100:00100000:0.0:1763343033.474282:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:55941:x1848997993476736:12345-192.168.204.21@tcp:101:bash.0 Request processed in 343us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.474290:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9099 00000100:00100000:1.0:1763343033.476118:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.476497:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993476992 00000100:00100000:2.0:1763343033.476511:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993476992 00000100:00100000:2.0:1763343033.476584:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3095 00000100:00100000:2.0:1763343033.476595:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56845:x1848997993476992:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343033.476904:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56845:x1848997993476992:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 309us (796us total) trans 8589939783 rc 0/0 00000100:00100000:2.0:1763343033.476912:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3095 00000100:00100000:1.0:1763343033.480008:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.480128:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.480230:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993477248 00000100:00100000:2.0:1763343033.480245:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993477248 00000100:00100000:0.0:1763343033.480931:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993477376 00000100:00100000:0.0:1763343033.480939:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993477376 00000100:00100000:0.0:1763343033.480989:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3096 00000100:00100000:0.0:1763343033.481000:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56845:x1848997993477376:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:0.0:1763343033.481198:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56845:x1848997993477376:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 199us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.481207:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3096 00000100:00100000:2.0:1763343033.481305:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9100 00000100:00100000:2.0:1763343033.481314:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:55941:x1848997993477248:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:2.0:1763343033.481355:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343033.481392:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5939 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8df5 expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.481414:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:2.0:1763343033.481420:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.481656:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5978 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.481673:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5978 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.481685:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5978 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000001:00080000:2.0:1763343033.481743:0:10042:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939784 00000004:00010000:2.0:1763343033.481768:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f4c62a4c reply state 00000000e8da41c2 transno 8589939785 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5978 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.481783:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5978 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.481789:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:2.0:1763343033.481792:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343033.481795:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343033.481846:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:55941:x1848997993477248:12345-192.168.204.21@tcp:36:bash.0 Request processed in 532us (1854us total) trans 8589939785 rc 0/0 00000100:00100000:2.0:1763343033.481852:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9100 00000020:00080000:2.0:1763343033.481856:0:10042:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343033.486019:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.486082:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993477504 00000100:00100000:2.0:1763343033.486098:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993477504 00000100:00100000:2.0:1763343033.486177:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9101 00000100:00100000:2.0:1763343033.486189:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:55941:x1848997993477504:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343033.486220:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.486249:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae597f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e0a expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.486320:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae597f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e0a expref: 258 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.486337:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae597f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e0a expref: 258 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.486359:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:2.0:1763343033.486362:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343033.486367:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7200, rc 0) 00000100:00100000:2.0:1763343033.486445:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:55941:x1848997993477504:12345-192.168.204.21@tcp:101:bash.0 Request processed in 258us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.486453:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9101 00000100:00100000:1.0:1763343033.494392:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.495368:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993477760 00000100:00100000:3.0:1763343033.495386:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993477760 00000100:00100000:3.0:1763343033.495465:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9102 00000100:00100000:3.0:1763343033.495477:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:55941:x1848997993477760:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343033.495504:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.495508:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343033.495545:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae597f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e0a expref: 258 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.495571:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:3.0:1763343033.495577:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343033.495596:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5986 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e11 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.496883:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae598d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.496908:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae598d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.496921:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae598d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:3.0:1763343033.497249:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1370, 88 off116080 00000004:00080000:3.0:1763343033.497259:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1227164637081ns, next at 1227177401661ns, rc = 0 00000040:00080000:3.0:1763343033.499462:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1371, 88 off116080 00000004:00080000:3.0:1763343033.499487:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1227166865366ns, next at 1227177369372ns, rc = 0 00000040:00080000:3.0:1763343033.499522:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1372, 88 off116168 00000004:00080000:3.0:1763343033.499527:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1227166906048ns, next at 1227177369372ns, rc = 0 00000040:00080000:3.0:1763343033.499546:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1371, 88 off116168 00000004:00080000:3.0:1763343033.499551:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1227166929973ns, next at 1227177401661ns, rc = 0 00010000:00010000:2.0:1763343033.506488:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae584b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506512:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae584b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506520:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae584b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506527:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.506532:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae584b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506545:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae584b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506565:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935800) 00010000:00010000:2.0:1763343033.506569:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.506575:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae584b lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506581:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae584b lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506605:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae58c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506611:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae58c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506617:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae58c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506679:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3ee00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.506682:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae58c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506688:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae58c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506697:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935800) 00010000:00010000:2.0:1763343033.506700:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.506703:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae58c2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506708:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae58c2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506729:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5978 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506735:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5978 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506741:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5978 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506745:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.506748:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5978 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506754:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5978 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506762:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:2.0:1763343033.506764:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.506767:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5978 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.506772:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5978 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000001:00080000:1.0:1763343033.508516:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939786 is committed 00000004:00080000:1.0:1763343033.508540:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 903 committed 00000004:00080000:1.0:1763343033.508904:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 902 committed 00000100:00100000:3.0:1763343033.509032:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000004:00080000:1.0:1763343033.509575:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 901 committed 00000004:00080000:1.0:1763343033.509582:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 902 committed 00000100:00100000:0.0:1763343033.509861:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340683aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010240512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.509932:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343033.509994:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343033.510000:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a350121b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010240128:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.510023:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343033.510055:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3501219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010240256:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.510079:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343033.510097:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343033.510101:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340683b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010240384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.510121:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343033.510158:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010240512 00000100:00100000:0.0:1763343033.510167:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010240512 00000100:00100000:0.0:1763343033.510215:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010240128 00000100:00100000:0.0:1763343033.510218:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010240128 00000100:00100000:0.0:1763343033.510234:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010240256 00000100:00100000:0.0:1763343033.510237:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010240256 00000100:00100000:0.0:1763343033.510252:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010240384 00000100:00100000:0.0:1763343033.510254:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010240384 00000100:00100000:0.0:1763343033.510279:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6363 00000100:00100000:0.0:1763343033.510290:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3657:x1848998010240512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343033.510521:0:15756:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343033.510525:0:15756:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.510528:0:15756:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.510531:0:15756:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.510534:0:15756:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343033.510903:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010240896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.510944:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.510994:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343033.511000:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010240768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.511027:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.511066:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010240896 00000100:00100000:2.0:1763343033.511072:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010240896 00000100:00100000:2.0:1763343033.511109:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010240768 00000100:00100000:2.0:1763343033.511112:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010240768 00000100:00100000:2.0:1763343033.511133:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6364 00000100:00100000:2.0:1763343033.511140:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3657:x1848998010240128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343033.511163:0:10294:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:653 count 1 00010000:00010000:2.0:1763343033.511190:0:10294:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae5994 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.511215:0:10294:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae57fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d93 expref: 22 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343033.511225:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6365 00010000:00010000:2.0:1763343033.511226:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343033.511229:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343033.511235:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae5994 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343033.511240:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3659:x1848998010240256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343033.511261:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:654 count 1 00010000:00010000:2.0:1763343033.511276:0:10294:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae57fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d93 expref: 22 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.511278:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae599b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.511304:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae574f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d3f expref: 22 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.511309:0:10294:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae57fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d93 expref: 22 pid: 8408 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.511316:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.511319:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.511325:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae599b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343033.511331:0:10294:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10294:1848998010241152:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343033.511404:0:10294:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509bdff00 going to sleep for 11 seconds 00000100:00100000:2.0:1763343033.511423:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6366 00000100:00100000:2.0:1763343033.511430:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3659:x1848998010240384:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343033.511506:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae574f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d3f expref: 22 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343033.511515:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae574f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d3f expref: 22 pid: 28993 timeout: 1327 lvb_type: 1 00000100:00100000:1.0:1763343033.511526:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010241280:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343033.511560:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe300 going to sleep for 11 seconds 00000100:00100000:2.0:1763343033.511941:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3659:x1848998010240384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 508us (1815us total) trans 21474838823 rc 0/0 00000100:00100000:2.0:1763343033.512058:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6366 00000100:00100000:1.0:1763343033.512072:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6367 00000100:00100000:1.0:1763343033.512084:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3660:x1848998010240896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.512088:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6368 00000100:00100000:2.0:1763343033.512099:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3660:x1848998010240768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343033.512115:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:656 count 1 00010000:00010000:2.0:1763343033.512132:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae59a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.512148:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae5756 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d46 expref: 16 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.512156:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.512158:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.512161:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae59a2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.512188:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae5756 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d46 expref: 16 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.512198:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae5756 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d46 expref: 16 pid: 8408 timeout: 1327 lvb_type: 1 00000100:00100000:2.0:1763343033.512212:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406649180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010241408:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343033.512251:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3660:x1848998010240896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 169us (1304us total) trans 17179871524 rc 0/0 00000100:00100000:1.0:1763343033.512260:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6367 00000100:00100000:2.0:1763343033.512262:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509bdf840 going to sleep for 11 seconds 00000004:00080000:2.0:1763343033.512323:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c3a680/2, rc 0, transno 17179871524 00000100:00100000:2.0:1763343033.512331:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010240896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.512360:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993478016 00000100:00100000:2.0:1763343033.512366:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993478016 00000100:00100000:0.0:1763343033.512431:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3657:x1848998010240512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 290us (644us total) trans 21474838822 rc 0/0 00000100:00100000:0.0:1763343033.512442:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6363 00000100:00100000:3.0:1763343033.512468:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010240640:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1763343033.512496:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340683b100/2, rc 0, transno 21474838823 00000100:00100000:0.0:1763343033.512504:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340683b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010240384:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343033.512514:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343033.512526:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010241024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343033.512564:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1763343033.512595:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340683aa00/2, rc 0, transno 21474838822 00000100:00100000:0.0:1763343033.512599:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340683aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010240512:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1763343033.512606:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae598d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e11 expref: 237 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.512643:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010240640 00010000:00010000:3.0:1763343033.512644:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00000100:00100000:0.0:1763343033.512649:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010240640 00010000:00010000:3.0:1763343033.512650:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343033.512676:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5986 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e11 expref: 237 pid: 6523 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1763343033.512678:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010241024 00000100:00100000:0.0:1763343033.512682:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010241024 00010000:00010000:3.0:1763343033.512704:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae598d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e11 expref: 236 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.512706:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6369 00000100:00100000:0.0:1763343033.512716:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3658:x1848998010240640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343033.512730:0:27833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:655 count 1 00010000:00010000:3.0:1763343033.512744:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:0.0:1763343033.512745:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae59a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.512750:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343033.512755:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92c00, rc 0) 00010000:00010000:0.0:1763343033.512765:0:27833:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae57f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d85 expref: 16 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.512773:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343033.512775:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343033.512778:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae59a9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343033.512795:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+236:55941:x1848997993477760:12345-192.168.204.21@tcp:101:bash.0 Request processed in 17319us (18418us total) trans 8589939786 rc 0/0 00010000:00010000:0.0:1763343033.512804:0:27833:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae57f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d85 expref: 16 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343033.512808:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9102 00010000:00010000:0.0:1763343033.512821:0:27833:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae57f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d85 expref: 16 pid: 8410 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343033.512834:0:27833:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27833:1848998010241536:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343033.512864:0:27833:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340468f900 going to sleep for 11 seconds 00000100:00100000:0.0:1763343033.512895:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6370 00000100:00100000:0.0:1763343033.512905:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3657:x1848998010241024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343033.512914:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9103 00000100:00100000:3.0:1763343033.512924:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+235:56846:x1848997993478016:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343033.512938:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.512968:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59b0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e18 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.513044:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae59b7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513059:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae59b7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513068:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae59b7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513081:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae59be lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513087:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae59be lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513093:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae59be lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513211:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae59c5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513220:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae59c5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513227:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae59c5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:3.0:1763343033.513238:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d0:0x0]: returning size 2 00010000:00010000:3.0:1763343033.513322:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae59b7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513329:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae59b7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513335:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae59b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513341:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae59b7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513348:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.513353:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae59b7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513360:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae59b7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513371:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53a000) 00010000:00010000:3.0:1763343033.513374:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.513378:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae59b7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513384:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae59b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513394:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae59be lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513400:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae59be lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513405:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae59be lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513410:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.513413:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae59be lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513417:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae59be lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513424:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:3.0:1763343033.513427:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.513430:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae59be lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513435:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae59be lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.513477:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e18 expref: 238 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.513490:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae59c5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e18 expref: 237 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.513497:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:3.0:1763343033.513499:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343033.513502:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93a00, rc 0) 00000100:00100000:3.0:1763343033.513539:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56846:x1848997993478016:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 618us (4513us total) trans 8589939787 rc 0/0 00000100:00100000:3.0:1763343033.513546:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9103 00002000:00010000:0.0:1763343033.513649:0:8408:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343033.513653:0:8408:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.513656:0:8408:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.513658:0:8408:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.513660:0:8408:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343033.513700:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3657:x1848998010241024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 797us (1137us total) trans 17179871525 rc 0/0 00000100:00100000:0.0:1763343033.513707:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6370 00000004:00080000:0.0:1763343033.513746:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c39180/2, rc 0, transno 17179871525 00000100:00100000:0.0:1763343033.513752:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010241024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343033.517686:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.517726:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.517741:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993478144 00000100:00100000:1.0:1763343033.517754:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993478272 00000100:00100000:0.0:1763343033.517755:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993478144 00000100:00100000:1.0:1763343033.517761:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993478272 00000100:00100000:2.0:1763343033.517870:0:10294:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340664b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10294:1848998010241152:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343033.517903:0:10294:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae5994 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343033.518042:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010241280:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343033.518059:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae599b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.518250:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae574f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d3f expref: 24 pid: 28993 timeout: 1327 lvb_type: 1 00000100:00100000:1.0:1763343033.518309:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2992 00000100:00100000:1.0:1763343033.518321:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2431:x1848997993478272:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343033.518341:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343033.518348:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae574f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d3f expref: 24 pid: 28993 timeout: 1327 lvb_type: 1 00010000:00010000:1.0:1763343033.518363:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae574f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d3f expref: 24 pid: 28993 timeout: 1327 lvb_type: 1 00010000:00010000:1.0:1763343033.518391:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae574f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d3f expref: 24 pid: 28993 timeout: 1327 lvb_type: 1 00010000:00010000:1.0:1763343033.518411:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.518414:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.518420:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae599b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.518431:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae599b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.518470:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343033.518539:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2431:x1848997993478272:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 220us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.518549:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2992 00010000:00010000:3.0:1763343033.518659:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae599b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.518668:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae599b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.518678:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae599b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.518688:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae599b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.518707:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343033.518771:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.518801:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.518840:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406649180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010241408:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343033.518861:0:28648:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae59a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.518896:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae57fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d93 expref: 23 pid: 8408 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343033.518899:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993478400 00000100:00100000:2.0:1763343033.518907:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993478400 00010000:00010000:2.0:1763343033.518932:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae5756 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d46 expref: 17 pid: 8408 timeout: 1327 lvb_type: 1 00000100:00100000:0.0:1763343033.518932:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2993 00000100:00100000:0.0:1763343033.518945:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2431:x1848997993478144:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343033.518973:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1763343033.518977:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2994 00010000:00010000:0.0:1763343033.518982:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae57fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d93 expref: 23 pid: 8408 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343033.518992:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993478400:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343033.519009:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343033.519011:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae57fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d93 expref: 23 pid: 8408 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.519018:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae5756 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x290:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d46 expref: 17 pid: 8408 timeout: 1327 lvb_type: 1 00010000:00010000:0.0:1763343033.519033:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae57fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d93 expref: 23 pid: 8408 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.519036:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae5756 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x290:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d46 expref: 17 pid: 8408 timeout: 1327 lvb_type: 1 00010000:00010000:0.0:1763343033.519054:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.519057:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.519061:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae5994 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.519065:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae5756 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x290:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d46 expref: 17 pid: 8408 timeout: 1327 lvb_type: 1 00010000:00010000:0.0:1763343033.519076:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae5994 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.519084:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.519087:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.519091:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae59a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.519100:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae59a2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.519104:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.519122:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343033.519154:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2431:x1848997993478144:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 211us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.519163:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2993 00010000:00010000:0.0:1763343033.519193:0:10294:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae5994 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343033.519742:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993478400:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 751us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.519750:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2994 00010000:00010000:2.0:1763343033.519779:0:28648:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae59a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.519792:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae59a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.519797:0:10294:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae5994 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.519809:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae59a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.519812:0:10294:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae5994 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.519829:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae59a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.519844:0:10294:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae5994 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.519862:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1763343033.519876:0:10294:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1763343033.520158:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3657:x1848998010240128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9016us (10131us total) trans 21474838825 rc 0/0 00000100:00100000:0.0:1763343033.520167:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6364 00000100:00100000:0.0:1763343033.520187:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993478528 00000100:00100000:0.0:1763343033.520193:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993478528 00000100:00100000:0.0:1763343033.520221:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6371 00000100:00100000:0.0:1763343033.520229:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:55941:x1848997993478528:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343033.520332:0:10294:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.520358:0:10294:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae59d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e1f expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343033.520384:0:10294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343033.520405:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.520407:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.520415:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae59d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e1f expref: 22 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.520432:0:10294:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae59d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e1f expref: 22 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.520444:0:10294:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d800, rc 0) 00000100:00100000:0.0:1763343033.520480:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:55941:x1848997993478528:12345-192.168.204.21@tcp:101:bash.0 Request processed in 248us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.520481:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3660:x1848998010240768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8378us (9447us total) trans 17179871526 rc 0/0 00000100:00100000:0.0:1763343033.520495:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6371 00010000:00010000:0.0:1763343033.520517:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1763343033.520525:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae599b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.520534:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343033.520539:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae599b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.520549:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae599b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.520566:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae599b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.520574:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae599b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343033.520662:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a350121b800/2, rc 0, transno 21474838825 00000100:00100000:1.0:1763343033.520674:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a350121b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010240128:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1763343033.520684:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343033.520690:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae59a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.520697:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7c00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343033.520701:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae59a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.520709:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae59a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.520721:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343033.520723:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae59a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.520730:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae5994 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343033.520732:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6368 00010000:00010000:0.0:1763343033.520739:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7c00/0x607405d401ae59a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.520749:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343033.520755:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae5994 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.520762:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343033.520766:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.520767:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae5994 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.520769:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.520784:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae5994 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763343033.520787:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c3bb80/2, rc 0, transno 17179871526 00010000:00010000:1.0:1763343033.520795:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6800/0x607405d401ae5994 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343033.520797:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010240768:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763343033.520800:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.520821:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.520824:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.520827:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343033.522703:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3659:x1848998010240256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11456us (12610us total) trans 21474838824 rc 0/0 00000100:00100000:3.0:1763343033.522720:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6365 00000004:00080000:0.0:1763343033.522899:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3501219500/2, rc 0, transno 21474838824 00000100:00100000:0.0:1763343033.522907:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3501219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010240256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343033.524023:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.524030:0:27833:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27833:1848998010241536:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343033.524071:0:27833:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae59a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343033.524118:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.524136:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993478656 00000100:00100000:1.0:1763343033.524147:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993478656 00010000:00010000:1.0:1763343033.524195:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae57f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d85 expref: 16 pid: 8410 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.524240:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2995 00000100:00100000:1.0:1763343033.524250:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993478656:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343033.524283:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343033.524290:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae57f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d85 expref: 16 pid: 8410 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.524304:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae57f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d85 expref: 16 pid: 8410 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.524338:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665ca00/0x607405d401ae57f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8d85 expref: 16 pid: 8410 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.524357:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.524360:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.524365:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae59a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.524376:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae59a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.524408:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343033.524464:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993478656:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 214us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.524472:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2995 00010000:00010000:3.0:1763343033.524491:0:27833:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae59a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.524500:0:27833:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae59a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.524511:0:27833:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae59a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.524519:0:27833:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae59a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.524540:0:27833:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343033.524600:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343033.524607:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae59a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.524615:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343033.524646:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae59a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.524656:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae59a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.524668:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae59a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.524675:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae59a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.524693:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.524694:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.524696:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343033.525838:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3658:x1848998010240640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13113us (13316us total) trans 17179871527 rc 0/0 00000004:00080000:3.0:1763343033.525962:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c39500/2, rc 0, transno 17179871527 00000100:00100000:3.0:1763343033.525971:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010240640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343033.526016:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6369 00000100:00100000:1.0:1763343033.526050:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993478784 00000100:00100000:1.0:1763343033.526058:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993478784 00000100:00100000:1.0:1763343033.526114:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6372 00000100:00100000:1.0:1763343033.526123:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993478784:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.526145:0:27833:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.526166:0:27833:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae59da lrc: 2/0,0 mode: --/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e26 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343033.526237:0:27833:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34050f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27833:1848998010241664:192.168.204.21@tcp:106: 00000100:00100000:1.0:1763343033.526332:0:27833:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe900 going to sleep for 11 seconds 00000100:00100000:3.0:1763343033.528787:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00002000:00010000:0.0:1763343033.529409:0:27833:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb mtime: 0 -> 1763343033 00002000:00010000:0.0:1763343033.529416:0:27833:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb atime: 0 -> 1763343033 00002000:00010000:0.0:1763343033.529418:0:27833:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb ctime: 0 -> 1763343033 00000100:00100000:0.0:1763343033.529444:0:27833:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34050f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27833:1848998010241664:192.168.204.21@tcp:106: 00010000:00010000:0.0:1763343033.529495:0:27833:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae59da lrc: 1/0,0 mode: --/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e26 expref: 23 pid: 27833 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343033.529531:0:27833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae59da lrc: 0/0,0 mode: --/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e26 expref: 23 pid: 27833 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343033.529553:0:27833:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:0.0:1763343033.529659:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993478784:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3535us (5539us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343033.529670:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6372 00000100:00100000:0.0:1763343033.529709:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993478912 00000100:00100000:0.0:1763343033.529718:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993478912 00000100:00100000:0.0:1763343033.529765:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6373 00000100:00100000:0.0:1763343033.529776:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:55941:x1848997993478912:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343033.529794:0:27833:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.529822:0:27833:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae59e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e2d expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343033.529843:0:27833:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x291:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343033.530152:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.530156:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.530167:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae59e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e2d expref: 16 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.530184:0:27833:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae59e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e2d expref: 16 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.530192:0:27833:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c400, rc 0) 00000100:00100000:0.0:1763343033.530218:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:55941:x1848997993478912:12345-192.168.204.21@tcp:101:bash.0 Request processed in 445us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.530224:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6373 00000100:00100000:3.0:1763343033.534674:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.534722:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.535590:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993479040 00000100:00100000:0.0:1763343033.535609:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993479040 00002000:00010000:0.0:1763343033.535687:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/655 (0->18446744073709551615) 00002000:00100000:0.0:1763343033.535693:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062f3100 with x1848997993479040 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343033.535708:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34062f3100. 00000100:00100000:0.0:1763343033.535740:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993479168 00000100:00100000:0.0:1763343033.535743:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993479168 00002000:00010000:0.0:1763343033.535757:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/657 (0->18446744073709551615) 00002000:00100000:0.0:1763343033.535761:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062f0700 with x1848997993479168 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343033.535767:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34062f0700. 00000100:00100000:3.0:1763343033.535782:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1562 00000100:00100000:0.0:1763343033.535788:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1563 00000100:00100000:3.0:1763343033.535794:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2432:x1848997993479040:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:0.0:1763343033.535794:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993479168:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343033.536033:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343033.536033:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x291:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343033.536037:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb mtime from disk: 1763343033 -> 1763343033 00002000:00010000:0.0:1763343033.536037:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x291:0x0] updating lvb mtime from disk: 0 -> 1763343033 00002000:00010000:3.0:1763343033.536041:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb atime from disk: 1763343033 -> 0 00002000:00010000:0.0:1763343033.536041:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x291:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343033.536044:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb ctime from disk: 1763343033 -> 1763343033 00002000:00010000:0.0:1763343033.536044:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x291:0x0] updating lvb ctime from disk: 0 -> 1763343033 00002000:00010000:3.0:1763343033.536047:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763343033.536047:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x291:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343033.536135:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2432:x1848997993479040:12345-192.168.204.21@tcp:10:bash.0 Request processed in 343us (1530us total) trans 21474838826 rc 0/0 00000100:00100000:3.0:1763343033.536143:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1562 00002000:00010000:3.0:1763343033.536148:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/655 (0->18446744073709551615) 00002000:00100000:3.0:1763343033.536151:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062f3100 with x1848997993479040 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343033.536156:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34062f3100. 00000100:00100000:0.0:1763343033.538898:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2432:x1848997993479168:12345-192.168.204.21@tcp:10:bash.0 Request processed in 3082us (4154us total) trans 17179871528 rc 0/0 00000100:00100000:0.0:1763343033.538916:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1563 00002000:00010000:0.0:1763343033.538924:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/657 (0->18446744073709551615) 00002000:00100000:0.0:1763343033.538928:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062f0700 with x1848997993479168 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343033.538940:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34062f0700. 00000100:00100000:2.0:1763343033.539394:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.539591:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993479424 00000100:00100000:3.0:1763343033.539605:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993479424 00000100:00100000:3.0:1763343033.539682:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3097 00000100:00100000:3.0:1763343033.539750:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fbb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56846:x1848997993479424:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343033.540156:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fbb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56846:x1848997993479424:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 462us (763us total) trans 8589939788 rc 0/0 00000100:00100000:3.0:1763343033.540164:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3097 00000100:00100000:3.0:1763343033.544470:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.544562:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993479680 00000100:00100000:0.0:1763343033.544577:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993479680 00000100:00100000:1.0:1763343033.544731:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.544977:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3098 00000100:00100000:0.0:1763343033.544990:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:55941:x1848997993479680:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343033.545366:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:55941:x1848997993479680:12345-192.168.204.21@tcp:35:bash.0 Request processed in 378us (911us total) trans 8589939789 rc 0/0 00000100:00100000:0.0:1763343033.545375:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3098 00000100:00100000:3.0:1763343033.547134:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993479936 00000100:00100000:3.0:1763343033.547155:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993479936 00000100:00100000:3.0:1763343033.547254:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9104 00000100:00100000:3.0:1763343033.547266:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56846:x1848997993479936:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343033.547301:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.547333:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae59e8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e34 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.547493:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.547511:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae59c5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e18 expref: 240 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.547523:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.547569:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae59c5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e18 expref: 240 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.547584:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae59c5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e18 expref: 240 pid: 6523 timeout: 1327 lvb_type: 0 00000100:00100000:3.0:1763343033.547600:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010241792:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343033.547750:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343033.557542:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010241792:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343033.557558:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343033.557584:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:0.0:1763343033.557968:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993480064 00000100:00100000:0.0:1763343033.557980:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993480064 00010000:00010000:0.0:1763343033.558030:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae59c5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e18 expref: 241 pid: 6523 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343033.558076:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2996 00000100:00100000:0.0:1763343033.558086:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:2430:x1848997993480064:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343033.558106:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343033.558113:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae59c5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e18 expref: 241 pid: 6523 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343033.558126:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae59c5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e18 expref: 241 pid: 6523 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343033.558154:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae59c5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e18 expref: 241 pid: 6523 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343033.558173:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:0.0:1763343033.558179:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.558190:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.558198:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.558235:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343033.558338:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.558347:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343033.558384:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d0:0x0]: returning size 5 00010000:00010000:3.0:1763343033.558539:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae59e8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e34 expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.558555:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e34 expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.558563:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:3.0:1763343033.558565:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1763343033.558568:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:0.0:1763343033.559439:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5fe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:2430:x1848997993480064:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1347us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.559452:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2996 00000100:00100000:3.0:1763343033.560587:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56846:x1848997993479936:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 13315us (15848us total) trans 8589939790 rc 0/0 00000100:00100000:3.0:1763343033.560600:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9104 00000100:00100000:2.0:1763343033.561001:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.561079:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993480192 00000100:00100000:3.0:1763343033.561090:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993480192 00000100:00100000:1.0:1763343033.563014:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.563112:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993480320 00000100:00100000:2.0:1763343033.563123:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993480320 00000100:00100000:2.0:1763343033.563179:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9105 00000100:00100000:2.0:1763343033.563191:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56847:x1848997993480192:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:2.0:1763343033.563227:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.563259:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae59fd lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e3b expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.563356:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5a04 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343033.563362:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9106 00000100:00100000:3.0:1763343033.563376:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56846:x1848997993480320:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.563379:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5a04 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.563389:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.563396:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5a04 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.563402:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5a0b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e42 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.563414:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a12 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.563422:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.563428:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.563486:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5a19 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.563500:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e34 expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.563508:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5a19 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.563521:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a20 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.563532:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a20 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.563540:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a20 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.563552:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e34 expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.563568:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e34 expref: 243 pid: 28422 timeout: 1327 lvb_type: 0 00000100:00100000:3.0:1763343033.563586:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010241920:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343033.563711:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343033.569005:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010241920:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343033.569043:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5a19 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:1.0:1763343033.569087:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.569147:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993480448 00000100:00100000:0.0:1763343033.569158:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993480448 00010000:00010000:0.0:1763343033.569207:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e34 expref: 244 pid: 28422 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343033.569259:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2997 00000100:00100000:0.0:1763343033.569271:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:2430:x1848997993480448:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343033.569290:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343033.569298:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e34 expref: 244 pid: 28422 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343033.569311:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e34 expref: 244 pid: 28422 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343033.569341:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae59ef lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d0:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e34 expref: 244 pid: 28422 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343033.569359:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:0.0:1763343033.569364:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5a19 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.569377:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5a19 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.569390:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5a19 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.569399:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a20 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.569405:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a20 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.569410:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a20 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.569453:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343033.569475:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5a19 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.569484:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5a19 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343033.569527:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:2430:x1848997993480448:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 255us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.569536:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2997 00000004:00200000:3.0:1763343033.569554:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d0:0x0]: returning size 5 00000004:00200000:3.0:1763343033.569561:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343033.569587:0:6523:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5a19 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.569651:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5a0b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e42 expref: 243 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.569670:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5a19 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e42 expref: 242 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.569684:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:3.0:1763343033.569687:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343033.569691:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343033.569728:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56846:x1848997993480320:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6356us (6726us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343033.569736:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9106 00010000:00010000:2.0:1763343033.569886:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a20 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.569895:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a20 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343033.569922:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d0:0x0]: returning size 5 00000004:00200000:2.0:1763343033.569925:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343033.569937:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a20 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.569947:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a20 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.569967:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5a04 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.569973:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5a04 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.569980:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5a04 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.569986:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.569990:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5a04 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.569999:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5a04 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.570009:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343033.570012:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.570017:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5a04 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.570023:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5a04 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.570035:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.570041:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a12 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.570047:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.570054:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.570056:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.570061:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a12 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.570068:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935000) 00010000:00010000:2.0:1763343033.570070:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.570073:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a12 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.570079:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a12 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343033.570109:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae59fd lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e3b expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.570124:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a20 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e3b expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.570131:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:2.0:1763343033.570133:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343033.570135:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6000, rc 0) 00000100:00100000:2.0:1763343033.570179:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56847:x1848997993480192:12345-192.168.204.21@tcp:101:rm.0 Request processed in 6991us (9179us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.570186:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9105 00000100:00100000:0.0:1763343033.575245:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.575339:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993480576 00000100:00100000:2.0:1763343033.575354:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993480576 00000100:00100000:2.0:1763343033.575434:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9107 00000100:00100000:2.0:1763343033.575446:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56846:x1848997993480576:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.575474:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.575502:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5a27 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e49 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.575581:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5a27 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e49 expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.575598:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5a27 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e49 expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.575668:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:2.0:1763343033.575673:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343033.575678:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7200, rc 0) 00000100:00100000:2.0:1763343033.575758:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56846:x1848997993480576:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 314us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.575766:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9107 00000100:00100000:2.0:1763343033.580650:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.580690:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.580714:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993480832 00000100:00100000:2.0:1763343033.580716:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993481088 00000100:00100000:2.0:1763343033.580729:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993481088 00000100:00100000:3.0:1763343033.580730:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993480832 00000100:00100000:3.0:1763343033.580798:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9108 00000100:00100000:2.0:1763343033.580805:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9109 00000100:00100000:3.0:1763343033.580811:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56847:x1848997993480832:12345-192.168.204.21@tcp:36:rm.0 00000100:00100000:2.0:1763343033.580818:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56846:x1848997993481088:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.580838:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.580861:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a2e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e50 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.580891:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1763343033.580922:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae598d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e11 expref: 244 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.580963:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a20 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e3b expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.580980:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5a19 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e42 expref: 242 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.580994:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5971 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e03 expref: 241 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.581006:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:2.0:1763343033.581009:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae5a35 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.581014:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.581029:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae5a35 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.581037:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a3c lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.581042:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae5a35 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.581049:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a3c lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581058:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a3c lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581075:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5a43 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343033.581075:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d0:0x0]: returning size 5 00010000:00010000:3.0:1763343033.581085:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5a43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581092:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5a43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581187:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5a51 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581196:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5a51 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581204:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5a51 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.581226:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a2e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e50 expref: 242 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.581244:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae5a35 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e50 expref: 241 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.581258:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:2.0:1763343033.581261:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343033.581428:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a84a00, rc 0) 00000004:00080000:3.0:1763343033.581459:0:6523:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1d0:0x0] is inserted into orphan list, open count = 2 00000100:00100000:2.0:1763343033.581503:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56846:x1848997993481088:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 688us (811us total) trans 8589939791 rc 0/0 00000100:00100000:2.0:1763343033.581512:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9109 00010000:00010000:3.0:1763343033.581530:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5a51 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581539:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5a51 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581546:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5a51 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581556:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.581561:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5a51 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581569:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5a51 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581577:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:3.0:1763343033.581580:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763343033.581586:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5a51 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581592:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5a51 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581605:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a3c lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581611:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a3c lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581616:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a3c lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581643:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a3c lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581647:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.581649:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a3c lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581654:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a3c lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581664:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53a000) 00010000:00010000:3.0:1763343033.581667:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.581670:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a3c lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581675:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a3c lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:3.0:1763343033.581688:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cb19240d reply state 00000000e5693fdb transno 8589939792 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5a43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581698:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5a43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.581703:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:3.0:1763343033.581705:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343033.581707:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343033.581856:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56847:x1848997993480832:12345-192.168.204.21@tcp:36:rm.0 Request processed in 1048us (1238us total) trans 8589939792 rc 0/0 00000100:00100000:2.0:1763343033.581865:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9108 00000100:00100000:0.0:1763343033.586989:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.587195:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993481216 00000100:00100000:1.0:1763343033.587210:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993481216 00000100:00100000:1.0:1763343033.587289:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6374 00000100:00100000:1.0:1763343033.587302:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2429:x1848997993481216:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:1.0:1763343033.587365:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5a58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.587390:0:27833:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae59d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e1f expref: 23 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.587400:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343033.587402:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343033.587407:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5a58 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.587456:0:27833:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae59d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e1f expref: 23 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.587473:0:27833:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae59d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e1f expref: 23 pid: 10294 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.587492:0:27833:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27833:1848998010242048:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343033.587606:0:27833:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe540 going to sleep for 11 seconds 00000100:00100000:1.0:1763343033.595303:0:27833:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27833:1848998010242048:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.595344:0:27833:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5a58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.598288:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.600720:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993481344 00000100:00100000:1.0:1763343033.600742:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993481344 00002000:00100000:1.0:1763343033.600834:0:8415:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x28f:0x0] (0->4) req@ffff9a3409a4f800 x1848997993481344/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:529/0 lens 496/0 e 0 to 0 dl 1763343044 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343033.600847:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3409a4f800 with x1848997993481344 ext(0->4) 00010000:00010000:1.0:1763343033.600863:0:8415:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae59d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e1f expref: 24 pid: 10294 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.600884:0:8415:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae59d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e1f expref: 24 pid: 10294 timeout: 1327 lvb_type: 0 00002000:00010000:1.0:1763343033.600894:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a3409a4f800 00000100:00100000:1.0:1763343033.600933:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 103 00000100:00100000:1.0:1763343033.600946:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2429:x1848997993481344:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:3.0:1763343033.601089:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.603913:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2429:x1848997993481344:12345-192.168.204.21@tcp:4:bash.0 Request processed in 2953us (5630us total) trans 21474838827 rc 0/0 00000100:00100000:1.0:1763343033.603931:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 103 00002000:00100000:1.0:1763343033.603947:0:8415:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x28f:0x0] (0->4) req@ffff9a3409a4f800 x1848997993481344/t21474838827(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:529/0 lens 496/448 e 0 to 0 dl 1763343044 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343033.603969:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3409a4f800 with x1848997993481344 ext(0->4) 00010000:00010000:1.0:1763343033.603982:0:8415:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae59d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e1f expref: 26 pid: 10294 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.604005:0:8415:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae59d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e1f expref: 26 pid: 10294 timeout: 1327 lvb_type: 0 00002000:00010000:1.0:1763343033.604014:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a3409a4f800 00000100:00100000:2.0:1763343033.604169:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993481472 00000100:00100000:2.0:1763343033.604180:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993481472 00000100:00100000:2.0:1763343033.604252:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9110 00000100:00100000:2.0:1763343033.604265:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56848:x1848997993481472:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.604295:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.604328:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae5a5f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e57 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.604414:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a66 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604432:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604446:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a66 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604458:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a6d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604467:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604473:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604520:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a66 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604528:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a66 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604535:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a66 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604543:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a66 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604551:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.604556:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a66 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604564:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a66 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604577:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343033.604581:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.604587:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a66 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604593:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a66 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604610:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604617:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a6d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604668:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604673:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.604676:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604680:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604688:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:2.0:1763343033.604691:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.604693:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a6d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604698:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a6d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.604729:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae5a5f lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e57 expref: 243 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.604739:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343033.604742:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.604745:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae5a5f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e57 expref: 243 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.604759:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a85200, rc 0) 00000100:00100000:2.0:1763343033.604827:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56848:x1848997993481472:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 565us (3743us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343033.604835:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9110 00000100:00100000:0.0:1763343033.611765:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.611819:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.611872:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993481728 00000100:00100000:2.0:1763343033.611887:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993481728 00000100:00100000:1.0:1763343033.612074:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993481600 00000100:00100000:1.0:1763343033.612079:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993481600 00010000:00010000:1.0:1763343033.612112:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae59d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e1f expref: 26 pid: 10294 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.612156:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2998 00000100:00100000:1.0:1763343033.612168:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2431:x1848997993481600:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343033.612187:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763343033.612224:0:6510:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1763343033.612228:0:6510:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb atime from disk: 0 -> 1763343033 00002000:00010000:1.0:1763343033.612231:0:6510:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763343033.612238:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae59d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e1f expref: 26 pid: 10294 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.612253:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae59d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e1f expref: 26 pid: 10294 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.612286:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae59d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e1f expref: 26 pid: 10294 timeout: 1327 lvb_type: 0 00010000:00010000:1.0:1763343033.612303:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.612306:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.612312:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5a58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.612323:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5a58 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.612363:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343033.612439:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2431:x1848997993481600:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 273us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.612447:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2998 00010000:00010000:1.0:1763343033.613006:0:27833:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5a58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.613019:0:27833:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5a58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.613986:0:27833:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5a58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.614003:0:27833:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5a58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.614012:0:27833:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5a58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.614020:0:27833:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343033.614026:0:27833:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5a58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.614036:0:27833:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5a58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.614058:0:27833:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5a58 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.614072:0:27833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae5a58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343033.614177:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9111 00000100:00100000:2.0:1763343033.614200:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56848:x1848997993481728:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.614227:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.614256:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a74 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e5e expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.614342:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5a7b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614357:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5a7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614368:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5a7b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614379:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a82 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614387:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614395:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614448:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5a7b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614454:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5a7b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614461:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5a7b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614467:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5a7b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614471:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.614475:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5a7b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614482:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5a7b lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614491:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935000) 00010000:00010000:2.0:1763343033.614494:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.614499:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5a7b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614504:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae5a7b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614515:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614521:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614526:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614530:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.614533:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614542:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614549:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:2.0:1763343033.614551:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.614554:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a82 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614559:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae5a82 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.614589:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a74 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e5e expref: 243 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.614599:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935000) 00010000:00010000:2.0:1763343033.614601:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.614605:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae5a74 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e5e expref: 243 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.614651:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6600, rc 0) 00000100:00100000:2.0:1763343033.614733:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56848:x1848997993481728:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 544us (2913us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343033.614741:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9111 00000100:00100000:1.0:1763343033.614836:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2429:x1848997993481216:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 27536us (27863us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.614844:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6374 00000100:00100000:0.0:1763343033.619774:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.620053:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993481856 00000100:00100000:2.0:1763343033.620068:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993481856 00000100:00100000:2.0:1763343033.620145:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9112 00000100:00100000:2.0:1763343033.620157:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56848:x1848997993481856:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.620186:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.620220:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a89 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e65 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.620303:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5a90 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.620320:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5a90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.620333:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5a90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343033.620389:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343033.620396:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343033.620444:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae5a89 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e65 expref: 244 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.620465:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5a90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e65 expref: 243 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.620475:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343033.620478:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343033.620482:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6800, rc 0) 00000100:00100000:2.0:1763343033.620565:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56848:x1848997993481856:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 410us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.620574:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9112 00000100:00100000:0.0:1763343033.623431:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.623534:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993482112 00000100:00100000:3.0:1763343033.623549:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993482112 00000100:00100000:3.0:1763343033.623653:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9113 00000100:00100000:3.0:1763343033.623673:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56846:x1848997993482112:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:3.0:1763343033.623748:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343033.623784:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae5a27 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e49 expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.623811:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:3.0:1763343033.623818:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343033.623856:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a97 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.623878:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a97 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.623889:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a97 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:3.0:1763343033.624186:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1372, 88 off116256 00000004:00080000:3.0:1763343033.624196:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1227291574890ns, next at 1227177401661ns, rc = 0 00000040:00080000:3.0:1763343033.624229:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1373, 88 off116256 00000004:00080000:3.0:1763343033.624234:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1227291612858ns, next at 1227177369372ns, rc = 0 00000040:00080000:3.0:1763343033.624269:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1374, 88 off116344 00000004:00080000:3.0:1763343033.624274:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1227291653833ns, next at 1227177369372ns, rc = 0 00000040:00080000:3.0:1763343033.624285:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1373, 88 off116344 00000004:00080000:3.0:1763343033.624289:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1227291668034ns, next at 1227177401661ns, rc = 0 00000100:00100000:0.0:1763343033.626902:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.627004:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993482240 00000100:00100000:2.0:1763343033.627018:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993482240 00000100:00100000:2.0:1763343033.627094:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9114 00000100:00100000:2.0:1763343033.627106:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56848:x1848997993482240:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.627135:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.627165:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae5a9e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e6c expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.627274:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5aa5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627292:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627307:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627318:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae5aac lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627326:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae5aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627337:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae5aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627387:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5aa5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627394:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5aa5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627401:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5aa5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627407:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5aa5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627413:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.627420:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5aa5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627427:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5aa5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627442:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343033.627446:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.627451:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5aa5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627457:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5aa5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627473:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae5aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627478:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae5aac lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627484:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae5aac lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627488:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c8200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.627491:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae5aac lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627496:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae5aac lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627503:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:2.0:1763343033.627505:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.627508:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae5aac lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627518:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae5aac lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.627548:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae5a9e lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e6c expref: 245 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.627559:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343033.627561:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.627565:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae5a9e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e6c expref: 245 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.627575:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a85200, rc 0) 00000100:00100000:2.0:1763343033.628762:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56848:x1848997993482240:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1647us (1863us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343033.628776:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9114 00000100:00100000:0.0:1763343033.630946:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.631282:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993482496 00000100:00100000:2.0:1763343033.631296:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993482496 00000001:00080000:1.0:1763343033.632131:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939793 is committed 00000004:00080000:1.0:1763343033.632142:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 905 committed 00000004:00080000:1.0:1763343033.632166:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 904 committed 00000004:00080000:1.0:1763343033.632179:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 903 committed 00000004:00080000:1.0:1763343033.632182:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 904 committed 00000100:00100000:1.0:1763343033.632306:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343033.632331:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010242176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343033.632405:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343033.632458:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010242176 00000100:00100000:1.0:1763343033.632464:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010242176 00000100:00100000:2.0:1763343033.632494:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343033.632505:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010242304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343033.632514:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6375 00000100:00100000:1.0:1763343033.632523:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3657:x1848998010242176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.632537:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.632567:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010242304 00000100:00100000:2.0:1763343033.632570:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010242304 00000100:00100000:2.0:1763343033.632597:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6376 00000100:00100000:2.0:1763343033.632603:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3660:x1848998010242304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763343033.632751:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343033.632754:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343033.632756:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343033.632760:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343033.632762:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343033.632814:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3660:x1848998010242304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 211us (275us total) trans 17179871530 rc 0/0 00000100:00100000:2.0:1763343033.632822:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6376 00000004:00080000:2.0:1763343033.632875:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537b0c700/2, rc 0, transno 17179871530 00000100:00100000:2.0:1763343033.632881:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010242304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.632916:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9115 00000100:00100000:2.0:1763343033.632924:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56848:x1848997993482496:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.632939:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.632942:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343033.633101:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae5a90 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e65 expref: 237 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.633122:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343033.633134:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.633152:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5ab3 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e73 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.633271:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5aba lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.633286:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5aba lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.633297:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5aba lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.633308:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ac1 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.633316:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.633321:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:2.0:1763343033.633715:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010242432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343033.633732:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343033.633743:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010242560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343033.633755:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343033.633770:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.633790:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010242432 00000100:00100000:3.0:1763343033.633795:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010242560 00000100:00100000:2.0:1763343033.633795:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010242432 00000100:00100000:3.0:1763343033.633805:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010242560 00000100:00100000:2.0:1763343033.633826:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6377 00000100:00100000:3.0:1763343033.633830:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6378 00000100:00100000:2.0:1763343033.633832:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3660:x1848998010242432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343033.633836:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3658:x1848998010242560:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763343033.634098:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5a43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.634109:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5a43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.634121:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5a43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.634127:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343033.634132:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5a43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.634140:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5a43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.634154:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:0.0:1763343033.634157:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343033.634162:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5a43 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.634168:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5a43 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00002000:00010000:1.0:1763343033.634322:0:27833:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x291:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343033.634327:0:27833:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x291:0x0] updating lvb mtime from disk: 1763343033 -> 1763343033 00002000:00010000:1.0:1763343033.634330:0:27833:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x291:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343033.634332:0:27833:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x291:0x0] updating lvb ctime from disk: 1763343033 -> 1763343033 00002000:00010000:1.0:1763343033.634334:0:27833:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x291:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343033.634377:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3657:x1848998010242176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1852us (1969us total) trans 17179871529 rc 0/0 00000100:00100000:1.0:1763343033.634385:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6375 00000004:00080000:3.0:1763343033.637551:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537b0ea00/2, rc 0, transno 17179871529 00000100:00100000:3.0:1763343033.637572:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010242176:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1763343033.637685:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000036573eda reply state 00000000ec4a3167 transno 8589939793 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a97 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.637711:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343033.637722:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:3.0:1763343033.637726:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763343033.637730:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1763343033.637886:0:6523:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763343033.637917:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56846:x1848997993482112:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 14244us (14500us total) trans 8589939793 rc 0/0 00000100:00100000:3.0:1763343033.637928:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9113 00010000:00010000:3.0:1763343033.638309:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5ac8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.638322:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.638333:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343033.638343:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d1:0x0]: returning size 0 00010000:00010000:3.0:1763343033.638378:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5aba lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.638386:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5aba lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.638392:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5aba lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.638399:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5aba lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.638405:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.638410:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5aba lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.638422:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5aba lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.638434:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935d00) 00010000:00010000:3.0:1763343033.638436:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.638441:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5aba lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.638447:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5aba lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:3.0:1763343033.638462:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ac67622c reply state 000000006f877387 transno 8589939794 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.638471:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ac1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.638477:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:3.0:1763343033.638480:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343033.638482:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343033.638513:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5ab3 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e73 expref: 238 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.638534:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e73 expref: 237 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.638541:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a350b53a000) 00010000:00010000:3.0:1763343033.638543:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343033.638546:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:3.0:1763343033.638576:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56848:x1848997993482496:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 5653us (7645us total) trans 8589939794 rc 0/0 00000100:00100000:3.0:1763343033.638586:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9115 00010000:00010000:1.0:1763343033.638859:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.638868:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a97 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.638875:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.638880:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.638883:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.638888:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a97 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.638898:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:1.0:1763343033.638901:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343033.638904:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a97 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.638908:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5a97 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343033.639407:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3660:x1848998010242432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5569us (5645us total) trans 21474838828 rc 0/0 00000100:00100000:2.0:1763343033.639419:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6377 00000004:00080000:1.0:1763343033.639521:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062f0e00/2, rc 0, transno 21474838828 00000100:00100000:1.0:1763343033.639529:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010242432:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343033.640594:0:28648:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343033.640601:0:28648:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343033.640603:0:28648:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343033.640605:0:28648:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343033.640608:0:28648:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343033.640704:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3658:x1848998010242560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 6864us (6929us total) trans 21474838829 rc 0/0 00000100:00100000:3.0:1763343033.640715:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6378 00000004:00080000:2.0:1763343033.640846:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062f2a00/2, rc 0, transno 21474838829 00000100:00100000:2.0:1763343033.640853:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010242560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343033.648423:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.648481:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.648585:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993482624 00000100:00100000:1.0:1763343033.648599:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993482624 00000100:00100000:1.0:1763343033.648701:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993482880 00000100:00100000:1.0:1763343033.648705:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993482880 00000100:00100000:1.0:1763343033.648734:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9116 00000100:00100000:1.0:1763343033.648746:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56846:x1848997993482624:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.648787:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.648817:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5ad6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e7a expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.648899:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e7a expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.648921:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e7a expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.648943:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:1.0:1763343033.648947:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343033.648965:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:1.0:1763343033.649037:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56846:x1848997993482624:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 293us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.649044:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9116 00000100:00100000:1.0:1763343033.649069:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9117 00000100:00100000:1.0:1763343033.649076:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56848:x1848997993482880:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.649085:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.649095:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5add lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e81 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.649256:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5ae4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.649270:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e73 expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.649284:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5ae4 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.649328:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e73 expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.649342:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e73 expref: 239 pid: 10042 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.649358:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010242688:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343033.649428:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343033.655500:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.655594:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993483008 00000100:00100000:0.0:1763343033.655609:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993483008 00000100:00100000:0.0:1763343033.655742:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9118 00000100:00100000:0.0:1763343033.655754:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56846:x1848997993483008:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343033.655783:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.655811:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae5aeb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e88 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.655920:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5af2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.655938:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5af2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.655962:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5af2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343033.656021:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d0:0x0]: returning size 5 00000004:00200000:0.0:1763343033.656027:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343033.656052:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5af2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343033.656082:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae5aeb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e88 expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.656101:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5af2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e88 expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.656111:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:0.0:1763343033.656114:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763343033.656118:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d200, rc 0) 00000100:00100000:0.0:1763343033.656183:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56846:x1848997993483008:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 431us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.656192:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9118 00000100:00100000:3.0:1763343033.657745:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010242688:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343033.657784:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5ae4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:0.0:1763343033.657803:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.657882:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993483136 00000100:00100000:2.0:1763343033.657892:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993483136 00010000:00010000:2.0:1763343033.657933:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e73 expref: 241 pid: 10042 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343033.658003:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2999 00000100:00100000:2.0:1763343033.658013:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:2429:x1848997993483136:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343033.658032:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343033.658039:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e73 expref: 241 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.658053:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e73 expref: 241 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.658076:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5ac8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e73 expref: 241 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.658093:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a350b53a000) 00010000:00010000:2.0:1763343033.658098:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5ae4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.658108:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5ae4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.658116:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5ae4 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.658148:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343033.658387:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:2429:x1848997993483136:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 374us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.658396:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2999 00010000:00010000:3.0:1763343033.658407:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5ae4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.658414:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5ae4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343033.658445:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d1:0x0]: returning size 0 00000004:00080000:2.0:1763343033.659466:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x293:0x0], index 1: 0 00000004:00080000:2.0:1763343033.659478:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x291:0x0], index 0: 0 00000004:00080000:2.0:1763343033.659484:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x292:0x0], index 0: 0 00000004:00080000:2.0:1763343033.659489:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x294:0x0], index 1: 0 00000100:00100000:1.0:1763343033.659764:0:32356:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:32356:1848998010242816:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1763343033.659837:0:32356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343033.659883:0:32356:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe240 going to sleep for 11 seconds 00000100:00100000:3.0:1763343033.659976:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010242816 00000100:00100000:3.0:1763343033.659985:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010242816 00000100:00100000:3.0:1763343033.660046:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6379 00000100:00100000:3.0:1763343033.660056:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:32356:x1848998010242816:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1763343033.660111:0:28648:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 674 00010000:00010000:2.0:1763343033.660324:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5ae4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.660336:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5ae4 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.660348:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5ae4 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.660355:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.660360:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5ae4 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.660368:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5ae4 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.660386:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a350b53a000) 00010000:00010000:2.0:1763343033.660390:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343033.660395:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5ae4 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.660401:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5ae4 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.660467:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5add lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e81 expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.660479:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a350b53a000) 00010000:00010000:2.0:1763343033.660482:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343033.660486:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5add lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e81 expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.660502:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:2.0:1763343033.660571:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56848:x1848997993482880:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 11494us (12088us total) trans 8589939795 rc 301/301 00000100:00100000:2.0:1763343033.660579:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9117 00000100:00100000:2.0:1763343033.663059:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:32356:x1848998010242816:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2994us (3212us total) trans 21474838830 rc 0/0 00000100:00100000:2.0:1763343033.663075:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6379 00000100:00100000:1.0:1763343033.663199:0:32356:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:32356:1848998010242816:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1763343033.663219:0:32356:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x292:0x0]-[0x280000401:0x2c1:0x0] 00000100:00100000:0.0:1763343033.667775:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.668896:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993483264 00000100:00100000:2.0:1763343033.668913:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993483264 00000100:00100000:2.0:1763343033.669005:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6380 00000100:00100000:2.0:1763343033.669018:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2429:x1848997993483264:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.669048:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.669080:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34049c8200/0x607405d401ae5b00 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e8f expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343033.669112:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28f:0x0] initial LVB size: 5, mtime: 0x691a7ab9, atime: 0x691a7ab9, ctime: 0x691a7ab9, blocks: 0x8 00010000:00010000:2.0:1763343033.669137:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.669140:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.669153:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34049c8200/0x607405d401ae5b00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e8f expref: 25 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.669172:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a34049c8200/0x607405d401ae5b00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e8f expref: 25 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.669187:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34049c8200, rc 0) 00000100:00100000:2.0:1763343033.669265:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2429:x1848997993483264:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 249us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.669274:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6380 00000100:00100000:0.0:1763343033.669389:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.669538:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993483520 00000100:00100000:3.0:1763343033.669544:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993483520 00000100:00100000:3.0:1763343033.669589:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3099 00000100:00100000:3.0:1763343033.669599:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56848:x1848997993483520:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343033.670385:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56848:x1848997993483520:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 784us (994us total) trans 8589939796 rc 0/0 00000100:00100000:3.0:1763343033.670395:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3099 00000100:00100000:0.0:1763343033.678462:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.680564:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993483776 00000100:00100000:2.0:1763343033.680588:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993483776 00000100:00100000:2.0:1763343033.680759:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3100 00000100:00100000:2.0:1763343033.680771:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56848:x1848997993483776:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343033.681182:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56848:x1848997993483776:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 412us (2735us total) trans 8589939797 rc 0/0 00000100:00100000:2.0:1763343033.681191:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3100 00000100:00100000:0.0:1763343033.692755:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.696209:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993484032 00000100:00100000:2.0:1763343033.696232:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993484032 00000100:00100000:2.0:1763343033.696344:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9119 00000100:00100000:2.0:1763343033.696357:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:55941:x1848997993484032:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343033.696391:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.696424:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5b07 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e96 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.696617:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5b0e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.696683:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5b0e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.696697:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5b0e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.696711:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5b15 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.696719:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5b15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.696726:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5b15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.696804:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae5b1c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.696816:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae5b1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.696823:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae5b1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343033.696834:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d1:0x0]: returning size 0 00010000:00010000:2.0:1763343033.696941:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5b0e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.696959:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5b0e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.696966:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5b0e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.696973:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5b0e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.696979:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c8600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.696984:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5b0e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.696996:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5b0e lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.697012:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935d00) 00010000:00010000:2.0:1763343033.697016:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.697022:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5b0e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.697029:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5b0e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.697050:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5b15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.697057:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5b15 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.697063:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5b15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.697069:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.697368:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5b15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.697374:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5b15 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.697383:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:2.0:1763343033.697385:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.697389:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5b15 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.697394:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5b15 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.698756:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5b07 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e96 expref: 244 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.698789:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae5b1c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e96 expref: 243 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.698798:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:2.0:1763343033.698801:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343033.698805:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a85200, rc 0) 00000100:00100000:2.0:1763343033.698898:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:55941:x1848997993484032:12345-192.168.204.21@tcp:101:bash.0 Request processed in 2544us (6158us total) trans 8589939798 rc 0/0 00000100:00100000:2.0:1763343033.698909:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9119 00000100:00100000:1.0:1763343033.704049:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.704148:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993484160 00000100:00100000:2.0:1763343033.704158:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993484160 00000100:00100000:2.0:1763343033.704221:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9120 00000100:00100000:2.0:1763343033.704232:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:55941:x1848997993484160:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343033.704258:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.704281:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5b2a lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8e9d expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.704316:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5b31 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.704389:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5b31 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.704404:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5b31 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.704766:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5b2a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e9d expref: 245 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.704786:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5b31 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e9d expref: 244 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.704794:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:2.0:1763343033.704798:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343033.704802:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480a00, rc 0) 00000100:00100000:2.0:1763343033.704853:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:55941:x1848997993484160:12345-192.168.204.21@tcp:101:bash.0 Request processed in 622us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.704861:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9120 00000100:00100000:0.0:1763343033.715615:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.718091:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993484416 00000100:00100000:3.0:1763343033.718112:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993484416 00000100:00100000:3.0:1763343033.718206:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9121 00000100:00100000:3.0:1763343033.718217:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:55941:x1848997993484416:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:3.0:1763343033.718287:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343033.718323:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae5b1c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e96 expref: 244 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.718347:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:3.0:1763343033.718355:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343033.719251:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5b38 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.719272:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5b38 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.719284:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5b38 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000001:00080000:3.0:1763343033.719352:0:28422:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939799 00000004:00010000:3.0:1763343033.719381:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002af194f1 reply state 0000000076d31bb6 transno 8589939800 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5b38 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.719399:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5b38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.719406:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:3.0:1763343033.719410:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343033.719412:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343033.719901:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.720196:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993484544 00000100:00100000:2.0:1763343033.720206:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993484544 00000100:00100000:2.0:1763343033.720264:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6381 00000100:00100000:2.0:1763343033.720275:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2430:x1848997993484544:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:2.0:1763343033.720370:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2430:x1848997993484544:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 98us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.720378:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6381 00000100:00100000:3.0:1763343033.720685:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:55941:x1848997993484416:12345-192.168.204.21@tcp:36:bash.0 Request processed in 1333us (3950us total) trans 8589939800 rc 0/0 00000100:00100000:3.0:1763343033.720694:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9121 00000020:00080000:3.0:1763343033.720699:0:28422:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343033.726616:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.727493:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.727660:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993484800 00000100:00100000:1.0:1763343033.727673:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993484800 00000100:00100000:1.0:1763343033.727749:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6382 00000100:00100000:1.0:1763343033.727762:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2429:x1848997993484800:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:1.0:1763343033.727916:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2429:x1848997993484800:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 157us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.727924:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6382 00000100:00100000:3.0:1763343033.728517:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993484672 00000100:00100000:3.0:1763343033.728525:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993484672 00000100:00100000:3.0:1763343033.728574:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9122 00000100:00100000:3.0:1763343033.728582:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:55941:x1848997993484672:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343033.728602:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.728666:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5b3f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ea4 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.728741:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5b3f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ea4 expref: 247 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.728758:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5b3f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ea4 expref: 247 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.728780:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:3.0:1763343033.728783:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343033.728788:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92c00, rc 0) 00000100:00100000:3.0:1763343033.728835:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:55941:x1848997993484672:12345-192.168.204.21@tcp:101:bash.0 Request processed in 248us (2230us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343033.728843:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9122 00000100:00100000:0.0:1763343033.735561:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.735899:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993485056 00000100:00100000:1.0:1763343033.735914:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993485056 00000100:00100000:1.0:1763343033.736000:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9123 00000100:00100000:1.0:1763343033.736012:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:55941:x1848997993485056:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343033.736041:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.736046:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343033.736087:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5b3f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ea4 expref: 247 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.736111:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:1.0:1763343033.736117:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343033.736136:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5b46 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8eab expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.736201:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5b4d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.736218:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5b4d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.736229:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5b4d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:2.0:1763343033.736674:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.736766:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993485184 00000100:00100000:0.0:1763343033.736772:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993485184 00000100:00100000:0.0:1763343033.736839:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1564 00000100:00100000:0.0:1763343033.736848:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2429:x1848997993485184:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:0.0:1763343033.736908:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae5b54 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.736923:0:8415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.736925:0:8415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.736932:0:8415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae5b54 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.736944:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae5b54 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.737103:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae5b54 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.737114:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae5b54 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.737123:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae5b54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.737131:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ca00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343033.737136:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae5b54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.737152:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae5b54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.737168:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae5b54 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.737176:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665ca00/0x607405d401ae5b54 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.737267:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2429:x1848997993485184:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 419us (594us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763343033.737276:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1564 00000040:00080000:1.0:1763343033.737469:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1375, 88 off116432 00000004:00080000:1.0:1763343033.737481:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1227404859656ns, next at 1227177369372ns, rc = 0 00000040:00080000:1.0:1763343033.737528:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1374, 88 off116432 00000004:00080000:1.0:1763343033.737533:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1227404912667ns, next at 1227177401661ns, rc = 0 00000040:00080000:1.0:1763343033.737558:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1375, 88 off116520 00000004:00080000:1.0:1763343033.737562:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1227404940787ns, next at 1227177401661ns, rc = 0 00000040:00080000:1.0:1763343033.737570:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1376, 88 off116520 00000004:00080000:1.0:1763343033.737574:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1227404952813ns, next at 1227177369372ns, rc = 0 00000100:00100000:0.0:1763343033.745732:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.745822:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993485312 00000100:00100000:3.0:1763343033.745835:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993485312 00000100:00100000:3.0:1763343033.745917:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9124 00000100:00100000:3.0:1763343033.745929:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56846:x1848997993485312:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343033.745964:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.745993:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5b5b lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8eb2 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.746037:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5b62 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.746055:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5b62 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.746068:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5b62 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.746213:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5b5b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eb2 expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.746233:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92c00/0x607405d401ae5b62 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eb2 expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.746243:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:3.0:1763343033.746247:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343033.746251:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92c00, rc 0) 00000100:00100000:3.0:1763343033.746320:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56846:x1848997993485312:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 393us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343033.746332:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9124 00000100:00100000:3.0:1763343033.752010:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000001:00080000:1.0:1763343033.752258:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939801 is committed 00000004:00080000:1.0:1763343033.752268:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 906 committed 00000004:00080000:1.0:1763343033.752281:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 907 committed 00000004:00080000:1.0:1763343033.752289:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 906 committed 00000004:00080000:1.0:1763343033.752292:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 905 committed 00010000:00010000:1.0:1763343033.752390:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5b4d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eab expref: 242 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.752407:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:1.0:1763343033.752410:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343033.752433:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5b46 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eab expref: 242 pid: 10042 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343033.752455:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5b4d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d1:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eab expref: 241 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.752492:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:1.0:1763343033.752495:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343033.752497:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177a00, rc 0) 00000100:00100000:1.0:1763343033.752567:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:55941:x1848997993485056:12345-192.168.204.21@tcp:101:bash.0 Request processed in 16556us (17021us total) trans 8589939801 rc 0/0 00000100:00100000:1.0:1763343033.752578:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9123 00000100:00100000:1.0:1763343033.752725:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343033.752742:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010243072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343033.752791:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343033.752840:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010243072 00000100:00100000:1.0:1763343033.752848:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010243072 00000100:00100000:1.0:1763343033.752887:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6383 00000100:00100000:1.0:1763343033.752894:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3660:x1848998010243072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343033.753091:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3660:x1848998010243072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 196us (298us total) trans 17179871531 rc 0/0 00000100:00100000:1.0:1763343033.753097:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6383 00000004:00080000:1.0:1763343033.753137:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b91c00/2, rc 0, transno 17179871531 00000100:00100000:1.0:1763343033.753142:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010243072:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763343033.754120:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ac1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.754134:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ac1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.754141:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ac1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.754148:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.754153:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ac1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.754162:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ac1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.754179:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a350b53ae00) 00010000:00010000:3.0:1763343033.754181:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.754186:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ac1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.754192:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ac1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343033.754220:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5b38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.754227:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5b38 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.754233:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5b38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.754239:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.754242:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5b38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.754248:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5b38 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.754255:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:3.0:1763343033.754257:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.754259:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5b38 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.754265:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5b38 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343033.754281:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343033.754298:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010242944:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343033.754360:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343033.754443:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993485440 00000100:00100000:3.0:1763343033.754451:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993485440 00000100:00100000:3.0:1763343033.754512:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1565 00000100:00100000:3.0:1763343033.754520:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993485440:12345-192.168.204.21@tcp:4:lfs.0 00010000:00010000:3.0:1763343033.754557:0:28424:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5b69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.754576:0:28424:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae5924 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8de7 expref: 17 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343033.754585:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343033.754588:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343033.754592:0:28424:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5b69 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.754648:0:28424:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae5924 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8de7 expref: 17 pid: 28993 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343033.754663:0:28424:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae5924 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8de7 expref: 17 pid: 28993 timeout: 1327 lvb_type: 1 00000100:00100000:3.0:1763343033.754677:0:28424:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3501218a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:28424:1848998010243200:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343033.754740:0:28424:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343033.754803:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343033.754811:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3501218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010243328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343033.754839:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343033.754866:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010243456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343033.754886:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343033.755020:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010242944 00000100:00100000:3.0:1763343033.755024:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010242944 00000100:00100000:3.0:1763343033.755046:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010243328 00000100:00100000:3.0:1763343033.755048:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010243328 00000100:00100000:3.0:1763343033.755061:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010243456 00000100:00100000:3.0:1763343033.755063:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010243456 00000100:00100000:3.0:1763343033.755086:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6384 00000100:00100000:3.0:1763343033.755092:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3657:x1848998010242944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343033.755250:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3657:x1848998010242944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (890us total) trans 17179871532 rc 0/0 00000100:00100000:3.0:1763343033.755258:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6384 00000100:00100000:3.0:1763343033.755273:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6385 00000100:00100000:3.0:1763343033.755278:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e6ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3659:x1848998010243328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343033.755369:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e6ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3659:x1848998010243328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (529us total) trans 21474838831 rc 0/0 00000100:00100000:3.0:1763343033.755375:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6385 00000100:00100000:3.0:1763343033.755512:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6386 00000100:00100000:3.0:1763343033.755517:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3657:x1848998010243456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343033.755573:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3657:x1848998010243456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (685us total) trans 21474838832 rc 0/0 00000100:00100000:3.0:1763343033.755579:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6386 00000004:00080000:3.0:1763343033.755646:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3501218380/2, rc 0, transno 21474838831 00000100:00100000:3.0:1763343033.755653:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3501218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010243328:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343033.755670:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d6a00/2, rc 0, transno 21474838832 00000100:00100000:3.0:1763343033.755674:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010243456:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343033.755684:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b90700/2, rc 0, transno 17179871532 00000100:00100000:3.0:1763343033.755688:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010242944:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763343033.757724:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343033.761024:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.761125:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993485568 00000100:00100000:1.0:1763343033.761139:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993485568 00000100:00100000:2.0:1763343033.762005:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6387 00000100:00100000:2.0:1763343033.762026:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:55941:x1848997993485568:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343033.762060:0:27833:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.762090:0:27833:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5b70 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8eb9 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343033.762119:0:27833:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x293:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343033.762833:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.762840:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.762855:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5b70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eb9 expref: 19 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.762881:0:27833:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5b70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eb9 expref: 19 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.762907:0:27833:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501481200, rc 0) 00000100:00100000:2.0:1763343033.763014:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:55941:x1848997993485568:12345-192.168.204.21@tcp:101:bash.0 Request processed in 995us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.763023:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6387 00000100:00100000:0.0:1763343033.766545:0:28424:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3501218a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:28424:1848998010243200:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343033.766588:0:28424:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5b69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343033.769933:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.770202:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.770447:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993485696 00000100:00100000:2.0:1763343033.770462:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993485696 00010000:00010000:2.0:1763343033.770518:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae5924 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8de7 expref: 19 pid: 28993 timeout: 1327 lvb_type: 1 00000100:00100000:2.0:1763343033.770576:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3000 00000100:00100000:2.0:1763343033.770588:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993485696:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343033.770608:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343033.770700:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae5924 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x292:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8de7 expref: 19 pid: 28993 timeout: 1327 lvb_type: 1 00010000:00010000:2.0:1763343033.770716:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae5924 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x292:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8de7 expref: 19 pid: 28993 timeout: 1327 lvb_type: 1 00010000:00010000:2.0:1763343033.770747:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae5924 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x292:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8de7 expref: 19 pid: 28993 timeout: 1327 lvb_type: 1 00010000:00010000:2.0:1763343033.770769:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.770772:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.770778:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5b69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.770796:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5b69 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.770829:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343033.770897:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993485696:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 310us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.770907:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3000 00000100:00100000:1.0:1763343033.770998:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993485824 00000100:00100000:1.0:1763343033.771004:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993485824 00000100:00100000:1.0:1763343033.771050:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6388 00000100:00100000:1.0:1763343033.771058:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:55941:x1848997993485824:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343033.771078:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.771106:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae5b77 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ec0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343033.771129:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x291:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343033.771147:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.771149:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.771157:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae5b77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ec0 expref: 26 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.771172:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae5b77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ec0 expref: 26 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.771185:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343033.771213:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:55941:x1848997993485824:12345-192.168.204.21@tcp:101:bash.0 Request processed in 157us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.771223:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6388 00010000:00010000:3.0:1763343033.771502:0:28424:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5b69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.771569:0:28424:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5b69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.779269:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.779313:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.780016:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993486080 00000100:00100000:2.0:1763343033.780028:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993486080 00002000:00010000:2.0:1763343033.780069:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/657 (0->18446744073709551615) 00002000:00100000:2.0:1763343033.780074:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a353796a300 with x1848997993486080 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343033.780088:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a353796a300. 00000100:00100000:2.0:1763343033.780108:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993485952 00000100:00100000:2.0:1763343033.780112:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993485952 00002000:00010000:2.0:1763343033.780123:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/659 (0->18446744073709551615) 00002000:00100000:2.0:1763343033.780125:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537968000 with x1848997993485952 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343033.780130:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537968000. 00000100:00100000:2.0:1763343033.780156:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1566 00000100:00100000:2.0:1763343033.780166:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2432:x1848997993486080:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:1.0:1763343033.780285:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1567 00000100:00100000:1.0:1763343033.780311:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2431:x1848997993485952:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343033.780367:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x291:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343033.780371:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x291:0x0] updating lvb mtime from disk: 0 -> 1763343033 00002000:00010000:2.0:1763343033.780374:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x291:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343033.780376:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x291:0x0] updating lvb ctime from disk: 0 -> 1763343033 00002000:00010000:2.0:1763343033.780378:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x291:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343033.780436:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2432:x1848997993486080:12345-192.168.204.21@tcp:10:bash.0 Request processed in 269us (1175us total) trans 21474838833 rc 0/0 00000100:00100000:2.0:1763343033.780448:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1566 00002000:00010000:2.0:1763343033.780452:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/657 (0->18446744073709551615) 00002000:00100000:2.0:1763343033.780454:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a353796a300 with x1848997993486080 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343033.780458:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a353796a300. 00002000:00010000:1.0:1763343033.784309:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x293:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343033.784324:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x293:0x0] updating lvb mtime from disk: 0 -> 1763343033 00002000:00010000:1.0:1763343033.784328:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x293:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343033.784332:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x293:0x0] updating lvb ctime from disk: 0 -> 1763343033 00002000:00010000:1.0:1763343033.784335:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x293:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343033.784451:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2431:x1848997993485952:12345-192.168.204.21@tcp:10:bash.0 Request processed in 4142us (5128us total) trans 17179871534 rc 0/0 00000100:00100000:1.0:1763343033.784465:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1567 00002000:00010000:1.0:1763343033.784472:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/659 (0->18446744073709551615) 00002000:00100000:1.0:1763343033.784476:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537968000 with x1848997993485952 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343033.784484:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537968000. 00000100:00100000:3.0:1763343033.788352:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000001:00080000:0.0:1763343033.789142:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871533 is committed 00000001:00080000:0.0:1763343033.789161:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871532 is committed 00000100:00100000:1.0:1763343033.789465:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993486336 00000100:00100000:1.0:1763343033.789475:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993486336 00000100:00100000:1.0:1763343033.789538:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3101 00000100:00100000:1.0:1763343033.789548:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:55941:x1848997993486336:12345-192.168.204.21@tcp:35:bash.0 00002000:00010000:3.0:1763343033.789697:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1763343033.789703:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb mtime from disk: 0 -> 1763343033 00002000:00010000:3.0:1763343033.789706:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb ctime from disk: 0 -> 1763343033 00002000:00010000:3.0:1763343033.789708:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763343033.789720:0:28424:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5b69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.789731:0:28424:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5b69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.789739:0:28424:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5b69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.789745:0:28424:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343033.789750:0:28424:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5b69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.789758:0:28424:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5b69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.789777:0:28424:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5b69 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.789783:0:28424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5b69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343033.790267:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993485440:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 35744us (38268us total) trans 17179871533 rc 0/0 00000100:00100000:1.0:1763343033.790267:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993486336:12345-192.168.204.21@tcp:35:bash.0 Request processed in 717us (1922us total) trans 8589939802 rc 0/0 00000100:00100000:1.0:1763343033.790277:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3101 00000100:00100000:3.0:1763343033.790278:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1565 00000100:00100000:2.0:1763343033.806431:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.807648:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993486464 00000100:00100000:1.0:1763343033.807662:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993486464 00000100:00100000:1.0:1763343033.807730:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9125 00000100:00100000:1.0:1763343033.807740:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56849:x1848997993486464:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:1.0:1763343033.807764:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.807789:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5b7e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ec7 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.807856:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5b85 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.807869:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5b85 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.807881:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5b85 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.807894:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5b8c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.807902:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5b8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.807908:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5b8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808000:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5b93 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808009:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5b93 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808015:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5b93 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343033.808053:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d1:0x0]: returning size 5 00000004:00200000:1.0:1763343033.808058:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343033.808076:0:10042:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5b93 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808087:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5b93 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808096:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5b85 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808102:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5b85 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808108:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5b85 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808114:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5b85 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808120:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.808124:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5b85 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808131:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5b85 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808144:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdce00) 00010000:00010000:1.0:1763343033.808147:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.808152:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5b85 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808158:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5b85 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808175:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5b8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808181:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5b8c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808188:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5b8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808193:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.808196:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5b8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808202:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5b8c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808209:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdc000) 00010000:00010000:1.0:1763343033.808211:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.808214:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5b8c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808219:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5b8c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.808249:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5b7e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ec7 expref: 242 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.808264:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5b93 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ec7 expref: 241 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.808272:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:1.0:1763343033.808274:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343033.808276:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:1.0:1763343033.808341:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56849:x1848997993486464:12345-192.168.204.21@tcp:101:rm.0 Request processed in 602us (1919us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.808348:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9125 00000100:00100000:0.0:1763343033.824541:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.824593:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.824707:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993486720 00000100:00100000:2.0:1763343033.824718:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993486720 00000100:00100000:2.0:1763343033.824769:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993486976 00000100:00100000:2.0:1763343033.824772:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993486976 00000100:00100000:2.0:1763343033.824801:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9126 00000100:00100000:2.0:1763343033.824810:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56846:x1848997993486720:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:2.0:1763343033.824865:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343033.824894:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5af2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d0:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e88 expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.824914:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:2.0:1763343033.824919:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.825003:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5b9a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825019:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5b9a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825029:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5b9a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00010000:2.0:1763343033.825152:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c69fd64c reply state 00000000f029ed8d transno 8589939803 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5b9a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825170:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5b9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825177:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:2.0:1763343033.825180:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343033.825182:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343033.825275:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56846:x1848997993486720:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 466us (744us total) trans 8589939803 rc 0/0 00000100:00100000:2.0:1763343033.825284:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9126 00000100:00100000:2.0:1763343033.825305:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9127 00000100:00100000:2.0:1763343033.825312:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56849:x1848997993486976:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:2.0:1763343033.825335:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343033.825348:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5b4d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eab expref: 242 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.825364:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5b93 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ec7 expref: 241 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.825375:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5b31 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e9d expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.825387:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:2.0:1763343033.825394:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.825410:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5ba1 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825417:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825428:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5ba1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825440:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ba8 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825446:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825452:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825519:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5baf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825526:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5baf lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825533:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5baf lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:2.0:1763343033.825780:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1377, 64 off116584 00000004:00080000:2.0:1763343033.825788:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1227493166867ns, next at 1228493164729ns, rc = 0 00000040:00080000:2.0:1763343033.825810:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1376, 64 off116584 00000004:00080000:2.0:1763343033.825814:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1227493193527ns, next at 1228493192443ns, rc = 0 00000040:00080000:2.0:1763343033.825823:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1377, 64 off116648 00000040:00080000:2.0:1763343033.825833:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1378, 64 off116648 00010000:00010000:2.0:1763343033.825867:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5bb6 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825877:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825889:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5bb6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825895:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5bb6 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825901:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5bb6 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825907:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5bb6 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825926:0:6523:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343033.825945:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343033.825965:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5bb6 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825971:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343033.825976:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5bb6 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825982:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5bb6 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.825991:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343033.825994:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343033.825998:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5bb6 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826004:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5bb6 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826013:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343033.826015:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343033.826017:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343033.826039:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5baf lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826045:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5baf lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826050:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5baf lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826055:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.826059:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5baf lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826064:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5baf lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826070:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d1:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343033.826072:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343033.826075:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5baf lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826080:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5baf lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826198:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5ba1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826205:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5ba1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826210:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5ba1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826215:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5ba1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826220:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.826222:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5ba1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826228:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5ba1 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826235:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935500) 00010000:00010000:2.0:1763343033.826237:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.826240:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5ba1 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826245:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5ba1 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:2.0:1763343033.826255:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001b8dac69 reply state 00000000359145e3 transno 8589939804 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826263:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ba8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.826269:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935700) 00010000:00010000:2.0:1763343033.826271:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343033.826273:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343033.826311:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56849:x1848997993486976:12345-192.168.204.21@tcp:36:rm.0 Request processed in 999us (1716us total) trans 8589939804 rc 0/0 00000100:00100000:2.0:1763343033.826318:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9127 00000100:00100000:3.0:1763343033.831262:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.831351:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993487104 00000100:00100000:2.0:1763343033.831362:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993487104 00000100:00100000:2.0:1763343033.831427:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6389 00000100:00100000:2.0:1763343033.831437:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:56846:x1848997993487104:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.831457:0:27833:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.831480:0:27833:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae5bbd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ece expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343033.831503:0:27833:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x292:0x0] initial LVB size: 4096, mtime: 0x691a7ab9, atime: 0x0, ctime: 0x691a7ab9, blocks: 0x8 00010000:00010000:2.0:1763343033.831524:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.831527:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.831535:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae5bbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ece expref: 15 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.831552:0:27833:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae5bbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ece expref: 15 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.831564:0:27833:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34049c8600, rc 0) 00000100:00100000:2.0:1763343033.831659:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:56846:x1848997993487104:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 223us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.831666:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6389 00000100:00100000:2.0:1763343033.839172:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.839428:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993487232 00000100:00100000:1.0:1763343033.839441:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993487232 00000100:00100000:1.0:1763343033.839507:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6390 00000100:00100000:1.0:1763343033.839518:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:56846:x1848997993487232:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.839542:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.839564:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae5bc4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ed5 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.839599:0:28993:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6200/0x607405d401ae592b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dee expref: 28 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343033.839608:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.839611:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343033.839616:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae5bc4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ed5 expref: 28 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.839690:0:28993:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6200/0x607405d401ae592b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dee expref: 28 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343033.839708:0:28993:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6200/0x607405d401ae592b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dee expref: 28 pid: 8408 timeout: 1327 lvb_type: 1 00000100:00100000:1.0:1763343033.839725:0:28993:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010243584:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343033.839829:0:28993:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe240 going to sleep for 11 seconds 00000100:00100000:1.0:1763343033.847922:0:28993:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010243584:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.847974:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae5bc4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ed5 expref: 28 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.848003:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00000100:00100000:1.0:1763343033.848073:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:56846:x1848997993487232:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8556us (8911us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.848082:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6390 00000100:00100000:3.0:1763343033.850607:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.850791:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993487360 00000100:00100000:0.0:1763343033.850804:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993487360 00010000:00010000:0.0:1763343033.850850:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6200/0x607405d401ae592b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dee expref: 28 pid: 8408 timeout: 1327 lvb_type: 1 00000100:00100000:2.0:1763343033.851461:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3001 00000100:00100000:2.0:1763343033.851478:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2429:x1848997993487360:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343033.851495:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343033.851520:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6200/0x607405d401ae592b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x290:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dee expref: 28 pid: 8408 timeout: 1327 lvb_type: 1 00010000:00010000:2.0:1763343033.851535:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6200/0x607405d401ae592b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x290:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dee expref: 28 pid: 8408 timeout: 1327 lvb_type: 1 00010000:00010000:2.0:1763343033.851566:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6200/0x607405d401ae592b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x290:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8dee expref: 28 pid: 8408 timeout: 1327 lvb_type: 1 00010000:00010000:2.0:1763343033.851582:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.851584:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.851589:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae5bc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ed5 expref: 27 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.851600:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae5bc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ed5 expref: 27 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.852254:0:6510:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae5bc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ed5 expref: 27 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343033.852272:0:6510:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6510:1848998010243712:192.168.204.21@tcp:105: 00000100:00100000:2.0:1763343033.852364:0:6510:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509bdff00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343033.857132:0:6510:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6510:1848998010243712:192.168.204.21@tcp:105: 00010000:00010000:1.0:1763343033.857160:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343033.857222:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2429:x1848997993487360:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 5749us (6624us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.857233:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3001 00000100:00100000:0.0:1763343033.861898:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.861974:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.862061:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993487488 00000100:00100000:3.0:1763343033.862073:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993487488 00002000:00010000:3.0:1763343033.862121:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/658 (5->18446744073709551615) 00002000:00100000:3.0:1763343033.862126:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a353796b800 with x1848997993487488 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343033.862139:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a353796b800. 00000100:00100000:3.0:1763343033.862168:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993487616 00000100:00100000:3.0:1763343033.862171:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993487616 00002000:00010000:3.0:1763343033.862184:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/656 (0->18446744073709551615) 00002000:00100000:3.0:1763343033.862188:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537968e00 with x1848997993487616 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343033.862194:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537968e00. 00000100:00100000:3.0:1763343033.862228:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1568 00000100:00100000:3.0:1763343033.862237:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993487488:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:3.0:1763343033.862565:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:3.0:1763343033.862568:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb mtime from disk: 1763343033 -> 1763343033 00002000:00010000:3.0:1763343033.862571:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343033.862573:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb ctime from disk: 1763343033 -> 1763343033 00002000:00010000:3.0:1763343033.862575:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343033.862881:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1569 00000100:00100000:2.0:1763343033.862891:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2430:x1848997993487616:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:2.0:1763343033.863002:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343033.863005:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb mtime from disk: 0 -> 1763343033 00002000:00010000:2.0:1763343033.863007:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343033.863009:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb ctime from disk: 0 -> 1763343033 00002000:00010000:2.0:1763343033.863011:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343033.865141:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993487488:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 2893us (3248us total) trans 17179871535 rc 0/0 00000100:00100000:3.0:1763343033.865155:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1568 00002000:00010000:3.0:1763343033.865162:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/658 (5->18446744073709551615) 00002000:00100000:3.0:1763343033.865166:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a353796b800 with x1848997993487488 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343033.865177:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a353796b800. 00000100:00100000:0.0:1763343033.865501:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.866063:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2430:x1848997993487616:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 3171us (4111us total) trans 21474838834 rc 0/0 00000100:00100000:2.0:1763343033.866078:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1569 00002000:00010000:2.0:1763343033.866082:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/656 (0->18446744073709551615) 00002000:00100000:2.0:1763343033.866085:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537968e00 with x1848997993487616 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343033.866093:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537968e00. 00000100:00100000:3.0:1763343033.866574:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993487744 00000100:00100000:3.0:1763343033.866586:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993487744 00000100:00100000:3.0:1763343033.868914:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9128 00000100:00100000:3.0:1763343033.868933:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56850:x1848997993487744:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343033.868971:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.868997:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5bcb lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8edc expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.869089:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5bd2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869103:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869115:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869126:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5bd9 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869133:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869139:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869181:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869188:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5bd2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869195:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869204:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.869208:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869215:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5bd2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869228:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53a400) 00010000:00010000:3.0:1763343033.869231:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.869236:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5bd2 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869242:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5bd2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869255:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869260:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5bd9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869265:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869270:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.869272:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869278:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869285:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935700) 00010000:00010000:3.0:1763343033.869287:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.869290:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5bd9 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869295:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5bd9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.869323:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5bcb lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8edc expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.869333:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53a400) 00010000:00010000:3.0:1763343033.869335:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.869339:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5bcb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8edc expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.869352:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:3.0:1763343033.869415:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56850:x1848997993487744:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 490us (3916us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343033.869423:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9128 00000100:00100000:2.0:1763343033.871581:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.872341:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993488000 00000100:00100000:1.0:1763343033.872354:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993488000 00000100:00100000:1.0:1763343033.872412:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9129 00000100:00100000:1.0:1763343033.872421:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56846:x1848997993488000:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:1.0:1763343033.872502:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5be0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.872518:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5be0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.872528:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5be0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00010000:1.0:1763343033.872662:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004401e652 reply state 00000000ad651c13 transno 8589939805 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5be0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.872675:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5be0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.872687:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:1.0:1763343033.872690:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343033.872694:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343033.872785:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56846:x1848997993488000:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 364us (1216us total) trans 8589939805 rc 0/0 00000100:00100000:1.0:1763343033.872792:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9129 00000100:00100000:3.0:1763343033.873275:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.873292:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993488128 00000100:00100000:3.0:1763343033.873297:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993488128 00000100:00100000:3.0:1763343033.873330:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9130 00000100:00100000:3.0:1763343033.873338:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56850:x1848997993488128:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343033.873348:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.873362:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5be7 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ee3 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.873411:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5bee lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873423:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5bee lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873431:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5bee lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873440:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5bf5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873447:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873453:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873482:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5bee lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873489:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5bee lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873496:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5bee lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873501:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.873505:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5bee lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873512:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5bee lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873521:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53ad00) 00010000:00010000:3.0:1763343033.873524:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.873528:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5bee lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873535:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5bee lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873547:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873552:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5bf5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873558:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873563:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.873565:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873570:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5bf5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873576:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935700) 00010000:00010000:3.0:1763343033.873578:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.873581:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5bf5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873586:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5bf5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.873605:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5be7 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ee3 expref: 244 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.873615:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53ad00) 00010000:00010000:3.0:1763343033.873634:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.873639:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5be7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ee3 expref: 244 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.873651:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92a00, rc 0) 00000100:00100000:3.0:1763343033.873680:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56850:x1848997993488128:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 344us (407us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343033.873686:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9130 00000100:00100000:3.0:1763343033.876990:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.877306:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993488256 00000100:00100000:1.0:1763343033.877318:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993488256 00000100:00100000:1.0:1763343033.878396:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6391 00000100:00100000:1.0:1763343033.878411:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2429:x1848997993488256:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:1.0:1763343033.878566:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343033.878570:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb mtime from disk: 1763343033 -> 1763343033 00002000:00010000:1.0:1763343033.878573:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb atime from disk: 1763343033 -> 1763343033 00002000:00010000:1.0:1763343033.878575:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb ctime from disk: 1763343033 -> 1763343033 00002000:00010000:1.0:1763343033.878578:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343033.879989:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2429:x1848997993488256:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 1575us (3004us total) trans 21474838835 rc 0/0 00000100:00100000:1.0:1763343033.880000:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6391 00000100:00100000:0.0:1763343033.880108:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.880320:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993488384 00000100:00100000:1.0:1763343033.880331:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993488384 00000100:00100000:1.0:1763343033.880376:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9131 00000100:00100000:1.0:1763343033.880384:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56850:x1848997993488384:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.880405:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.880428:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5bfc lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8eea expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.880491:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5c03 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.880505:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5c03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343033.880516:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5c03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343033.880562:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343033.880567:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343033.880604:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5bfc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eea expref: 245 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.880648:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5c03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eea expref: 244 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.880657:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdce00) 00010000:00010000:1.0:1763343033.880661:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343033.880665:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177600, rc 0) 00000100:00100000:1.0:1763343033.880728:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56850:x1848997993488384:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 344us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343033.880734:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9131 00000100:00100000:0.0:1763343033.884162:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.885002:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993488640 00000100:00100000:1.0:1763343033.885017:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993488640 00000100:00100000:1.0:1763343033.885245:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3102 00000100:00100000:1.0:1763343033.885256:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fb9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56846:x1848997993488640:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:1.0:1763343033.885331:0:6527:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1d0:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae5a35 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e50 expref: 244 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.885381:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.885393:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5ad6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e7a expref: 244 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.885404:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.885439:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e7a expref: 244 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.885453:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5ad6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e7a expref: 244 pid: 10042 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.885467:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b93800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010243840:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343033.885563:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe900 going to sleep for 11 seconds 00000100:00100000:0.0:1763343033.889796:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.889826:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.890057:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993488896 00000100:00100000:3.0:1763343033.890068:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993488896 00000100:00100000:3.0:1763343033.890134:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9132 00000100:00100000:3.0:1763343033.890146:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56850:x1848997993488896:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343033.890171:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.890194:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5c11 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ef1 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.890260:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5c18 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890274:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5c18 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890285:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5c18 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890294:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5c1f lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890301:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5c1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890312:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5c1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890351:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5c18 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890358:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5c18 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890364:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5c18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890370:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.890375:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5c18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890381:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5c18 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890393:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdce00) 00010000:00010000:3.0:1763343033.890397:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.890401:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5c18 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890407:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5c18 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890421:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5c1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890427:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5c1f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890432:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5c1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890437:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.890440:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5c1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890445:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5c1f lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890452:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935700) 00010000:00010000:3.0:1763343033.890454:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.890457:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5c1f lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890462:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae5c1f lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343033.890489:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5c11 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ef1 expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.890497:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdce00) 00010000:00010000:3.0:1763343033.890500:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343033.890503:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5c11 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ef1 expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.890512:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92a00, rc 0) 00000100:00100000:3.0:1763343033.890571:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56850:x1848997993488896:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 427us (744us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343033.890578:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9132 00000100:00100000:2.0:1763343033.891056:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993488768 00000100:00100000:2.0:1763343033.891063:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993488768 00010000:00010000:2.0:1763343033.891089:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5ad6 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e7a expref: 245 pid: 10042 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343033.891115:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3002 00000100:00100000:2.0:1763343033.891122:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:2430:x1848997993488768:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343033.891134:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343033.891138:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5ad6 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e7a expref: 245 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.891149:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5ad6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e7a expref: 245 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.891163:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:2.0:1763343033.891167:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.891175:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.891181:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.891199:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343033.891225:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:2430:x1848997993488768:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 102us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.891231:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3002 00010000:00010000:1.0:1763343033.891369:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5ad6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e7a expref: 244 pid: 10042 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.891386:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b93800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010243840:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.891408:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.891416:0:6527:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.891422:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00000040:00080000:1.0:1763343033.891658:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1378, 88 off116736 00000004:00080000:1.0:1763343033.891667:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1227559045422ns, next at 1228493192443ns, rc = 0 00000040:00080000:1.0:1763343033.891689:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1379, 88 off116736 00000004:00080000:1.0:1763343033.891692:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1227559071657ns, next at 1228493164729ns, rc = 0 00000040:00080000:1.0:1763343033.891727:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1380, 88 off116824 00000004:00080000:1.0:1763343033.891730:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1227559109697ns, next at 1228493164729ns, rc = 0 00000040:00080000:1.0:1763343033.891743:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1379, 88 off116824 00000004:00080000:1.0:1763343033.891746:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1227559125595ns, next at 1228493192443ns, rc = 0 00000100:00100000:2.0:1763343033.896380:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.896483:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993489152 00000100:00100000:0.0:1763343033.896495:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993489152 00000100:00100000:0.0:1763343033.896560:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9133 00000100:00100000:0.0:1763343033.896571:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56850:x1848997993489152:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343033.896594:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.896597:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343033.896649:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5c03 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eea expref: 245 pid: 10042 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1763343033.896801:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939806 is committed 00000004:00080000:1.0:1763343033.896810:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 910 committed 00000004:00080000:1.0:1763343033.896819:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 909 committed 00000004:00080000:1.0:1763343033.896827:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 908 committed 00000004:00080000:1.0:1763343033.896829:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 909 committed 00000004:00080000:1.0:1763343033.896838:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 908 committed 00000004:00080000:1.0:1763343033.896840:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 907 committed 00000004:00010000:1.0:1763343033.897003:0:6527:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000068ef0f reply state 00000000891cb15e transno 8589939806 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343033.897024:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00000100:00100000:3.0:1763343033.897031:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010243968:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763343033.897036:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:1.0:1763343033.897041:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763343033.897046:0:6527:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343033.897051:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:1.0:1763343033.897054:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343033.897060:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae5a35 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e50 expref: 239 pid: 10041 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343033.897104:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343033.897145:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343033.897151:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010244352:0@lo:2:osp-syn-1-0.0 00010000:00080000:1.0:1763343033.897175:0:6527:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763343033.897179:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343033.897192:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fb9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56846:x1848997993488640:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 11936us (13038us total) trans 8589939806 rc 0/0 00000100:00100000:1.0:1763343033.897203:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3102 00000100:00100000:3.0:1763343033.897209:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010244096:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343033.897237:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343033.897260:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343033.897281:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010244224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343033.897305:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343033.897337:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343033.897346:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343033.897353:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343033.897359:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343033.897364:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343033.897372:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343033.897381:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:3.0:1763343033.897389:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343033.897393:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343033.897398:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5c0a lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.897422:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5b9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.897428:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdce00) 00010000:00010000:2.0:1763343033.897431:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5b9a lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.897440:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5b9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.897441:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.897448:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.897452:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5b9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.897460:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5b9a lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.897462:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae5c26 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ef8 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.897473:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:2.0:1763343033.897478:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.897481:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5b9a lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.897488:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5b9a lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.897503:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ba8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.897513:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ba8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.897520:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ba8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.897539:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.897543:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ba8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.897549:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ba8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.897558:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935700) 00010000:00010000:2.0:1763343033.897561:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343033.897561:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5c2d lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.897567:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ba8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.897577:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5ba8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343033.897580:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5c2d lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.897592:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5c2d lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.897594:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5be0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.897609:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5be0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.897613:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae5c34 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.897616:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5be0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.897646:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae5c34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.897654:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae5c34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.897666:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.897671:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5be0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.897678:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5be0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.897687:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:2.0:1763343033.897689:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.897692:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5be0 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.897697:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5be0 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000100:00100000:2.0:1763343033.897717:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010243968 00000100:00100000:2.0:1763343033.897723:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010243968 00000100:00100000:2.0:1763343033.897759:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010244352 00000100:00100000:2.0:1763343033.897763:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010244352 00000100:00100000:2.0:1763343033.897784:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010244096 00000100:00100000:2.0:1763343033.897786:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010244096 00000100:00100000:2.0:1763343033.897800:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010244224 00000100:00100000:2.0:1763343033.897802:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010244224 00000100:00100000:2.0:1763343033.897825:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6392 00000100:00100000:2.0:1763343033.897834:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3658:x1848998010243968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343033.897855:0:27833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:659 count 1 00010000:00010000:2.0:1763343033.897875:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9a00/0x607405d401ae5c3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.897891:0:27833:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5b70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eb9 expref: 15 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.897899:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343033.897901:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343033.897905:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9a00/0x607405d401ae5c3b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.897932:0:27833:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5b70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eb9 expref: 15 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.897956:0:27833:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5b70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eb9 expref: 15 pid: 27833 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343033.897968:0:27833:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27833:1848998010244480:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343033.898027:0:27833:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509bdf840 going to sleep for 11 seconds 00000100:00100000:2.0:1763343033.898048:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6393 00000100:00100000:2.0:1763343033.898056:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3658:x1848998010244352:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763343033.898092:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5c42 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.898102:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5c42 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.898109:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5c42 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:0.0:1763343033.898119:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d3:0x0]: returning size 0 00010000:00010000:0.0:1763343033.898146:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5c2d lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.898153:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5c2d lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.898159:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5c2d lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00002000:00010000:2.0:1763343033.898164:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb size from disk: 5 -> 5 00010000:00010000:0.0:1763343033.898166:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5c2d lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00002000:00010000:2.0:1763343033.898170:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb mtime from disk: 1763343033 -> 1763343033 00002000:00010000:2.0:1763343033.898176:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:0.0:1763343033.898178:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d000 already unused, calling callback (ffffffffc19a2550) 00002000:00010000:2.0:1763343033.898180:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb ctime from disk: 1763343033 -> 1763343033 00010000:00010000:0.0:1763343033.898183:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5c2d lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00002000:00010000:2.0:1763343033.898184:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x292:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:0.0:1763343033.898194:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5c2d lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.898204:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:0.0:1763343033.898207:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343033.898210:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5c2d lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343033.898217:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5c2d lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:0.0:1763343033.898228:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000232ac8ba reply state 00000000a4a56166 transno 8589939807 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae5c34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:2.0:1763343033.898238:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3658:x1848998010244352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (1058us total) trans 17179871536 rc 0/0 00010000:00010000:0.0:1763343033.898241:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae5c34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00000100:00100000:2.0:1763343033.898252:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6393 00010000:00010000:0.0:1763343033.898253:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:0.0:1763343033.898257:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343033.898260:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343033.898271:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6394 00000100:00100000:2.0:1763343033.898279:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3659:x1848998010244096:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763343033.898289:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae5c26 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ef8 expref: 238 pid: 10042 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1763343033.898291:0:10294:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:660 count 1 00010000:00010000:0.0:1763343033.898311:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5c42 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ef8 expref: 237 pid: 10042 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343033.898312:0:10294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x294:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343033.898322:0:10294:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9400/0x607405d401ae5c50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.898326:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:0.0:1763343033.898332:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343033.898336:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.898337:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d200, rc 0) 00010000:00010000:2.0:1763343033.898340:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.898346:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9400/0x607405d401ae5c50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.898356:0:10294:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9400/0x607405d401ae5c50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.898364:0:10294:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9400/0x607405d401ae5c50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.898367:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56850:x1848997993489152:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1797us (1996us total) trans 8589939807 rc 0/0 00010000:00010000:2.0:1763343033.898381:0:10294:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9400/0x607405d401ae5c50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.898388:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9133 00010000:00010000:2.0:1763343033.898407:0:10294:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343033.898575:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3659:x1848998010244096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 296us (1337us total) trans 17179871537 rc 0/0 00000100:00100000:2.0:1763343033.898582:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6394 00000100:00100000:2.0:1763343033.898595:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6395 00000100:00100000:2.0:1763343033.898601:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3659:x1848998010244224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763343033.898691:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x291:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343033.898694:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x291:0x0] updating lvb mtime from disk: 1763343033 -> 1763343033 00002000:00010000:2.0:1763343033.898696:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x291:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343033.898699:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x291:0x0] updating lvb ctime from disk: 1763343033 -> 1763343033 00002000:00010000:2.0:1763343033.898701:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x291:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343033.898728:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3659:x1848998010244224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 127us (1422us total) trans 17179871538 rc 0/0 00000100:00100000:2.0:1763343033.898734:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6395 00010000:00010000:2.0:1763343033.898758:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343033.898764:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9400/0x607405d401ae5c50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.898773:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343033.898777:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9400/0x607405d401ae5c50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.898783:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9400/0x607405d401ae5c50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.898799:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9400/0x607405d401ae5c50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.898805:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9400/0x607405d401ae5c50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.898818:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343033.898821:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343033.898822:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343033.898851:0:3658:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871532 gen 2 00000004:00080000:2.0:1763343033.898857:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7ca80, transno 17179871509 00000004:00080000:2.0:1763343033.898866:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7f800, transno 17179871510 00000004:00080000:2.0:1763343033.898869:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7c000, transno 17179871511 00000004:00080000:2.0:1763343033.898872:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7e680, transno 17179871512 00000004:00080000:2.0:1763343033.898875:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b90000, transno 17179871513 00000004:00080000:2.0:1763343033.898877:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b93b80, transno 17179871514 00000004:00080000:2.0:1763343033.898881:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b92300, transno 17179871515 00000004:00080000:2.0:1763343033.898884:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b92a00, transno 17179871516 00000004:00080000:2.0:1763343033.898886:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f39180, transno 17179871518 00000004:00080000:2.0:1763343033.898889:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c3ad80, transno 17179871519 00000004:00080000:2.0:1763343033.898891:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f39c00, transno 17179871520 00000004:00080000:2.0:1763343033.898893:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f38e00, transno 17179871521 00000004:00080000:2.0:1763343033.898905:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c3a680, transno 17179871524 00000004:00080000:2.0:1763343033.898909:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c39180, transno 17179871525 00000004:00080000:2.0:1763343033.898912:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c3bb80, transno 17179871526 00000004:00080000:2.0:1763343033.898915:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c39500, transno 17179871527 00000004:00080000:2.0:1763343033.898919:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537b0ea00, transno 17179871529 00000004:00080000:2.0:1763343033.898922:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537b0c700, transno 17179871530 00000004:00080000:2.0:1763343033.898925:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b91c00, transno 17179871531 00000004:00080000:2.0:1763343033.898928:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b90700, transno 17179871532 00000100:00100000:2.0:1763343033.898934:0:3658:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a3406b91f80 x1848998010244352/t17179871536(17179871536) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343049 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763343033.898954:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b91f80/2, rc 0, transno 17179871536 00000100:00100000:2.0:1763343033.898960:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010244352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343033.899044:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010244992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343033.899082:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343033.899103:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343033.899108:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010244608:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763343033.899127:0:32357:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 4 in progress, 3 in flight, 20 done 00000100:00100000:3.0:1763343033.899128:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.899148:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010244992 00000100:00100000:2.0:1763343033.899153:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010244992 00000100:00100000:3.0:1763343033.899155:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010244608 00000100:00100000:3.0:1763343033.899160:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010244608 00000100:00100000:2.0:1763343033.899190:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6396 00000100:00100000:3.0:1763343033.899206:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6397 00000100:00100000:3.0:1763343033.899216:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+43:3657:x1848998010244608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343033.899231:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:657 count 1 00010000:00010000:3.0:1763343033.899248:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5c57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x291:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.899261:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae5b77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ec0 expref: 28 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.899543:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343033.899545:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343033.899548:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5c57 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.899570:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae5b77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ec0 expref: 28 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.899580:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae5b77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ec0 expref: 28 pid: 28993 timeout: 1327 lvb_type: 0 00000100:00100000:3.0:1763343033.899592:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010245120:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343033.899648:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343033.899662:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010244864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343033.899685:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343033.899699:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343033.899703:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010244736:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343033.899718:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343033.899742:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010244864 00000100:00100000:3.0:1763343033.899746:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010244864 00000100:00100000:3.0:1763343033.899765:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010244736 00000100:00100000:3.0:1763343033.899768:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010244736 00000100:00100000:3.0:1763343033.899780:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6398 00000100:00100000:3.0:1763343033.899786:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3660:x1848998010244864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343033.899873:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343033.899876:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb mtime from disk: 1763343033 -> 1763343033 00002000:00010000:3.0:1763343033.899878:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb atime from disk: 1763343033 -> 1763343033 00002000:00010000:3.0:1763343033.899880:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb ctime from disk: 1763343033 -> 1763343033 00002000:00010000:3.0:1763343033.899882:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x28f:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343033.899912:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3660:x1848998010244864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (226us total) trans 21474838836 rc 0/0 00000100:00100000:3.0:1763343033.899919:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6398 00000100:00100000:3.0:1763343033.899934:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6399 00000100:00100000:3.0:1763343033.899940:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3660:x1848998010244736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343033.899964:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:658 count 1 00002000:00010000:3.0:1763343033.899982:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x292:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343033.899987:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae5c5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.899994:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343033.899996:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343033.900000:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae5c5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.900012:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae5c5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.900020:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae5c5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.900027:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae5c5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.900042:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343033.900164:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3660:x1848998010244736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 223us (444us total) trans 21474838837 rc 0/0 00000100:00100000:3.0:1763343033.900171:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6399 00000004:00080000:3.0:1763343033.900201:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a4e680/2, rc 0, transno 21474838837 00000100:00100000:3.0:1763343033.900207:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010244736:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763343033.900216:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a4df80/2, rc 0, transno 21474838836 00000100:00100000:3.0:1763343033.900220:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010244864:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343033.900409:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b90380/2, rc 0, transno 17179871538 00000100:00100000:0.0:1763343033.900415:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010244224:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343033.900424:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b91180/2, rc 0, transno 17179871537 00000100:00100000:0.0:1763343033.900427:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010244096:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763343033.902031:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343033.902047:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae5c5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.902060:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343033.902064:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae5c5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.902074:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae5c5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.902096:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae5c5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.902103:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae5c5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.902126:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.902128:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.902130:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343033.905773:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3657:x1848998010244992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763343033.905956:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343033.905960:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb mtime from disk: 1763343033 -> 1763343033 00002000:00010000:2.0:1763343033.905963:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343033.905965:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb ctime from disk: 1763343033 -> 1763343033 00002000:00010000:2.0:1763343033.905967:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x290:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343033.906059:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3657:x1848998010244992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 6859us (6974us total) trans 21474838838 rc 0/0 00000100:00100000:2.0:1763343033.906069:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6396 00000004:00080000:3.0:1763343033.907772:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a4ce00/2, rc 0, transno 21474838838 00000100:00100000:3.0:1763343033.907786:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010244992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343033.908940:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.908987:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.909025:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993489280 00000100:00100000:0.0:1763343033.909032:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993489280 00000100:00100000:0.0:1763343033.909086:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993489536 00000100:00100000:0.0:1763343033.909089:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993489536 00000100:00100000:0.0:1763343033.909111:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9134 00000100:00100000:0.0:1763343033.909120:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56846:x1848997993489280:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343033.909146:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343033.909172:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae5c65 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8eff expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343033.909212:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9135 00000100:00100000:1.0:1763343033.909224:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56850:x1848997993489536:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343033.909229:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae5c65 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eff expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.909238:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.909249:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5c6c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f06 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.909254:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ca00/0x607405d401ae5c65 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eff expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.909285:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:0.0:1763343033.909293:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343033.909298:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665ca00, rc 0) 00000100:00100000:0.0:1763343033.909355:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56846:x1848997993489280:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 236us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.909364:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9134 00010000:00010000:1.0:1763343033.909370:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c73 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.909385:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5c42 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ef8 expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.909392:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c73 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.909427:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5c42 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ef8 expref: 239 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.909439:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5c42 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ef8 expref: 239 pid: 10042 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.909454:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010245248:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343033.909521:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe240 going to sleep for 11 seconds 00000100:00100000:2.0:1763343033.910439:0:27833:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27833:1848998010244480:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343033.910463:0:27833:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9a00/0x607405d401ae5c3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.913780:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.913840:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993489664 00000100:00100000:2.0:1763343033.913850:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993489664 00000100:00100000:0.0:1763343033.913861:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:2.0:1763343033.913890:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5b70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eb9 expref: 16 pid: 27833 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343033.913931:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993489792 00000100:00100000:2.0:1763343033.913934:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993489792 00010000:00010000:2.0:1763343033.913965:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae5b77 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ec0 expref: 29 pid: 28993 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343033.914002:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3003 00000100:00100000:2.0:1763343033.914011:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993489664:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343033.914031:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343033.914036:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5b70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eb9 expref: 16 pid: 27833 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.914049:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5b70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eb9 expref: 16 pid: 27833 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.914072:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5b70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8eb9 expref: 16 pid: 27833 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.914090:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.914092:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.914096:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9a00/0x607405d401ae5c3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.914106:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9a00/0x607405d401ae5c3b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.914170:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343033.914216:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993489664:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 207us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.914224:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3003 00000100:00100000:2.0:1763343033.914285:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3004 00000100:00100000:2.0:1763343033.914293:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2430:x1848997993489792:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343033.914302:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343033.914307:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae5b77 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ec0 expref: 29 pid: 28993 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.914316:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae5b77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ec0 expref: 29 pid: 28993 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.914331:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.914333:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.914337:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5c57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.914349:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5c57 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.914361:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343033.914380:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2430:x1848997993489792:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 88us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.914387:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3004 00010000:00010000:2.0:1763343033.914415:0:27833:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9a00/0x607405d401ae5c3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.914424:0:27833:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9a00/0x607405d401ae5c3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.914434:0:27833:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9a00/0x607405d401ae5c3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.914442:0:27833:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9a00/0x607405d401ae5c3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.914468:0:27833:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343033.914491:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343033.914500:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9a00/0x607405d401ae5c3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.914508:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343033.914512:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9a00/0x607405d401ae5c3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.914523:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9a00/0x607405d401ae5c3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.914537:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9a00/0x607405d401ae5c3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.914544:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34049c9a00/0x607405d401ae5c3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.914562:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343033.914564:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343033.914565:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343033.914725:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3658:x1848998010243968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16892us (17620us total) trans 17179871539 rc 0/0 00000100:00100000:2.0:1763343033.914734:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6392 00000004:00080000:0.0:1763343033.914769:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b93800/2, rc 0, transno 17179871539 00000100:00100000:0.0:1763343033.914777:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010243968:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763343033.914837:0:27835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae5b77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ec0 expref: 28 pid: 28993 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343033.914849:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340664aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010245120:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.914877:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5c57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.914891:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5c57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.914898:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5c57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.914906:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5c57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.914912:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5c57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.914933:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343033.915090:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3657:x1848998010244608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15875us (15960us total) trans 21474838839 rc 0/0 00000100:00100000:1.0:1763343033.915098:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6397 00000004:00080000:0.0:1763343033.915179:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a4c700/2, rc 0, transno 21474838839 00000100:00100000:0.0:1763343033.915187:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010244608:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763343033.915337:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343033.915343:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5c57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.915354:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343033.915358:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5c57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.915365:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5c57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.915377:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5c57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.915383:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae5c57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.915398:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343033.915399:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343033.915400:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343033.915886:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.915974:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993490048 00000100:00100000:2.0:1763343033.915982:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993490048 00000100:00100000:2.0:1763343033.916026:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3103 00000100:00100000:2.0:1763343033.916033:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56846:x1848997993490048:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:2.0:1763343033.916255:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1d0:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:0.0:1763343033.916322:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.916391:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010245248:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343033.916411:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c73 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343033.916433:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993490176 00000100:00100000:3.0:1763343033.916437:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993490176 00010000:00010000:3.0:1763343033.916456:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5c42 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ef8 expref: 241 pid: 10042 timeout: 1327 lvb_type: 0 00000100:00100000:3.0:1763343033.916489:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3005 00000100:00100000:3.0:1763343033.916498:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:2429:x1848997993490176:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343033.916511:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343033.916522:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5c42 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ef8 expref: 241 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:3.0:1763343033.916533:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5c42 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ef8 expref: 241 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:3.0:1763343033.916551:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae5c42 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ef8 expref: 241 pid: 10042 timeout: 1327 lvb_type: 0 00010000:00010000:3.0:1763343033.916565:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:3.0:1763343033.916571:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c73 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.916580:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c73 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.916586:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c73 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343033.916640:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343033.916681:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:2429:x1848997993490176:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 184us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343033.916690:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3005 00000040:00080000:2.0:1763343033.916691:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1380, 64 off116888 00000040:00080000:2.0:1763343033.916717:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1381, 64 off116888 00000040:00080000:2.0:1763343033.916726:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1382, 64 off116952 00000040:00080000:2.0:1763343033.916734:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1381, 64 off116952 00010000:00010000:2.0:1763343033.916791:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5c7a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.916804:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5c7a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.916813:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5c7a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.916820:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5c7a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.916827:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5c7a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.916832:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5c7a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343033.916861:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343033.916900:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c73 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.916907:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c73 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343033.916928:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d3:0x0]: returning size 0 00000100:00100000:2.0:1763343033.917038:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56846:x1848997993490048:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1003us (1152us total) trans 8589939808 rc 0/0 00000100:00100000:2.0:1763343033.917047:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3103 00000004:00080000:1.0:1763343033.917072:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x293:0x0], index 0: 0 00000004:00080000:1.0:1763343033.917079:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x295:0x0], index 1: 0 00000004:00080000:1.0:1763343033.917091:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x296:0x0], index 1: 0 00000004:00080000:1.0:1763343033.917096:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x294:0x0], index 0: 0 00010000:00010000:1.0:1763343033.917171:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c73 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.917178:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c73 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.917185:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c73 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.917191:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.917195:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c73 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.917201:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c73 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.917210:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:1.0:1763343033.917213:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343033.917216:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c73 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.917222:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c73 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.917257:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5c6c lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f06 expref: 240 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.917266:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:1.0:1763343033.917269:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343033.917273:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5c6c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f06 expref: 240 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.917290:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:1.0:1763343033.917330:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56850:x1848997993489536:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8109us (8346us total) trans 8589939809 rc 301/301 00000100:00100000:1.0:1763343033.917337:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9135 00010000:00010000:3.0:1763343033.917388:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343033.917394:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5c7a lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343033.917400:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343033.917403:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5c7a lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343033.917410:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5c7a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343033.917418:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d0:0x0].0x0 (ffff9a3541141300) 00010000:00010000:3.0:1763343033.917421:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343033.917424:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5c7a lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343033.917429:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5c7a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343033.917438:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343033.917440:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343033.917442:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343033.924207:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.924263:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993490688 00000100:00100000:2.0:1763343033.924285:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993490688 00000100:00100000:2.0:1763343033.924350:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3104 00000100:00100000:2.0:1763343033.924361:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56850:x1848997993490688:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343033.924690:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56850:x1848997993490688:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 330us (492us total) trans 8589939810 rc 0/0 00000100:00100000:2.0:1763343033.924699:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3104 00000100:00100000:3.0:1763343033.924983:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.925259:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993490432 00000100:00100000:1.0:1763343033.925275:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993490432 00000100:00100000:1.0:1763343033.925317:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9136 00000100:00100000:1.0:1763343033.925325:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56846:x1848997993490432:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.925338:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.925361:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5c88 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f0d expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.925454:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c8f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925469:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c8f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925480:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c8f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925491:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5c96 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925498:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5c96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925504:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5c96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925598:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5c9d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925606:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5c9d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925612:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5c9d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343033.925658:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d3:0x0]: returning size 0 00010000:00010000:1.0:1763343033.925722:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c8f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925730:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c8f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925736:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c8f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925743:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c8f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925748:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.925753:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c8f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925759:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c8f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925770:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde700) 00010000:00010000:1.0:1763343033.925773:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.925778:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c8f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925787:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5c8f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925801:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5c96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925806:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5c96 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925812:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5c96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925816:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.925819:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5c96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925824:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5c96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925831:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:1.0:1763343033.925834:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.925836:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5c96 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925842:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5c96 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.925873:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5c88 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f0d expref: 243 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.925888:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5c9d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f0d expref: 242 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.925899:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3403bde000) 00010000:00010000:1.0:1763343033.925901:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343033.925903:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00000100:00100000:1.0:1763343033.925940:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56846:x1848997993490432:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 616us (958us total) trans 8589939811 rc 0/0 00000100:00100000:1.0:1763343033.925960:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9136 00000100:00100000:3.0:1763343033.930045:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.930199:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993490944 00000100:00100000:1.0:1763343033.930210:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993490944 00000100:00100000:1.0:1763343033.930274:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3105 00000100:00100000:1.0:1763343033.930284:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56850:x1848997993490944:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343033.932056:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56850:x1848997993490944:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1762us (2015us total) trans 8589939812 rc 0/0 00000100:00100000:1.0:1763343033.932071:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3105 00000100:00100000:3.0:1763343033.941212:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.941460:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.941685:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993491456 00000100:00100000:2.0:1763343033.941696:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993491456 00000100:00100000:2.0:1763343033.941757:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9137 00000100:00100000:2.0:1763343033.941767:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:55941:x1848997993491456:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343033.941791:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.941794:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343033.941822:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae5c9d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f0d expref: 243 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.941844:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3403bde000) 00010000:00010000:2.0:1763343033.941856:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.941872:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5cab lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f22 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.941981:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5cb2 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343033.941994:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5cb2 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d3:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343033.942003:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5cb2 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d3:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:2.0:1763343033.942014:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d3:0x0]: returning size 0 00010000:00010000:2.0:1763343033.942123:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5cab lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f22 expref: 245 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.942139:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5cb2 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d3:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f22 expref: 244 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.942147:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343033.942150:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1763343033.942153:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34049c9400, rc 0) 00000100:00100000:2.0:1763343033.942213:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:55941:x1848997993491456:12345-192.168.204.21@tcp:101:bash.0 Request processed in 447us (753us total) trans 8589939813 rc 0/0 00000100:00100000:2.0:1763343033.942222:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9137 00000100:00100000:1.0:1763343033.942328:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993491200 00000100:00100000:1.0:1763343033.942334:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993491200 00000100:00100000:2.0:1763343033.942459:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6400 00000100:00100000:2.0:1763343033.942467:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2430:x1848997993491200:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.942475:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.942488:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5cc0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f1b expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343033.942514:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x294:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343033.942527:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.942529:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.942536:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5cc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f1b expref: 29 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.942548:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5cc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f1b expref: 29 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.942558:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34049c9a00, rc 0) 00000100:00100000:0.0:1763343033.943205:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.943243:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2430:x1848997993491200:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 775us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.943251:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6400 00000100:00100000:2.0:1763343033.943278:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993491072 00000100:00100000:2.0:1763343033.943282:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993491072 00000100:00100000:2.0:1763343033.943308:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6401 00000100:00100000:2.0:1763343033.943314:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993491072:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343033.943323:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.943335:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5cc7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f14 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343033.943353:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x296:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343033.943367:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.943368:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.943373:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5cc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f14 expref: 16 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.943385:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5cc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f14 expref: 16 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343033.943394:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501481200, rc 0) 00000100:00100000:2.0:1763343033.943413:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993491072:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 100us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.943420:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6401 00000100:00100000:0.0:1763343033.946417:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.946915:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993491584 00000100:00100000:2.0:1763343033.946925:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993491584 00000100:00100000:2.0:1763343033.947006:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9138 00000100:00100000:2.0:1763343033.947016:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:55941:x1848997993491584:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343033.947041:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.947064:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5cce lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f29 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.947103:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5cd5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.947117:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.947132:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.947250:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5cce lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f29 expref: 246 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.947283:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f29 expref: 245 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.947292:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343033.947295:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343033.947299:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480e00, rc 0) 00000100:00100000:2.0:1763343033.948314:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:55941:x1848997993491584:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1293us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.948323:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9138 00000100:00100000:3.0:1763343033.950352:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.950612:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993491840 00000100:00100000:1.0:1763343033.951508:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993491840 00000100:00100000:0.0:1763343033.951634:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3106 00000100:00100000:0.0:1763343033.951644:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56846:x1848997993491840:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343033.951864:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56846:x1848997993491840:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 221us (1521us total) trans 8589939814 rc 0/0 00000100:00100000:0.0:1763343033.951873:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3106 00000100:00100000:0.0:1763343033.954270:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.955041:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993492096 00000100:00100000:2.0:1763343033.955052:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993492096 00000100:00100000:2.0:1763343033.955103:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9139 00000100:00100000:2.0:1763343033.955112:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:55941:x1848997993492096:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:2.0:1763343033.955164:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343033.955192:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5cb2 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d3:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f22 expref: 246 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.955209:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343033.955213:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343033.955411:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5cdc lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.955428:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5cdc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.955438:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5cdc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000001:00080000:2.0:1763343033.955479:0:6523:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939815 00000004:00010000:2.0:1763343033.955498:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003f5832b7 reply state 000000002ff505b0 transno 8589939816 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5cdc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.955508:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5cdc lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.955514:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343033.955517:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343033.955519:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343033.955606:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:55941:x1848997993492096:12345-192.168.204.21@tcp:36:bash.0 Request processed in 493us (1345us total) trans 8589939816 rc 0/0 00000100:00100000:2.0:1763343033.955613:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9139 00000020:00080000:2.0:1763343033.955636:0:6523:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343033.956670:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.956937:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993492352 00000100:00100000:1.0:1763343033.956954:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993492352 00000100:00100000:1.0:1763343033.957013:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9140 00000100:00100000:1.0:1763343033.957032:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56846:x1848997993492352:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343033.957056:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343033.957075:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5ce3 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f30 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.957144:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5cea lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957157:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5cea lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957167:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5cea lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957177:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5cf1 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957183:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957189:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957285:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5cf8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957295:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957302:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343033.957322:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d3:0x0]: returning size 0 00010000:00010000:1.0:1763343033.957396:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5cea lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957404:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5cea lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957409:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5cea lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957426:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5cea lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957432:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.957436:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5cea lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957443:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5cea lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957453:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde700) 00010000:00010000:1.0:1763343033.957456:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.957460:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5cea lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957466:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5cea lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957480:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957486:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5cf1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957490:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957496:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343033.957498:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957504:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5cf1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957511:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:1.0:1763343033.957513:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343033.957517:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5cf1 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957522:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5cf1 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343033.957556:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5ce3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f30 expref: 251 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.957574:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f30 expref: 250 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.957581:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:1.0:1763343033.957583:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343033.957585:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:1.0:1763343033.957666:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56846:x1848997993492352:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 644us (999us total) trans 8589939817 rc 0/0 00000100:00100000:1.0:1763343033.957673:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9140 00000100:00100000:3.0:1763343033.961459:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.961496:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.961652:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993492608 00000100:00100000:0.0:1763343033.961664:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993492608 00000100:00100000:0.0:1763343033.961728:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3107 00000100:00100000:0.0:1763343033.961740:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56846:x1848997993492608:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343033.961989:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56846:x1848997993492608:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 252us (540us total) trans 8589939818 rc 0/0 00000100:00100000:0.0:1763343033.961997:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3107 00000100:00100000:2.0:1763343033.962700:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993492864 00000100:00100000:2.0:1763343033.962708:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993492864 00000100:00100000:2.0:1763343033.962749:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9141 00000100:00100000:2.0:1763343033.962757:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:55941:x1848997993492864:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343033.962774:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.962797:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d06 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f37 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.962848:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae5d0d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.962867:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5cf8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f30 expref: 252 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.962877:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae5d0d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.962911:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f30 expref: 252 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.962923:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f30 expref: 252 pid: 10041 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343033.962936:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010245376:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343033.963020:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340660ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1763343033.967898:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.967963:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993492992 00000100:00100000:0.0:1763343033.967974:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993492992 00000100:00100000:0.0:1763343033.968030:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3108 00000100:00100000:0.0:1763343033.968040:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fb9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56846:x1848997993492992:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:0.0:1763343033.968204:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fb9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56846:x1848997993492992:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 165us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.968211:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3108 00000100:00100000:2.0:1763343033.971235:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010245376:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343033.971267:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae5d0d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:1.0:1763343033.971766:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343033.971814:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993493120 00000100:00100000:2.0:1763343033.971822:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993493120 00010000:00010000:2.0:1763343033.971857:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f30 expref: 253 pid: 10041 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343033.971893:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3006 00000100:00100000:2.0:1763343033.971902:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:2429:x1848997993493120:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343033.971917:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343033.971923:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f30 expref: 253 pid: 10041 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.971935:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f30 expref: 253 pid: 10041 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.971966:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5cf8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f30 expref: 253 pid: 10041 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343033.971982:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343033.971987:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae5d0d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.971997:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae5d0d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.972004:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae5d0d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.972039:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343033.972090:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:2429:x1848997993493120:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 187us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.972097:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3006 00010000:00010000:1.0:1763343033.972160:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae5d0d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343033.972167:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae5d0d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:1.0:1763343033.972431:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1382, 88 off117040 00000004:00080000:1.0:1763343033.972439:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1227639818188ns, next at 1228493192443ns, rc = 0 00000040:00080000:1.0:1763343033.972477:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1383, 88 off117040 00000004:00080000:1.0:1763343033.972482:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1227639860873ns, next at 1228493164729ns, rc = 0 00000040:00080000:1.0:1763343033.972495:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1384, 88 off117128 00000004:00080000:1.0:1763343033.972499:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1227639878348ns, next at 1228493164729ns, rc = 0 00000040:00080000:1.0:1763343033.972509:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1383, 88 off117128 00000004:00080000:1.0:1763343033.972512:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1227639891450ns, next at 1228493192443ns, rc = 0 00000001:00080000:1.0:1763343033.975271:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939819 is committed 00000004:00080000:1.0:1763343033.975287:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 912 committed 00000004:00080000:1.0:1763343033.975305:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 911 committed 00000100:00100000:0.0:1763343033.975511:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010245504:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.975572:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763343033.975660:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 910 committed 00000004:00080000:1.0:1763343033.975662:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 911 committed 00010000:00010000:1.0:1763343033.975745:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae5d0d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f37 expref: 240 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.975758:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:1.0:1763343033.975761:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343033.975776:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d06 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f37 expref: 240 pid: 6523 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343033.975795:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae5d0d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f37 expref: 239 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.975822:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:1.0:1763343033.975825:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343033.975827:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d4800, rc 0) 00000100:00100000:1.0:1763343033.975876:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:55941:x1848997993492864:12345-192.168.204.21@tcp:101:bash.0 Request processed in 13119us (14379us total) trans 8589939819 rc 0/0 00000100:00100000:1.0:1763343033.975884:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9141 00010000:00010000:2.0:1763343033.976205:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae5c34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.976214:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae5c34 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.976221:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae5c34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.976227:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.976231:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae5c34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.976239:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae5c34 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.976250:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:2.0:1763343033.976253:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.976256:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae5c34 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.976262:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae5c34 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343033.976280:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5cdc lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.976285:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5cdc lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.976291:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5cdc lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.976295:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343033.976297:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5cdc lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.976303:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5cdc lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.976386:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343033.976388:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343033.976391:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5cdc lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343033.976401:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5cdc lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343033.976478:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010246016:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343033.976510:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343033.976530:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343033.976535:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010245888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.976551:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343033.976572:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010245632:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.976589:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343033.976603:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343033.976607:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010245760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343033.976640:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343033.976664:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010245504 00000100:00100000:0.0:1763343033.976671:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010245504 00000100:00100000:0.0:1763343033.976705:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010246016 00000100:00100000:0.0:1763343033.976707:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010246016 00000100:00100000:0.0:1763343033.976720:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010245888 00000100:00100000:0.0:1763343033.976722:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010245888 00000100:00100000:0.0:1763343033.976732:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010245632 00000100:00100000:0.0:1763343033.976734:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010245632 00000100:00100000:0.0:1763343033.976745:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010245760 00000100:00100000:0.0:1763343033.976747:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010245760 00000100:00100000:0.0:1763343033.976760:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6402 00000100:00100000:0.0:1763343033.976767:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3658:x1848998010245504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343033.976790:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:655 count 1 00010000:00010000:0.0:1763343033.976812:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae5d14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.976829:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a34049c8200/0x607405d401ae5b00 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e8f expref: 28 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343033.976837:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.976840:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.976843:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae5d14 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.976865:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a34049c8200/0x607405d401ae5b00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e8f expref: 28 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343033.976876:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a34049c8200/0x607405d401ae5b00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e8f expref: 28 pid: 28648 timeout: 1327 lvb_type: 1 00000100:00100000:0.0:1763343033.976888:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010246144:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343033.976927:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340468f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343033.976942:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6403 00000100:00100000:0.0:1763343033.976960:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3658:x1848998010246016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343033.976975:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:657 count 1 00010000:00010000:0.0:1763343033.976989:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5d1b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.977000:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae59e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e2d expref: 15 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.977006:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343033.977007:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343033.977010:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5d1b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.977032:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae59e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e2d expref: 15 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.977041:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae59e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e2d expref: 15 pid: 27833 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343033.977051:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010246272:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343033.977071:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3512746840 going to sleep for 11 seconds 00000100:00100000:0.0:1763343033.977085:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6404 00000100:00100000:0.0:1763343033.977091:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3658:x1848998010245888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343033.977214:0:28995:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x294:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343033.977218:0:28995:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x294:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.977220:0:28995:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x294:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.977223:0:28995:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x294:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343033.977225:0:28995:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x294:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343033.977257:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3658:x1848998010245888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 165us (704us total) trans 21474838840 rc 0/0 00000100:00100000:0.0:1763343033.977263:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6404 00000100:00100000:0.0:1763343033.977277:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6405 00000100:00100000:0.0:1763343033.977282:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3659:x1848998010245632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343033.977292:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:656 count 1 00010000:00010000:0.0:1763343033.977302:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5d22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343033.977470:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6406 00000100:00100000:3.0:1763343033.977479:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3659:x1848998010245760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343033.977565:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3659:x1848998010245760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (924us total) trans 21474838841 rc 0/0 00000100:00100000:3.0:1763343033.977572:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6406 00000004:00080000:1.0:1763343033.977660:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3538754700/2, rc 0, transno 21474838841 00000100:00100000:1.0:1763343033.977667:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010245760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343033.977805:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010246528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.977830:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.977847:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343033.977852:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010246400:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.977867:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.977884:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010246528 00000100:00100000:2.0:1763343033.977888:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010246528 00000100:00100000:2.0:1763343033.977908:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010246400 00000100:00100000:2.0:1763343033.977910:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010246400 00000100:00100000:2.0:1763343033.977922:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6407 00000100:00100000:2.0:1763343033.977927:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3660:x1848998010246528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343033.978021:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3660:x1848998010246528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (189us total) trans 17179871540 rc 0/0 00000100:00100000:2.0:1763343033.978027:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6407 00000100:00100000:2.0:1763343033.978037:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6408 00000100:00100000:2.0:1763343033.978042:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3660:x1848998010246400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343033.978051:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:658 count 1 00010000:00010000:2.0:1763343033.978061:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a35029d5a00/0x607405d401ae5d29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.978073:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae5bbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ece expref: 15 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.978080:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343033.978082:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343033.978085:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a35029d5a00/0x607405d401ae5d29 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.978101:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae5bbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ece expref: 15 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.978110:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae5bbd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ece expref: 15 pid: 27833 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343033.978120:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010246784:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343033.978148:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340660ca80 going to sleep for 11 seconds 00000004:00080000:2.0:1763343033.978169:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a4a80/2, rc 0, transno 17179871540 00000100:00100000:2.0:1763343033.978173:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010246528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343033.978252:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010246656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343033.978278:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343033.978400:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010246656 00000100:00100000:2.0:1763343033.981014:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010246656 00010000:00010000:0.0:1763343033.981293:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae5bc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ed5 expref: 28 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.981304:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343033.981306:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343033.981311:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5d22 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.981353:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae5bc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ed5 expref: 28 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.981366:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae5bc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ed5 expref: 28 pid: 28993 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343033.981383:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010246912:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343033.981460:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34050d5000 going to sleep for 11 seconds 00000004:00080000:0.0:1763343033.981506:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3538755500/2, rc 0, transno 21474838840 00000100:00100000:0.0:1763343033.981513:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010245888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343033.981577:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6409 00000100:00100000:2.0:1763343033.981587:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3657:x1848998010246656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763343033.981779:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x296:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343033.981783:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x296:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343033.981785:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x296:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343033.981787:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x296:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343033.981789:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x296:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343033.981846:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3657:x1848998010246656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 261us (3566us total) trans 17179871541 rc 0/0 00000100:00100000:2.0:1763343033.981854:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6409 00000004:00080000:0.0:1763343033.982456:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a4380/2, rc 0, transno 17179871541 00000100:00100000:0.0:1763343033.982463:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010246656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343033.990245:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343033.990910:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010246144:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343033.990964:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae5d14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343033.991387:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993493248 00000100:00100000:2.0:1763343033.991396:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993493248 00000100:00100000:2.0:1763343033.991456:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6410 00000100:00100000:2.0:1763343033.991466:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:55941:x1848997993493248:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343033.991484:0:8410:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343033.991506:0:8410:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a35029d5600/0x607405d401ae5d30 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f3e expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343033.991529:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x293:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343033.991549:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.991551:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343033.991562:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a35029d5600/0x607405d401ae5d30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f3e expref: 30 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.991576:0:8410:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a35029d5600/0x607405d401ae5d30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f3e expref: 30 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.991589:0:8410:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d5600, rc 0) 00000100:00100000:2.0:1763343033.991669:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:55941:x1848997993493248:12345-192.168.204.21@tcp:101:bash.0 Request processed in 203us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343033.991675:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6410 00000100:00100000:3.0:1763343033.992288:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010246272:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343033.992852:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.992874:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.992891:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.992934:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010246912:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343033.992959:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5d22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343033.993003:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343033.993022:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993493376 00000100:00100000:0.0:1763343033.993027:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993493376 00010000:00010000:0.0:1763343033.993053:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a34049c8200/0x607405d401ae5b00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e8f expref: 30 pid: 28648 timeout: 1327 lvb_type: 1 00000100:00100000:0.0:1763343033.993076:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993493632 00000100:00100000:0.0:1763343033.993079:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993493632 00010000:00010000:0.0:1763343033.993092:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae5bbd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ece expref: 16 pid: 27833 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343033.993103:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993493504 00000100:00100000:0.0:1763343033.993105:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993493504 00010000:00010000:0.0:1763343033.993115:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae59e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e2d expref: 17 pid: 27833 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343033.993126:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993493760 00000100:00100000:0.0:1763343033.993128:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993493760 00010000:00010000:0.0:1763343033.993138:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae5bc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ed5 expref: 31 pid: 28993 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343033.993150:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3007 00000100:00100000:0.0:1763343033.993156:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993493376:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343033.993167:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343033.993172:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a34049c8200/0x607405d401ae5b00 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e8f expref: 31 pid: 28648 timeout: 1327 lvb_type: 1 00010000:00010000:0.0:1763343033.993188:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a34049c8200/0x607405d401ae5b00 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e8f expref: 31 pid: 28648 timeout: 1327 lvb_type: 1 00010000:00010000:0.0:1763343033.993208:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34049c8200/0x607405d401ae5b00 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x28f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e8f expref: 31 pid: 28648 timeout: 1327 lvb_type: 1 00010000:00010000:0.0:1763343033.993220:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.993222:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.993226:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae5d14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993234:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae5d14 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993263:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343033.993296:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2430:x1848997993493376:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 139us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.993303:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3007 00000100:00100000:0.0:1763343033.993319:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3008 00000100:00100000:0.0:1763343033.993326:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993493632:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343033.993334:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343033.993339:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae5bbd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ece expref: 17 pid: 27833 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343033.993348:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae5bbd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ece expref: 17 pid: 27833 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343033.993363:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.993365:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.993369:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a35029d5a00/0x607405d401ae5d29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993376:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a35029d5a00/0x607405d401ae5d29 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993388:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343033.993405:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993493632:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 80us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.993412:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3008 00000100:00100000:0.0:1763343033.993425:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3009 00000100:00100000:0.0:1763343033.993432:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993493504:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343033.993442:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343033.993447:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae59e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e2d expref: 16 pid: 27833 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343033.993456:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae59e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e2d expref: 16 pid: 27833 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343033.993468:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae59e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8e2d expref: 16 pid: 27833 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343033.993478:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.993479:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.993483:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5d1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993490:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5d1b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993500:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343033.993516:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993493504:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 85us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.993522:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3009 00000100:00100000:0.0:1763343033.993534:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3010 00000100:00100000:0.0:1763343033.993540:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2431:x1848997993493760:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343033.993547:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343033.993551:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae5bc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ed5 expref: 29 pid: 28993 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343033.993560:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae5bc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ed5 expref: 29 pid: 28993 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343033.993572:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177000/0x607405d401ae5bc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ed5 expref: 29 pid: 28993 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343033.993581:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.993583:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343033.993586:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5d22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993593:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5d22 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993610:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343033.993664:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2431:x1848997993493760:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 122us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343033.993670:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3010 00010000:00010000:0.0:1763343033.993724:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5d22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993731:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5d22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993740:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5d22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993748:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5d22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993767:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343033.993780:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343033.993785:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5d22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993793:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343033.993797:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5d22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993805:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5d22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993816:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5d22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993823:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5d22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343033.993839:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343033.993840:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343033.993842:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343033.994079:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3659:x1848998010245632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16795us (17486us total) trans 21474838842 rc 0/0 00000100:00100000:0.0:1763343033.994087:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6405 00010000:00010000:2.0:1763343033.994779:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae5bbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ece expref: 14 pid: 27833 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343033.994793:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010246784:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343033.994810:0:15756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a35029d5a00/0x607405d401ae5d29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.994824:0:15756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a35029d5a00/0x607405d401ae5d29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.994830:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a35029d5a00/0x607405d401ae5d29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.994839:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a35029d5a00/0x607405d401ae5d29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.994845:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a35029d5a00/0x607405d401ae5d29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.994862:0:15756:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343033.995113:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3660:x1848998010246400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17069us (17242us total) trans 17179871542 rc 0/0 00000100:00100000:2.0:1763343033.995120:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6408 00010000:00010000:2.0:1763343033.995143:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343033.995148:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a35029d5a00/0x607405d401ae5d29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.995156:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d5a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343033.995159:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a35029d5a00/0x607405d401ae5d29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.995166:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a35029d5a00/0x607405d401ae5d29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.995183:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a35029d5a00/0x607405d401ae5d29 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.995190:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a35029d5a00/0x607405d401ae5d29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.995203:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343033.995205:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343033.995206:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.995212:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae5d14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.995220:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae5d14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.995227:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae5d14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763343033.995229:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a5880/2, rc 0, transno 17179871542 00000100:00100000:2.0:1763343033.995234:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010246400:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763343033.995235:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae5d14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.995250:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343033.995252:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343033.995256:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae5d14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343033.995411:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3658:x1848998010245504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18643us (19837us total) trans 21474838843 rc 0/0 00000100:00100000:1.0:1763343033.995417:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6402 00010000:00010000:3.0:1763343033.995888:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5d1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.995899:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5d1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.995906:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5d1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.995914:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5d1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.995922:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5d1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.995952:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343033.996017:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343033.996022:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5d1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.996030:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343033.996034:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5d1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.996042:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5d1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.996053:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5d1b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.996059:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5d1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343033.996073:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343033.996075:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343033.996077:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3658:x1848998010246016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19117us (19566us total) trans 17179871543 rc 0/0 00010000:00010000:1.0:1763343033.996077:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343033.996084:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6403 00000004:00080000:3.0:1763343033.996121:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537b0c700/2, rc 0, transno 21474838842 00000100:00100000:3.0:1763343033.996127:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010245632:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763343033.996411:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665cc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343033.996417:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae5d14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.996425:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae5d14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.996436:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae5d14 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.996443:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae5d14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343033.996456:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343033.996457:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343033.996459:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343033.997448:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343033.997534:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993493888 00000100:00100000:3.0:1763343033.997543:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993493888 00000100:00100000:3.0:1763343033.997595:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6411 00000100:00100000:3.0:1763343033.997604:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:55941:x1848997993493888:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343033.997648:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343033.997668:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5d37 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f45 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343033.997690:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x295:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343033.997710:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343033.997712:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343033.997721:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5d37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f45 expref: 15 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.997735:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5d37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f45 expref: 15 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343033.997746:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343033.997801:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:55941:x1848997993493888:12345-192.168.204.21@tcp:101:bash.0 Request processed in 198us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343033.997807:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6411 00000004:00080000:0.0:1763343033.998469:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a5180/2, rc 0, transno 17179871543 00000100:00100000:0.0:1763343033.998478:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010246016:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1763343033.998494:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537b0d500/2, rc 0, transno 21474838843 00000100:00100000:0.0:1763343033.998498:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010245504:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343034.001920:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.001964:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.002411:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993494016 00000100:00100000:3.0:1763343034.002421:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993494016 00002000:00010000:3.0:1763343034.002458:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/659 (0->18446744073709551615) 00002000:00100000:3.0:1763343034.002463:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406b93100 with x1848997993494016 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343034.002475:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406b93100. 00000100:00100000:3.0:1763343034.002505:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993494144 00000100:00100000:3.0:1763343034.002509:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993494144 00002000:00010000:3.0:1763343034.002523:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/661 (0->18446744073709551615) 00002000:00100000:3.0:1763343034.002526:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406b92a00 with x1848997993494144 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343034.002532:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3406b92a00. 00000100:00100000:3.0:1763343034.002559:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1570 00000100:00100000:3.0:1763343034.002568:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2429:x1848997993494016:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343034.002757:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x293:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343034.002761:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x293:0x0] updating lvb mtime from disk: 0 -> 1763343033 00002000:00010000:3.0:1763343034.002763:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x293:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343034.002766:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x293:0x0] updating lvb ctime from disk: 0 -> 1763343033 00002000:00010000:3.0:1763343034.002768:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x293:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343034.002822:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2429:x1848997993494016:12345-192.168.204.21@tcp:10:bash.0 Request processed in 255us (911us total) trans 21474838844 rc 0/0 00000100:00100000:3.0:1763343034.002830:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1570 00002000:00010000:3.0:1763343034.002834:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/659 (0->18446744073709551615) 00002000:00100000:3.0:1763343034.002836:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406b93100 with x1848997993494016 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343034.002840:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406b93100. 00000100:00100000:3.0:1763343034.002857:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1571 00000100:00100000:3.0:1763343034.002863:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993494144:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343034.002956:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x295:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343034.002958:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x295:0x0] updating lvb mtime from disk: 0 -> 1763343033 00002000:00010000:3.0:1763343034.002961:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x295:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343034.002962:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x295:0x0] updating lvb ctime from disk: 0 -> 1763343033 00002000:00010000:3.0:1763343034.002964:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x295:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343034.002984:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993494144:12345-192.168.204.21@tcp:10:bash.0 Request processed in 121us (1020us total) trans 17179871544 rc 0/0 00000100:00100000:3.0:1763343034.002994:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1571 00002000:00010000:3.0:1763343034.002997:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/661 (0->18446744073709551615) 00002000:00100000:3.0:1763343034.002999:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406b92a00 with x1848997993494144 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343034.003003:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3406b92a00. 00000100:00100000:1.0:1763343034.007362:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.007505:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993494400 00000100:00100000:2.0:1763343034.007514:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993494400 00000100:00100000:2.0:1763343034.007576:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9142 00000100:00100000:2.0:1763343034.007585:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56851:x1848997993494400:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.007610:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.007670:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae5d3e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f4c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.007766:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae5d45 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.007780:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae5d45 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.007792:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae5d45 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.007803:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d4c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.007810:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.007816:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.007922:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5d53 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.007932:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5d53 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.007939:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5d53 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343034.007960:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d3:0x0]: returning size 2 00010000:00010000:2.0:1763343034.008044:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae5d45 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.008053:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae5d45 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.008059:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae5d45 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.008065:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae5d45 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.008072:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.008076:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae5d45 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.008083:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae5d45 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.008094:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7000) 00010000:00010000:2.0:1763343034.008097:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.008101:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae5d45 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.008107:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae5d45 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.008123:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.008128:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d4c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.008133:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.008137:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.008139:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.008144:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d4c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.008150:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3538bf7200) 00010000:00010000:2.0:1763343034.008153:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.008155:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d4c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.008160:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d4c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.008196:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae5d3e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f4c expref: 240 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.008211:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5d53 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f4c expref: 239 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.008218:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343034.008221:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343034.008224:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34049c8600, rc 0) 00000100:00100000:2.0:1763343034.010274:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56851:x1848997993494400:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2679us (2911us total) trans 8589939820 rc 0/0 00000100:00100000:2.0:1763343034.010288:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9142 00000100:00100000:3.0:1763343034.010418:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.011565:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993494656 00000100:00100000:2.0:1763343034.011575:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993494656 00000100:00100000:2.0:1763343034.011647:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3109 00000100:00100000:2.0:1763343034.011655:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:55941:x1848997993494656:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:2.0:1763343034.011913:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993494656:12345-192.168.204.21@tcp:35:bash.0 Request processed in 257us (1494us total) trans 8589939821 rc 0/0 00000100:00100000:2.0:1763343034.011920:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3109 00000100:00100000:3.0:1763343034.014938:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.015133:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993494912 00000100:00100000:0.0:1763343034.015144:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993494912 00000100:00100000:0.0:1763343034.015414:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3110 00000100:00100000:0.0:1763343034.015425:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56851:x1848997993494912:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343034.016304:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56851:x1848997993494912:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 877us (1372us total) trans 8589939822 rc 0/0 00000100:00100000:0.0:1763343034.016315:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3110 00000100:00100000:3.0:1763343034.026391:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.026450:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.026586:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993495040 00000100:00100000:2.0:1763343034.026600:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993495040 00000100:00100000:2.0:1763343034.026703:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993495296 00000100:00100000:2.0:1763343034.026707:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993495296 00000100:00100000:2.0:1763343034.026731:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9143 00000100:00100000:2.0:1763343034.026743:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56851:x1848997993495040:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.026771:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.026798:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae5d61 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f53 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.026871:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d68 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.026887:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d68 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.026899:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d68 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343034.026954:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d3:0x0]: returning size 5 00000004:00200000:2.0:1763343034.026960:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343034.026981:0:6523:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d68 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.026994:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d68 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.027022:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae5d61 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f53 expref: 244 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.027051:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d68 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f53 expref: 243 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.027061:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343034.027065:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343034.027070:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34049c9200, rc 0) 00000100:00100000:2.0:1763343034.027149:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56851:x1848997993495040:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 409us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.027157:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9143 00000100:00100000:2.0:1763343034.027183:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9144 00000100:00100000:2.0:1763343034.027190:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56852:x1848997993495296:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:2.0:1763343034.027227:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343034.027242:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae5d0d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f37 expref: 242 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.027257:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5d53 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f4c expref: 241 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.027274:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5cd5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f29 expref: 240 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.027284:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343034.027287:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343034.027303:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5d6f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.027311:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5d6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.027318:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5d6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.027331:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae5d76 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.027337:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae5d76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.027343:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae5d76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.027417:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d7d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.027428:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d68 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f53 expref: 239 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.027437:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d7d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.027474:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d68 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f53 expref: 239 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.027489:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d68 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f53 expref: 239 pid: 6523 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343034.027503:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010247040:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343034.027765:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340660c840 going to sleep for 11 seconds 00000100:00100000:3.0:1763343034.032920:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.033190:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010247040:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343034.033221:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d7d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343034.033360:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993495424 00000100:00100000:0.0:1763343034.033368:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993495424 00010000:00010000:0.0:1763343034.033408:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d68 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f53 expref: 240 pid: 6523 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343034.033447:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3011 00000100:00100000:0.0:1763343034.033457:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:2430:x1848997993495424:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343034.033472:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343034.033479:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d68 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f53 expref: 240 pid: 6523 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.033490:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d68 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f53 expref: 240 pid: 6523 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.033512:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d68 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f53 expref: 240 pid: 6523 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.033527:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:0.0:1763343034.033532:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d7d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.033542:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d7d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.033549:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d7d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.033582:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343034.033662:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:2430:x1848997993495424:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 206us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.033670:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3011 00010000:00010000:2.0:1763343034.034803:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d7d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.034816:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d7d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:2.0:1763343034.035135:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1384, 64 off117192 00000040:00080000:2.0:1763343034.035163:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1385, 64 off117192 00000040:00080000:2.0:1763343034.035176:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1386, 64 off117256 00000040:00080000:2.0:1763343034.035187:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1385, 64 off117256 00010000:00010000:2.0:1763343034.035245:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5d84 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035259:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5d84 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035285:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5d84 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035296:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5d84 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035302:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5d84 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035308:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5d84 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035330:0:6523:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343034.035352:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d7d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035359:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d7d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035366:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d7d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035372:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.035377:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d7d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035385:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d7d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035396:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343034.035399:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343034.035403:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d7d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035409:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae5d7d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035537:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5d6f lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035545:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5d6f lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035551:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5d6f lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035557:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5d6f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035562:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.035565:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5d6f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035572:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5d6f lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035580:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7200) 00010000:00010000:2.0:1763343034.035583:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.035586:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5d6f lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035592:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5d6f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:2.0:1763343034.035607:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000076a060bc reply state 00000000ad094d40 transno 8589939823 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae5d76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035666:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae5d76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.035675:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935100) 00010000:00010000:2.0:1763343034.035678:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343034.035681:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343034.035769:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56852:x1848997993495296:12345-192.168.204.21@tcp:36:rm.0 Request processed in 8576us (9314us total) trans 8589939823 rc 0/0 00000100:00100000:2.0:1763343034.035777:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9144 00010000:00010000:0.0:1763343034.036799:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343034.036809:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5d84 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.036817:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343034.036820:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5d84 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.036828:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5d84 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.036841:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d3:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:0.0:1763343034.036844:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343034.036848:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5d84 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.036853:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5d84 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.036874:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343034.036876:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343034.036878:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343034.040955:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.042877:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993495680 00000100:00100000:2.0:1763343034.042890:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993495680 00000100:00100000:2.0:1763343034.042963:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9145 00000100:00100000:2.0:1763343034.042971:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56851:x1848997993495680:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.042996:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.043021:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5d8b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f5a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.043105:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5d92 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043120:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5d92 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043131:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5d92 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043142:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d99 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043149:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043155:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043195:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5d92 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043202:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5d92 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043208:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5d92 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043214:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5d92 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043219:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.043223:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5d92 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043229:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5d92 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043238:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343034.043241:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.043245:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5d92 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043250:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5d92 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043274:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043279:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d99 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043284:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043288:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.043291:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043296:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d99 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043302:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935100) 00010000:00010000:2.0:1763343034.043304:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.043306:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d99 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043312:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae5d99 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.043341:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5d8b lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f5a expref: 241 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.043350:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343034.043353:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343034.043356:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5d8b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f5a expref: 241 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.043369:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480600, rc 0) 00000100:00100000:2.0:1763343034.043430:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56851:x1848997993495680:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 459us (2493us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343034.043437:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9145 00000100:00100000:3.0:1763343034.062835:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.062975:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993495808 00000100:00100000:0.0:1763343034.062986:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993495808 00000100:00100000:0.0:1763343034.063057:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9146 00000100:00100000:0.0:1763343034.063069:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56853:x1848997993495808:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343034.063091:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.063118:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5da0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f61 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.063188:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae5da7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063203:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae5da7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063216:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae5da7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063227:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5dae lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063234:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5dae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063240:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5dae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063368:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae5da7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063376:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae5da7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063383:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae5da7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063388:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343034.063392:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae5da7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063399:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae5da7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063413:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:0.0:1763343034.063417:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343034.063422:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae5da7 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063427:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae5da7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063440:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5dae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063446:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5dae lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063457:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5dae lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063461:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343034.063464:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5dae lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063469:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5dae lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063476:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935100) 00010000:00010000:0.0:1763343034.063479:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343034.063482:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5dae lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063487:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae5dae lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.063513:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5da0 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f61 expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.063523:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:0.0:1763343034.063525:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343034.063529:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae5da0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f61 expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.063547:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d000, rc 0) 00000100:00100000:0.0:1763343034.063605:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56853:x1848997993495808:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 539us (782us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343034.063612:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9146 00000100:00100000:3.0:1763343034.069174:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.069767:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993496064 00000100:00100000:1.0:1763343034.069778:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993496064 00000100:00100000:1.0:1763343034.069836:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9147 00000100:00100000:1.0:1763343034.069846:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56854:x1848997993496064:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343034.069867:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.069892:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5db5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f68 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.069985:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dbc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070005:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dbc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070019:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dbc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070030:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dc3 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070037:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070044:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070092:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dbc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070099:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dbc lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070106:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dbc lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070111:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.070115:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dbc lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070123:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dbc lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070134:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:1.0:1763343034.070137:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.070141:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dbc lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070147:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dbc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070161:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070167:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dc3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070173:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070178:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.070181:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070186:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dc3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070194:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935100) 00010000:00010000:1.0:1763343034.070196:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.070199:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dc3 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070205:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dc3 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.070235:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5db5 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f68 expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.070246:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:1.0:1763343034.070249:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343034.070253:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5db5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f68 expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.071276:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:1.0:1763343034.071377:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56854:x1848997993496064:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1528us (2209us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343034.071386:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9147 00000100:00100000:3.0:1763343034.076790:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.076882:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993496192 00000100:00100000:1.0:1763343034.076894:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993496192 00000100:00100000:1.0:1763343034.076960:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9148 00000100:00100000:1.0:1763343034.076969:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56853:x1848997993496192:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343034.076990:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.077016:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5dca lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f6f expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.077084:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dd1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077098:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077109:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077119:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dd8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077126:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077133:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077170:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077176:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dd1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077183:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077189:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.077193:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077201:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dd1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077212:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:1.0:1763343034.077215:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.077219:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dd1 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077226:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae5dd1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077238:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077244:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dd8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077249:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077254:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.077258:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077279:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dd8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077286:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935100) 00010000:00010000:1.0:1763343034.077289:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.077292:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dd8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077298:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5dd8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.077324:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5dca lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f6f expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.077335:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:1.0:1763343034.077337:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.077341:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5dca lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f6f expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.077354:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:1.0:1763343034.077413:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56853:x1848997993496192:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 445us (633us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343034.077420:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9148 00000100:00100000:3.0:1763343034.081100:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.081149:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.081232:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993496320 00000100:00100000:2.0:1763343034.081243:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993496320 00000100:00100000:1.0:1763343034.081364:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993496448 00000100:00100000:1.0:1763343034.081370:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993496448 00000100:00100000:1.0:1763343034.081753:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9149 00000100:00100000:1.0:1763343034.081763:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56853:x1848997993496448:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343034.081785:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.081806:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5ddf lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f7d expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.081876:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5de6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.081889:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5de6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.081899:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5de6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343034.081951:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343034.081956:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343034.081990:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5ddf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f7d expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.082010:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5de6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f7d expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.082019:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdcc00) 00010000:00010000:1.0:1763343034.082022:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343034.082025:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177600, rc 0) 00000100:00100000:1.0:1763343034.082075:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56853:x1848997993496448:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 314us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343034.082082:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9149 00000100:00100000:1.0:1763343034.082101:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9150 00000100:00100000:1.0:1763343034.082108:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56854:x1848997993496320:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343034.082119:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.082126:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5ded lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f76 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.082157:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5df4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082165:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5df4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082171:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5df4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082181:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5dfb lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082187:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5dfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082193:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5dfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082228:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5df4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082234:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5df4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082240:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5df4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082245:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.082250:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5df4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082259:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5df4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082286:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdcc00) 00010000:00010000:1.0:1763343034.082288:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.082292:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5df4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082297:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5df4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082305:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5dfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082311:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5dfb lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082317:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5dfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082321:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.082324:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5dfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082330:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5dfb lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082336:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935100) 00010000:00010000:1.0:1763343034.082339:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.082341:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5dfb lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082346:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5dfb lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.082366:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5ded lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f76 expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.082377:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdcc00) 00010000:00010000:1.0:1763343034.082379:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.082382:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5ded lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f76 expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.082391:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343034.082414:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56854:x1848997993496320:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 306us (1324us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343034.082420:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9150 00000100:00100000:3.0:1763343034.093841:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.093915:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993496704 00000100:00100000:1.0:1763343034.093926:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993496704 00000100:00100000:1.0:1763343034.093996:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9151 00000100:00100000:1.0:1763343034.094005:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56853:x1848997993496704:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343034.094025:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.094028:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343034.094053:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5de6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f7d expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.094070:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdcc00) 00010000:00010000:1.0:1763343034.094080:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343034.094093:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5e02 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f84 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.094180:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5e09 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094193:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5e09 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094202:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5e09 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094212:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5e10 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094219:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5e10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094225:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5e10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094563:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5e17 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094571:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5e17 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094578:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5e17 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343034.094587:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d4:0x0]: returning size 0 00010000:00010000:1.0:1763343034.094605:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5e09 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094612:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5e09 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094662:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5e09 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094669:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.094674:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5e09 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094681:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5e09 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094690:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:1.0:1763343034.094693:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.094696:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5e09 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094702:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae5e09 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:1.0:1763343034.094711:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006b1afc4a reply state 00000000529023da transno 8589939824 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5e10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094720:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5e10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.094727:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935100) 00010000:00010000:1.0:1763343034.094730:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343034.094732:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343034.094753:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae5e02 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f84 expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.094766:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5e17 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f84 expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.094774:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3403bdc800) 00010000:00010000:1.0:1763343034.094776:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343034.094778:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343034.094837:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56853:x1848997993496704:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 834us (1005us total) trans 8589939824 rc 0/0 00000100:00100000:1.0:1763343034.094845:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9151 00000100:00100000:3.0:1763343034.107128:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.107176:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.108839:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993496960 00000100:00100000:1.0:1763343034.108853:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993496960 00000100:00100000:2.0:1763343034.108970:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993497216 00000100:00100000:2.0:1763343034.108975:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993497216 00000100:00100000:2.0:1763343034.109006:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9152 00000100:00100000:2.0:1763343034.109016:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56855:x1848997993496960:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.109039:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.109058:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5e25 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f8b expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.109149:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5e2c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.109162:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5e2c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.109172:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5e2c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343034.109181:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d4:0x0]: returning size 0 00010000:00010000:2.0:1763343034.109287:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae5e25 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f8b expref: 247 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.109304:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5e2c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f8b expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.109313:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3403bdc800) 00010000:00010000:2.0:1763343034.109316:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343034.109320:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34049c8600, rc 0) 00000100:00100000:2.0:1763343034.109375:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56855:x1848997993496960:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 360us (2256us total) trans 8589939825 rc 0/0 00000100:00100000:2.0:1763343034.109382:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9152 00000100:00100000:2.0:1763343034.109402:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9153 00000100:00100000:2.0:1763343034.109410:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56853:x1848997993497216:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.109420:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.109428:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae5e3a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f92 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.109490:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.109500:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5e17 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f84 expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.109508:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5e2c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f8b expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.109515:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.109542:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5e2c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f8b expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.109554:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5e2c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f8b expref: 246 pid: 28422 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343034.109566:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010247168:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343034.109616:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5e17 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f84 expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.109661:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5e17 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f84 expref: 246 pid: 28422 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343034.109677:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010247296:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343034.109701:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340660ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343034.117020:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010247168:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343034.117040:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010247296:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343034.117069:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:0.0:1763343034.117590:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.117669:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.117962:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993497600 00000100:00100000:2.0:1763343034.117971:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993497600 00000100:00100000:2.0:1763343034.118211:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3111 00000100:00100000:2.0:1763343034.118221:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56855:x1848997993497600:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343034.118446:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993497344 00000100:00100000:3.0:1763343034.118450:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993497344 00010000:00010000:3.0:1763343034.118471:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5e2c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f8b expref: 248 pid: 28422 timeout: 1327 lvb_type: 0 00000100:00100000:3.0:1763343034.118492:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3012 00000100:00100000:3.0:1763343034.118498:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:2430:x1848997993497344:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343034.118508:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343034.118514:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5e2c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f8b expref: 248 pid: 28422 timeout: 1327 lvb_type: 0 00010000:00010000:3.0:1763343034.118525:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5e2c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f8b expref: 248 pid: 28422 timeout: 1327 lvb_type: 0 00010000:00010000:3.0:1763343034.118545:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae5e2c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f8b expref: 248 pid: 28422 timeout: 1327 lvb_type: 0 00010000:00010000:3.0:1763343034.118561:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3403bdc800) 00010000:00010000:3.0:1763343034.118567:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.118575:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343034.118644:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:2430:x1848997993497344:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 121us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.118651:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3012 00000100:00100000:1.0:1763343034.118742:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.119025:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56855:x1848997993497600:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 805us (1436us total) trans 8589939826 rc 0/0 00000100:00100000:2.0:1763343034.119032:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3111 00000100:00100000:0.0:1763343034.119086:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993497728 00000100:00100000:0.0:1763343034.119090:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993497728 00010000:00010000:0.0:1763343034.119107:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5e17 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f84 expref: 247 pid: 28422 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343034.119131:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3013 00000100:00100000:0.0:1763343034.119137:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:2429:x1848997993497728:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343034.119144:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343034.119148:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5e17 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f84 expref: 247 pid: 28422 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.119156:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5e17 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f84 expref: 247 pid: 28422 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.119168:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5e17 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f84 expref: 247 pid: 28422 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.119178:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3403bdc800) 00010000:00010000:0.0:1763343034.119182:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.119194:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.119200:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.119217:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343034.119233:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:2429:x1848997993497728:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 97us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.119238:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3013 00010000:00010000:3.0:1763343034.120342:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.120355:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343034.120382:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d4:0x0]: returning size 0 00000004:00080000:3.0:1763343034.120536:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x297:0x0], index 1: 0 00000004:00080000:3.0:1763343034.120542:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x295:0x0], index 0: 0 00000004:00080000:3.0:1763343034.120546:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x296:0x0], index 0: 0 00000004:00080000:3.0:1763343034.120549:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x298:0x0], index 1: 0 00010000:00010000:3.0:1763343034.120668:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.120676:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.120682:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.120687:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343034.120691:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.120698:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.120711:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3403bdc800) 00010000:00010000:3.0:1763343034.120713:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343034.120717:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.120722:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e41 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.120770:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae5e3a lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f92 expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.120780:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3403bdc800) 00010000:00010000:3.0:1763343034.120782:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343034.120786:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae5e3a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f92 expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.120800:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34049c8200, rc 0) 00000100:00100000:3.0:1763343034.120861:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56853:x1848997993497216:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 11451us (13684us total) trans 8589939827 rc 301/301 00000100:00100000:3.0:1763343034.120869:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9153 00000100:00100000:0.0:1763343034.123597:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.123909:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993497984 00000100:00100000:3.0:1763343034.123920:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993497984 00000100:00100000:3.0:1763343034.123979:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9154 00000100:00100000:3.0:1763343034.123989:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56855:x1848997993497984:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343034.124009:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.124034:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5e4f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8f99 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.124114:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5e56 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.124128:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5e56 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.124138:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5e56 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.124149:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5e5d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.124156:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5e5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.124162:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5e5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.124747:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5e64 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.124759:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5e64 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.124767:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5e64 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.125249:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5e56 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.125258:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5e56 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.125276:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5e56 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.125281:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.125285:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5e56 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.125291:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5e56 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.125304:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53a800) 00010000:00010000:2.0:1763343034.125306:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.125310:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5e56 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.125316:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae5e56 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.125327:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5e5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.125332:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5e5d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.125337:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5e5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.125341:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.125344:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5e5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.125348:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5e5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.125353:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935100) 00010000:00010000:2.0:1763343034.125355:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.125357:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5e5d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.125362:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae5e5d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.125397:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae5e4f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f99 expref: 248 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.125413:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5e64 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f99 expref: 247 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.125424:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a350b53ad00) 00010000:00010000:2.0:1763343034.125426:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343034.125429:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93a00, rc 0) 00000100:00100000:2.0:1763343034.125492:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56855:x1848997993497984:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1505us (1904us total) trans 8589939828 rc 0/0 00000100:00100000:2.0:1763343034.125499:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9154 00000100:00100000:1.0:1763343034.127208:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.127308:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993498240 00000100:00100000:2.0:1763343034.127317:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993498240 00000100:00100000:2.0:1763343034.127355:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3112 00000100:00100000:2.0:1763343034.127363:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56853:x1848997993498240:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343034.127606:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56853:x1848997993498240:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 243us (406us total) trans 8589939829 rc 0/0 00000100:00100000:2.0:1763343034.127614:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3112 00000100:00100000:1.0:1763343034.130324:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.130500:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993498496 00000100:00100000:2.0:1763343034.130511:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993498496 00000100:00100000:2.0:1763343034.130567:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3113 00000100:00100000:2.0:1763343034.130577:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56853:x1848997993498496:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343034.130833:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56853:x1848997993498496:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 256us (515us total) trans 8589939830 rc 0/0 00000100:00100000:2.0:1763343034.130841:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3113 00000100:00100000:0.0:1763343034.132311:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.132346:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.132476:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993498624 00000100:00100000:3.0:1763343034.132489:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993498624 00000100:00100000:3.0:1763343034.132531:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993498752 00000100:00100000:3.0:1763343034.132535:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993498752 00000100:00100000:3.0:1763343034.132567:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6412 00000100:00100000:3.0:1763343034.132577:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2430:x1848997993498624:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343034.132592:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.132614:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae5e72 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8fa0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343034.132662:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x296:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343034.132680:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.132682:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.132690:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae5e72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa0 expref: 30 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343034.132706:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae5e72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa0 expref: 30 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343034.132718:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343034.132761:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2430:x1848997993498624:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 187us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.132768:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6412 00000100:00100000:3.0:1763343034.132785:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6413 00000100:00100000:3.0:1763343034.132791:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993498752:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343034.132798:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.132809:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5e79 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8fa7 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343034.132823:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x298:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343034.132833:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.132835:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.132839:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5e79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa7 expref: 17 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343034.132849:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5e79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa7 expref: 17 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343034.132857:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:3.0:1763343034.132873:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993498752:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 83us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.132879:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6413 00000100:00100000:1.0:1763343034.137930:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.138281:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993499008 00000100:00100000:2.0:1763343034.138292:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993499008 00000100:00100000:2.0:1763343034.138355:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9155 00000100:00100000:2.0:1763343034.138365:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:55941:x1848997993499008:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343034.138395:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.138399:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343034.138426:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5e64 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f99 expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.138443:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a350b53ad00) 00010000:00010000:2.0:1763343034.138454:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343034.138471:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5e80 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8fae expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.138576:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5e87 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.138589:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5e87 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.138599:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5e87 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343034.138612:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d4:0x0]: returning size 0 00010000:00010000:2.0:1763343034.138774:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5e80 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fae expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.138791:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5e87 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fae expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.138799:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343034.138802:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1763343034.138805:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480a00, rc 0) 00000100:00100000:2.0:1763343034.138863:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:55941:x1848997993499008:12345-192.168.204.21@tcp:101:bash.0 Request processed in 498us (941us total) trans 8589939831 rc 0/0 00000100:00100000:2.0:1763343034.138871:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9155 00000100:00100000:1.0:1763343034.140378:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.140455:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993499136 00000100:00100000:3.0:1763343034.140463:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993499136 00000100:00100000:3.0:1763343034.140509:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9156 00000100:00100000:3.0:1763343034.140518:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56855:x1848997993499136:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343034.140534:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.140552:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5e95 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8fb5 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.140599:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5e95 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fb5 expref: 251 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.140614:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5e95 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fb5 expref: 251 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.140676:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:3.0:1763343034.140679:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343034.140683:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343034.140737:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56855:x1848997993499136:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 218us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.140744:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9156 00000100:00100000:0.0:1763343034.143905:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.143959:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.144064:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993499264 00000100:00100000:2.0:1763343034.144076:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993499264 00000100:00100000:2.0:1763343034.144137:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9157 00000100:00100000:2.0:1763343034.144145:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:55941:x1848997993499264:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343034.144169:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.144189:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e9c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8fbc expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.144221:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae5ea3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.144235:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae5ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.144245:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae5ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.144361:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5e9c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fbc expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.144380:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae5ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fbc expref: 252 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.144389:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343034.144392:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343034.144397:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340683d600, rc 0) 00000100:00100000:2.0:1763343034.144457:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:55941:x1848997993499264:12345-192.168.204.21@tcp:101:bash.0 Request processed in 312us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.144468:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9157 00000100:00100000:1.0:1763343034.144546:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993499520 00000100:00100000:1.0:1763343034.144552:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993499520 00000100:00100000:1.0:1763343034.144588:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3114 00000100:00100000:1.0:1763343034.144595:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fbb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56855:x1848997993499520:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343034.144768:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fbb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56855:x1848997993499520:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 172us (807us total) trans 8589939832 rc 0/0 00000100:00100000:1.0:1763343034.144775:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3114 00000100:00100000:0.0:1763343034.148519:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.148589:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993499776 00000100:00100000:3.0:1763343034.148599:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993499776 00000100:00100000:2.0:1763343034.149317:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9158 00000100:00100000:2.0:1763343034.149332:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56855:x1848997993499776:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.149351:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.149373:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5eaa lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8fc3 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.149439:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5eb1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149452:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5eb1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149462:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5eb1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149469:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5eb8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149476:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149481:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149576:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5ebf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149586:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5ebf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149592:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5ebf lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149599:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5ebf lrc: 3/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149604:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.149608:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5ebf lrc: 3/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149614:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5ebf lrc: 4/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149647:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343034.149653:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5ebf lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149658:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae5ebf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343034.149674:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d4:0x0]: returning size 0 00010000:00010000:2.0:1763343034.149743:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5eb1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149749:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5eb1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149755:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149759:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340683c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.149761:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149766:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5eb1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149776:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935000) 00010000:00010000:2.0:1763343034.149779:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.149781:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5eb1 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149786:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5eb1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149793:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149798:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5eb8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149802:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149807:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340683d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.149809:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149814:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5eb8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149819:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935100) 00010000:00010000:2.0:1763343034.149821:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.149823:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5eb8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149827:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5eb8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.149854:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5eaa lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fc3 expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.149863:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935000) 00010000:00010000:2.0:1763343034.149865:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343034.149868:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5eaa lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fc3 expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.149878:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340683ce00, rc 0) 00000100:00100000:2.0:1763343034.149950:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56855:x1848997993499776:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 615us (1431us total) trans 8589939833 rc 301/301 00000100:00100000:2.0:1763343034.149957:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9158 00000100:00100000:0.0:1763343034.151590:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.152022:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993500032 00000100:00100000:3.0:1763343034.152032:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993500032 00000100:00100000:3.0:1763343034.152103:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9159 00000100:00100000:3.0:1763343034.152112:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:55941:x1848997993500032:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:3.0:1763343034.152162:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343034.152186:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5e87 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fae expref: 254 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.152202:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:3.0:1763343034.152207:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343034.152366:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5ecd lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.152383:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5ecd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.152391:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5ecd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000001:00080000:3.0:1763343034.152433:0:10041:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939834 00000004:00010000:3.0:1763343034.152450:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f5f44f1d reply state 00000000048ca486 transno 8589939835 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5ecd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.152461:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5ecd lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.152466:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:3.0:1763343034.152468:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343034.152471:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343034.152549:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:55941:x1848997993500032:12345-192.168.204.21@tcp:36:bash.0 Request processed in 438us (965us total) trans 8589939835 rc 0/0 00000100:00100000:3.0:1763343034.152556:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9159 00000020:00080000:3.0:1763343034.152560:0:10041:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343034.153684:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.154493:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993500288 00000100:00100000:2.0:1763343034.154504:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993500288 00000100:00100000:2.0:1763343034.154553:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3115 00000100:00100000:2.0:1763343034.154561:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56855:x1848997993500288:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343034.155715:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56855:x1848997993500288:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1149us (2030us total) trans 8589939836 rc 0/0 00000100:00100000:2.0:1763343034.155724:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3115 00000100:00100000:1.0:1763343034.158142:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.158905:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993500544 00000100:00100000:2.0:1763343034.158917:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993500544 00000100:00100000:1.0:1763343034.159038:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9160 00000100:00100000:1.0:1763343034.159046:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:55941:x1848997993500544:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343034.159068:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.159070:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343034.159094:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5e95 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fb5 expref: 257 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.159111:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:1.0:1763343034.159116:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343034.159128:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5ed4 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8fca expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.159171:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5edb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.159184:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5edb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.159193:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5edb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:1.0:1763343034.159418:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1387, 88 off117344 00000004:00080000:1.0:1763343034.159425:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1227826803986ns, next at 1228493164729ns, rc = 0 00000040:00080000:1.0:1763343034.159457:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1386, 88 off117344 00000004:00080000:1.0:1763343034.159461:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1227826840771ns, next at 1228493192443ns, rc = 0 00000040:00080000:1.0:1763343034.159473:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1387, 88 off117432 00000004:00080000:1.0:1763343034.159476:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1227826855721ns, next at 1228493192443ns, rc = 0 00000040:00080000:1.0:1763343034.159483:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1388, 88 off117432 00000004:00080000:1.0:1763343034.159486:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1227826865656ns, next at 1228493164729ns, rc = 0 00000100:00100000:0.0:1763343034.160253:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.160358:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993500672 00000100:00100000:2.0:1763343034.160364:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993500672 00000100:00100000:2.0:1763343034.160404:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3116 00000100:00100000:2.0:1763343034.160410:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56855:x1848997993500672:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:2.0:1763343034.160535:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56855:x1848997993500672:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 125us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.160542:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3116 00000001:00080000:1.0:1763343034.163922:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939837 is committed 00000004:00080000:1.0:1763343034.163936:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 913 committed 00000004:00080000:1.0:1763343034.163960:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 914 committed 00000004:00080000:1.0:1763343034.164075:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 913 committed 00000100:00100000:0.0:1763343034.164193:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010247424:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343034.164383:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010247680:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343034.164492:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 912 committed 00010000:00010000:1.0:1763343034.164594:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5edb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fca expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.164607:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:1.0:1763343034.164610:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343034.164645:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae5ed4 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fca expref: 241 pid: 28422 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343034.164669:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5edb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fca expref: 240 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.164698:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:1.0:1763343034.164701:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343034.164703:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:1.0:1763343034.164756:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993500544:12345-192.168.204.21@tcp:101:bash.0 Request processed in 5708us (6619us total) trans 8589939837 rc 0/0 00000100:00100000:1.0:1763343034.164764:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9160 00000100:00100000:0.0:1763343034.164934:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343034.164992:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010247936:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343034.165018:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343034.165035:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1763343034.165040:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010247808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343034.165061:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343034.165077:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010248320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343034.165095:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343034.165124:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010247424 00000100:00100000:0.0:1763343034.165131:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010247424 00000100:00100000:0.0:1763343034.165163:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010247936 00000100:00100000:0.0:1763343034.165165:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010247936 00000100:00100000:0.0:1763343034.165179:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010247808 00000100:00100000:0.0:1763343034.165181:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010247808 00000100:00100000:0.0:1763343034.165192:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010248320 00000100:00100000:0.0:1763343034.165194:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010248320 00000100:00100000:0.0:1763343034.165209:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6414 00000100:00100000:0.0:1763343034.165216:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3658:x1848998010247424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343034.165240:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:659 count 1 00010000:00010000:0.0:1763343034.165275:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5ee2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.165294:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a35029d5600/0x607405d401ae5d30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f3e expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.165302:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343034.165305:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343034.165308:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5ee2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.165336:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a35029d5600/0x607405d401ae5d30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f3e expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.165350:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a35029d5600/0x607405d401ae5d30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f3e expref: 29 pid: 8410 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343034.165362:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010248448:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343034.165409:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3538beac00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343034.165427:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6415 00000100:00100000:0.0:1763343034.165435:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3658:x1848998010247936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343034.165447:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:661 count 1 00010000:00010000:0.0:1763343034.165463:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5ee9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.165475:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5d37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f45 expref: 16 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.165482:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343034.165484:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343034.165487:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5ee9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.165506:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5d37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f45 expref: 16 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.165515:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5d37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f45 expref: 16 pid: 28996 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343034.165525:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1848998010248576:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343034.165547:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3538bea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343034.165565:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6416 00000100:00100000:0.0:1763343034.165573:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+51:3658:x1848998010247808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343034.165751:0:8408:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343034.165755:0:8408:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.165757:0:8408:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.165760:0:8408:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.165763:0:8408:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343034.165799:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3658:x1848998010247808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (736us total) trans 21474838845 rc 0/0 00000100:00100000:0.0:1763343034.165805:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6416 00000100:00100000:0.0:1763343034.165822:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6417 00000100:00100000:0.0:1763343034.165829:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3658:x1848998010248320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343034.165890:0:8408:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343034.165893:0:8408:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.165895:0:8408:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.165897:0:8408:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.165900:0:8408:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343034.165922:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3658:x1848998010248320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (825us total) trans 17179871545 rc 0/0 00000100:00100000:0.0:1763343034.165927:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6417 00000100:00100000:0.0:1763343034.165967:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343034.165994:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010248192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343034.166016:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343034.166032:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1763343034.166038:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010247552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343034.166060:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343034.166075:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010248064:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343034.166091:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343034.166114:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010247680 00000100:00100000:0.0:1763343034.166119:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010247680 00000100:00100000:0.0:1763343034.166139:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010248192 00000100:00100000:0.0:1763343034.166141:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010248192 00000100:00100000:0.0:1763343034.166153:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010247552 00000100:00100000:0.0:1763343034.166155:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010247552 00000100:00100000:0.0:1763343034.166166:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010248064 00000100:00100000:0.0:1763343034.166168:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010248064 00000100:00100000:0.0:1763343034.166177:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6418 00000100:00100000:0.0:1763343034.166182:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3660:x1848998010247680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343034.166252:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3660:x1848998010247680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (283us total) trans 21474838846 rc 0/0 00000100:00100000:0.0:1763343034.166258:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6418 00000100:00100000:0.0:1763343034.166269:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6419 00000100:00100000:0.0:1763343034.166274:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3660:x1848998010248192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343034.166334:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3660:x1848998010248192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (316us total) trans 17179871546 rc 0/0 00000100:00100000:0.0:1763343034.166340:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6419 00000100:00100000:0.0:1763343034.166351:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6420 00000100:00100000:0.0:1763343034.166356:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354111d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3660:x1848998010247552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343034.166367:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:660 count 1 00010000:00010000:0.0:1763343034.166377:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5ef0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x294:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.166389:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5cc0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f1b expref: 29 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343034.166395:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.166397:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.166400:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5ef0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.166424:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5cc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f1b expref: 29 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343034.166433:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5cc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f1b expref: 29 pid: 27835 timeout: 1327 lvb_type: 1 00000100:00100000:0.0:1763343034.166443:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010248704:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343034.166467:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35011ca840 going to sleep for 11 seconds 00000100:00100000:0.0:1763343034.166481:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6421 00000100:00100000:0.0:1763343034.166487:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3660:x1848998010248064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343034.166497:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:662 count 1 00010000:00010000:0.0:1763343034.166507:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5ef7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.166517:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5cc7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f14 expref: 16 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343034.166524:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.166525:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.166528:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5ef7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.166546:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5cc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f14 expref: 16 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343034.166554:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5cc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f14 expref: 16 pid: 27835 timeout: 1327 lvb_type: 1 00000100:00100000:0.0:1763343034.166564:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010248832:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343034.166584:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c300 going to sleep for 11 seconds 00000004:00080000:0.0:1763343034.166645:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a4700/2, rc 0, transno 17179871546 00000100:00100000:0.0:1763343034.166651:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010248192:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343034.166663:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d10f800/2, rc 0, transno 21474838846 00000100:00100000:0.0:1763343034.166667:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010247680:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343034.166685:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d10ea00/2, rc 0, transno 21474838845 00000100:00100000:0.0:1763343034.166689:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010247808:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343034.166696:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a5c00/2, rc 0, transno 17179871545 00000100:00100000:0.0:1763343034.166699:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010248320:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763343034.167974:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae5d76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343034.167989:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae5d76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343034.167996:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae5d76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343034.168001:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d5a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343034.168006:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae5d76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343034.168014:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae5d76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343034.168031:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935100) 00010000:00010000:3.0:1763343034.168035:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343034.168039:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae5d76 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343034.168046:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae5d76 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343034.168064:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5e10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.168070:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5e10 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.168076:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5e10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.168081:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343034.168084:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5e10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.168090:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5e10 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.168097:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935100) 00010000:00010000:3.0:1763343034.168100:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343034.168102:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5e10 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.168108:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae5e10 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.168125:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5ecd lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.168131:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5ecd lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.168136:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5ecd lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.168142:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343034.168145:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5ecd lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.168150:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5ecd lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.168157:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:3.0:1763343034.168160:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343034.168162:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5ecd lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.168168:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5ecd lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000100:00100000:0.0:1763343034.174997:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010248832:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343034.175035:0:28648:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5ef7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343034.175079:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.175099:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.175117:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.175139:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993500800 00000100:00100000:0.0:1763343034.175145:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993500800 00010000:00010000:0.0:1763343034.175181:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a35029d5600/0x607405d401ae5d30 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f3e expref: 30 pid: 8410 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343034.175209:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993501184 00000100:00100000:0.0:1763343034.175213:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993501184 00010000:00010000:0.0:1763343034.175225:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5cc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f14 expref: 17 pid: 27835 timeout: 1327 lvb_type: 1 00000100:00100000:0.0:1763343034.175243:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993501056 00000100:00100000:0.0:1763343034.175246:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993501056 00010000:00010000:0.0:1763343034.175260:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5cc0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f1b expref: 31 pid: 27835 timeout: 1327 lvb_type: 1 00000100:00100000:0.0:1763343034.175290:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3014 00000100:00100000:0.0:1763343034.175298:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993500800:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343034.175313:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343034.175318:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a35029d5600/0x607405d401ae5d30 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f3e expref: 31 pid: 8410 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.175329:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a35029d5600/0x607405d401ae5d30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f3e expref: 31 pid: 8410 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.175355:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.175358:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.175362:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5ee2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.175372:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5ee2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.175389:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343034.175433:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993500800:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 135us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.175444:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3014 00000100:00100000:0.0:1763343034.175461:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3015 00000100:00100000:0.0:1763343034.175467:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2432:x1848997993501184:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343034.175476:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343034.175480:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5cc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f14 expref: 17 pid: 27835 timeout: 1327 lvb_type: 1 00010000:00010000:0.0:1763343034.175489:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5cc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f14 expref: 17 pid: 27835 timeout: 1327 lvb_type: 1 00010000:00010000:0.0:1763343034.175503:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae5cc7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f14 expref: 17 pid: 27835 timeout: 1327 lvb_type: 1 00010000:00010000:0.0:1763343034.175518:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.175520:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.175523:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5ef7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.175529:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5ef7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.175546:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343034.175567:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993501184:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 99us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.175573:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3015 00000100:00100000:0.0:1763343034.175585:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3016 00000100:00100000:0.0:1763343034.175592:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2429:x1848997993501056:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343034.175600:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343034.175604:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5cc0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f1b expref: 30 pid: 27835 timeout: 1327 lvb_type: 1 00010000:00010000:0.0:1763343034.175612:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5cc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f1b expref: 30 pid: 27835 timeout: 1327 lvb_type: 1 00010000:00010000:0.0:1763343034.175664:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.175666:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.175669:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5ef0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.175677:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5ef0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.175689:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343034.175707:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2429:x1848997993501056:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 115us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.175713:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3016 00010000:00010000:0.0:1763343034.175741:0:28648:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5ef7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.175750:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5ef7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.175759:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5ef7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.175769:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5ef7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.175784:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343034.176026:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3660:x1848998010248064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9537us (9931us total) trans 17179871547 rc 0/0 00000100:00100000:0.0:1763343034.176034:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6421 00000004:00080000:0.0:1763343034.176074:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a5500/2, rc 0, transno 17179871547 00000100:00100000:0.0:1763343034.176080:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010248064:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343034.176118:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.176137:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993501312 00000100:00100000:0.0:1763343034.176141:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993501312 00000100:00100000:0.0:1763343034.176164:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6422 00000100:00100000:0.0:1763343034.176170:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:55941:x1848997993501312:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343034.176182:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.176199:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665d200/0x607405d401ae5efe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8fd1 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343034.176219:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x297:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343034.176234:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.176236:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.176242:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d200/0x607405d401ae5efe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd1 expref: 17 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.176255:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340665d200/0x607405d401ae5efe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd1 expref: 17 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.176271:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d200, rc 0) 00000100:00100000:0.0:1763343034.176290:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993501312:12345-192.168.204.21@tcp:101:bash.0 Request processed in 121us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.176296:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6422 00000100:00100000:0.0:1763343034.176369:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.176385:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993500928 00000100:00100000:0.0:1763343034.176389:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993500928 00010000:00010000:0.0:1763343034.176406:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5d37 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f45 expref: 17 pid: 28996 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343034.176425:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3017 00000100:00100000:0.0:1763343034.176432:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2432:x1848997993500928:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343034.176441:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343034.176445:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5d37 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f45 expref: 17 pid: 28996 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.176455:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5d37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f45 expref: 17 pid: 28996 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.176468:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.176470:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.176473:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5ee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.176481:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5ee9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.176499:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343034.176518:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2432:x1848997993500928:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 86us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.176525:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3017 00010000:00010000:1.0:1763343034.176858:0:28994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a35029d5600/0x607405d401ae5d30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x293:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f3e expref: 29 pid: 8410 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343034.176872:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010248448:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343034.176891:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5ee2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.176901:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5ee2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.176909:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5ee2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.176918:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5ee2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.176931:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5ee2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.176968:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763343034.177144:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3658:x1848998010247424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11926us (12209us total) trans 21474838847 rc 0/0 00000100:00100000:1.0:1763343034.177150:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6414 00000004:00080000:1.0:1763343034.177187:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d10dc00/2, rc 0, transno 21474838847 00000100:00100000:1.0:1763343034.177192:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010247424:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1763343034.177319:0:27835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9a00/0x607405d401ae5cc0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f1b expref: 28 pid: 27835 timeout: 1327 lvb_type: 1 00000100:00100000:3.0:1763343034.177330:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010248704:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343034.177341:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5ef0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177352:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5ef0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177358:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5ef0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177365:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5ef0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177370:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5ef0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177384:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1763343034.177486:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354111d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3660:x1848998010247552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11129us (11425us total) trans 21474838848 rc 0/0 00000100:00100000:3.0:1763343034.177493:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6420 00010000:00010000:3.0:1763343034.177511:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1763343034.177518:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5ef7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177526:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343034.177529:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5ef7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177538:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5ef7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177555:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5ef7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177561:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae5ef7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177577:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343034.177580:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5ee2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177586:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343034.177589:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5ee2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177595:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5ee2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177604:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5ee2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177610:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665c400/0x607405d401ae5ee2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177645:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343034.177650:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5ef0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177661:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343034.177665:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5ef0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177672:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5ef0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177681:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5ef0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177687:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d000/0x607405d401ae5ef0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.177697:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343034.177699:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343034.177701:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343034.177722:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d10f480/2, rc 0, transno 21474838848 00000100:00100000:3.0:1763343034.177727:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010247552:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763343034.179205:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343034.179257:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae5d37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8f45 expref: 16 pid: 28996 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343034.179285:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1848998010248576:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343034.179306:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5ee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.179315:0:8410:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5ee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.179322:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5ee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.179331:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5ee9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.179338:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5ee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.179368:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343034.179610:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010247936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14174us (14589us total) trans 17179871548 rc 0/0 00000100:00100000:2.0:1763343034.179642:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6415 00010000:00010000:1.0:1763343034.179806:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343034.179813:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5ee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.179821:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665da00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343034.179825:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5ee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.179831:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5ee9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.179848:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5ee9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.179855:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5ee9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.179878:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343034.179880:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343034.179881:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343034.180047:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a6680/2, rc 0, transno 17179871548 00000100:00100000:3.0:1763343034.180055:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010247936:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343034.180852:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.181212:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993501440 00000100:00100000:2.0:1763343034.181220:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993501440 00000100:00100000:2.0:1763343034.181278:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6423 00000100:00100000:2.0:1763343034.181287:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:55941:x1848997993501440:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343034.181304:0:8410:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.181325:0:8410:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae5f05 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8fd8 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343034.181346:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x295:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343034.181368:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.181370:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.181379:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae5f05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd8 expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.181395:0:8410:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae5f05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd8 expref: 29 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.181409:0:8410:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480600, rc 0) 00000100:00100000:2.0:1763343034.183163:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:55941:x1848997993501440:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1866us (2304us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.183175:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6423 00000100:00100000:1.0:1763343034.183430:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.184183:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993501696 00000100:00100000:2.0:1763343034.184194:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993501696 00000100:00100000:2.0:1763343034.184703:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9161 00000100:00100000:2.0:1763343034.184714:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+237:56856:x1848997993501696:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.184741:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.184766:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5f0c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8fdf expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.184851:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5f13 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.184865:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5f13 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.184878:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5f13 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.184893:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f1a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.184900:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.184907:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185042:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5f21 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185052:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5f21 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185059:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5f21 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343034.185070:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d4:0x0]: returning size 2 00010000:00010000:2.0:1763343034.185167:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5f13 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185175:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5f13 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185181:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5f13 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185187:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.185192:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5f13 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185199:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5f13 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185212:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935d00) 00010000:00010000:2.0:1763343034.185215:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.185220:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5f13 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185227:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae5f13 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185243:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185249:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f1a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185255:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185261:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340683ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.185277:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185283:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185290:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935200) 00010000:00010000:2.0:1763343034.185292:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.185295:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f1a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185304:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f1a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.185348:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae5f0c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fdf expref: 240 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.185362:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5f21 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fdf expref: 239 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.185369:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343034.185371:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343034.185374:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340683d400, rc 0) 00000100:00100000:2.0:1763343034.185448:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56856:x1848997993501696:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 736us (2018us total) trans 8589939838 rc 0/0 00000100:00100000:2.0:1763343034.185456:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9161 00010000:00010000:0.0:1763343034.185749:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343034.188516:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.188564:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.188675:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993501824 00000100:00100000:0.0:1763343034.188688:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993501824 00002000:00010000:0.0:1763343034.188730:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/663 (0->18446744073709551615) 00002000:00100000:0.0:1763343034.188735:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538755880 with x1848997993501824 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343034.188745:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3538755880. 00000100:00100000:0.0:1763343034.188770:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993501952 00000100:00100000:0.0:1763343034.188774:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993501952 00002000:00010000:0.0:1763343034.188786:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/661 (0->18446744073709551615) 00002000:00100000:0.0:1763343034.188789:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062f1180 with x1848997993501952 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343034.188795:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34062f1180. 00000100:00100000:0.0:1763343034.188818:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1572 00000100:00100000:0.0:1763343034.188828:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2431:x1848997993501824:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343034.189013:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343034.189017:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb mtime from disk: 0 -> 1763343034 00002000:00010000:0.0:1763343034.189020:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.189022:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb ctime from disk: 0 -> 1763343034 00002000:00010000:0.0:1763343034.189024:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343034.189073:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2431:x1848997993501824:12345-192.168.204.21@tcp:10:bash.0 Request processed in 246us (567us total) trans 17179871549 rc 0/0 00000100:00100000:0.0:1763343034.189081:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1572 00002000:00010000:0.0:1763343034.189085:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/663 (0->18446744073709551615) 00002000:00100000:0.0:1763343034.189087:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538755880 with x1848997993501824 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343034.189092:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3538755880. 00000100:00100000:0.0:1763343034.189109:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1573 00000100:00100000:0.0:1763343034.189115:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2431:x1848997993501952:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343034.189195:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x295:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343034.189198:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x295:0x0] updating lvb mtime from disk: 0 -> 1763343034 00002000:00010000:0.0:1763343034.189200:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x295:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.189202:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x295:0x0] updating lvb ctime from disk: 0 -> 1763343034 00002000:00010000:0.0:1763343034.189204:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x295:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343034.189226:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2431:x1848997993501952:12345-192.168.204.21@tcp:10:bash.0 Request processed in 111us (661us total) trans 21474838849 rc 0/0 00000100:00100000:0.0:1763343034.189232:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1573 00002000:00010000:0.0:1763343034.189235:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/661 (0->18446744073709551615) 00002000:00100000:0.0:1763343034.189238:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062f1180 with x1848997993501952 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343034.189242:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34062f1180. 00000100:00100000:3.0:1763343034.191991:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.192088:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993502208 00000100:00100000:1.0:1763343034.192099:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993502208 00000100:00100000:1.0:1763343034.192150:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3117 00000100:00100000:1.0:1763343034.192161:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56856:x1848997993502208:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343034.192380:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56856:x1848997993502208:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 221us (398us total) trans 8589939839 rc 0/0 00000100:00100000:1.0:1763343034.192388:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3117 00000100:00100000:3.0:1763343034.195018:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.195103:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993502464 00000100:00100000:2.0:1763343034.195114:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993502464 00000100:00100000:2.0:1763343034.195174:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3118 00000100:00100000:2.0:1763343034.195184:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993502464:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:2.0:1763343034.195574:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:55941:x1848997993502464:12345-192.168.204.21@tcp:35:bash.0 Request processed in 391us (563us total) trans 8589939840 rc 0/0 00000100:00100000:2.0:1763343034.195582:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3118 00000100:00100000:3.0:1763343034.200464:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.200876:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993502720 00000100:00100000:2.0:1763343034.200887:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993502720 00000100:00100000:2.0:1763343034.201238:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9162 00000100:00100000:2.0:1763343034.201249:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56856:x1848997993502720:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.201285:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.201309:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f2f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8fe6 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.201448:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.201464:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5f21 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fdf expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.201473:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.201511:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5f21 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fdf expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.201524:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5f21 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fdf expref: 242 pid: 28422 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343034.201539:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010248960:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343034.202089:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35167c1900 going to sleep for 11 seconds 00000100:00100000:2.0:1763343034.208085:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010248960:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343034.208122:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343034.210610:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.211130:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993502848 00000100:00100000:2.0:1763343034.211140:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993502848 00010000:00010000:2.0:1763343034.211183:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5f21 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fdf expref: 243 pid: 28422 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343034.211239:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3018 00000100:00100000:2.0:1763343034.211251:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:2429:x1848997993502848:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343034.211268:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343034.211275:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5f21 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fdf expref: 243 pid: 28422 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343034.211289:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5f21 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fdf expref: 243 pid: 28422 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343034.211459:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5f21 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fdf expref: 243 pid: 28422 timeout: 1327 lvb_type: 0 00010000:00010000:2.0:1763343034.211476:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343034.211481:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.211490:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.211497:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.211525:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343034.211584:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:2429:x1848997993502848:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 335us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.211592:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3018 00010000:00010000:1.0:1763343034.211694:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.211702:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343034.211725:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d4:0x0]: returning size 5 00010000:00010000:1.0:1763343034.211855:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f2f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fe6 expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.211869:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fe6 expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.211876:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:1.0:1763343034.211879:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763343034.211881:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340683c200, rc 0) 00000100:00100000:1.0:1763343034.211920:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56856:x1848997993502720:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 10674us (11466us total) trans 8589939841 rc 0/0 00000100:00100000:1.0:1763343034.211927:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9162 00000100:00100000:3.0:1763343034.212065:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.212421:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993502976 00000100:00100000:1.0:1763343034.212426:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993502976 00000100:00100000:1.0:1763343034.212461:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9163 00000100:00100000:1.0:1763343034.212469:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56857:x1848997993502976:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:1.0:1763343034.212487:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.212503:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5f44 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8fed expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.212552:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5f4b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.212562:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5f4b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.212570:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5f4b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.212580:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5f52 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.212586:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5f52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.212591:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5f52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.212688:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5f59 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.212698:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fe6 expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.212705:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5f59 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.212732:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fe6 expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.212743:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fe6 expref: 243 pid: 28422 timeout: 1327 lvb_type: 0 00000100:00100000:1.0:1763343034.212756:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010249088:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343034.212812:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abed80 going to sleep for 11 seconds 00000100:00100000:2.0:1763343034.214686:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010249088:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343034.214713:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5f59 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343034.216083:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.216161:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.216232:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993503232 00000100:00100000:0.0:1763343034.216240:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993503232 00010000:00010000:0.0:1763343034.216274:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fe6 expref: 244 pid: 28422 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343034.216407:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3019 00000100:00100000:0.0:1763343034.216418:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:2430:x1848997993503232:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343034.216432:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343034.216439:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fe6 expref: 244 pid: 28422 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.216457:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fe6 expref: 244 pid: 28422 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.216477:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f36 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fe6 expref: 244 pid: 28422 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.216492:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:0.0:1763343034.216497:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5f59 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.216506:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5f59 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.216513:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5f59 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.216540:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343034.216586:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:2430:x1848997993503232:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 170us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.216592:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3019 00000100:00100000:3.0:1763343034.216735:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993503104 00000100:00100000:3.0:1763343034.216740:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993503104 00000100:00100000:3.0:1763343034.216772:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9164 00000100:00100000:3.0:1763343034.216778:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56856:x1848997993503104:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343034.216798:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.216813:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5f60 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ff4 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.216913:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5f67 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.216923:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5f67 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.216931:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5f67 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343034.216966:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d4:0x0]: returning size 5 00000004:00200000:3.0:1763343034.216970:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343034.216987:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5f67 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.217007:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5f60 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ff4 expref: 245 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.217019:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5f67 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ff4 expref: 244 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.217026:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:3.0:1763343034.217029:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343034.217032:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343034.217061:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56856:x1848997993503104:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 282us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.217067:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9164 00010000:00010000:2.0:1763343034.217168:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5f59 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217176:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5f59 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343034.217195:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d4:0x0]: returning size 5 00000004:00200000:2.0:1763343034.217197:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343034.217206:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5f59 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217216:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5f59 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217224:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5f4b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217231:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5f4b lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217237:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5f4b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217244:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.217248:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5f4b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217255:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5f4b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217267:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bde800) 00010000:00010000:2.0:1763343034.217270:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.217274:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5f4b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217280:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae5f4b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217290:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5f52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217296:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5f52 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217301:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5f52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217306:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.217407:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5f52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217414:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5f52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217422:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403bdec00) 00010000:00010000:2.0:1763343034.217425:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.217428:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5f52 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217433:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5f52 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.217457:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5f44 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fed expref: 244 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.217470:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5f59 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fed expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.217476:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343034.217479:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343034.217481:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177600, rc 0) 00000100:00100000:2.0:1763343034.217515:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56857:x1848997993502976:12345-192.168.204.21@tcp:101:rm.0 Request processed in 5047us (5451us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.217521:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9163 00000100:00100000:3.0:1763343034.227911:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.227980:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.230244:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993503488 00000100:00100000:2.0:1763343034.230264:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993503488 00000100:00100000:2.0:1763343034.230350:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993503744 00000100:00100000:2.0:1763343034.230353:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993503744 00000100:00100000:2.0:1763343034.230392:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9165 00000100:00100000:2.0:1763343034.230402:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56856:x1848997993503488:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.230430:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.230458:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5f6e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac8ffb expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.230587:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f75 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.230605:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f75 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.230650:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f75 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343034.230664:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d4:0x0]: returning size 5 00010000:00010000:2.0:1763343034.230793:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae5f6e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ffb expref: 247 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.230813:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f75 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ffb expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.230823:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343034.230827:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343034.230830:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340683c200, rc 0) 00000100:00100000:2.0:1763343034.230902:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56856:x1848997993503488:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 501us (3012us total) trans 8589939842 rc 0/0 00000100:00100000:2.0:1763343034.230909:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9165 00000100:00100000:2.0:1763343034.230929:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9166 00000100:00100000:2.0:1763343034.230935:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56857:x1848997993503744:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:2.0:1763343034.230983:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1763343034.230997:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae5edb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fca expref: 245 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.231014:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae5f59 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fed expref: 244 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.231027:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae5f67 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ff4 expref: 243 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.231039:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae5ea3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fbc expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.231046:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343034.231050:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343034.231068:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f83 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231075:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f83 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231082:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f83 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231095:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae5f8a lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231101:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae5f8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231108:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae5f8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231178:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae5f91 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231184:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae5f91 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231190:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae5f91 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00080000:2.0:1763343034.231746:0:28422:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1d4:0x0] is inserted into orphan list, open count = 2 00010000:00010000:2.0:1763343034.231819:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae5f91 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231827:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae5f91 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231835:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae5f91 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231843:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.231848:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae5f91 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231856:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae5f91 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231865:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343034.231868:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343034.231871:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae5f91 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231877:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae5f91 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231890:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f83 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231896:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f83 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231902:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f83 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231907:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340683ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.231909:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f83 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231915:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f83 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231921:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935d00) 00010000:00010000:2.0:1763343034.231923:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.231926:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f83 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231932:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae5f83 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:2.0:1763343034.231959:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003dedf044 reply state 000000004ca43ad9 transno 8589939843 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae5f8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231971:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae5f8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.231977:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935200) 00010000:00010000:2.0:1763343034.231979:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343034.231982:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343034.232049:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56857:x1848997993503744:12345-192.168.204.21@tcp:36:rm.0 Request processed in 1111us (4066us total) trans 8589939843 rc 0/0 00000100:00100000:2.0:1763343034.232058:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9166 00000100:00100000:0.0:1763343034.234138:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.234236:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993503872 00000100:00100000:3.0:1763343034.234249:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993503872 00000100:00100000:3.0:1763343034.234311:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9167 00000100:00100000:3.0:1763343034.234321:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56856:x1848997993503872:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343034.234354:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.234378:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5f98 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9002 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.234448:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5f98 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9002 expref: 244 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.234466:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5f98 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9002 expref: 244 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.234485:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:3.0:1763343034.234489:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343034.234493:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343034.234562:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56856:x1848997993503872:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 242us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.234571:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9167 00000100:00100000:1.0:1763343034.236483:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.236714:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993504000 00000100:00100000:0.0:1763343034.236726:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993504000 00000100:00100000:0.0:1763343034.236779:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6424 00000100:00100000:0.0:1763343034.236789:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2432:x1848997993504000:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:0.0:1763343034.236846:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5f9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.236876:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d200/0x607405d401ae5efe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd1 expref: 17 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.236886:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343034.236888:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343034.236893:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5f9f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.236932:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665d200/0x607405d401ae5efe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd1 expref: 17 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.238713:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665d200/0x607405d401ae5efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd1 expref: 17 pid: 28648 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343034.238741:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1848998010249216:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343034.238898:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343034.250836:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1848998010249216:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343034.250883:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5f9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343034.251158:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.252407:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993504128 00000100:00100000:3.0:1763343034.252423:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993504128 00002000:00100000:3.0:1763343034.252501:0:28424:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x297:0x0] (0->4) req@ffff9a34062f0000 x1848997993504128/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:530/0 lens 496/0 e 0 to 0 dl 1763343045 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343034.252514:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062f0000 with x1848997993504128 ext(0->4) 00010000:00010000:3.0:1763343034.252524:0:28424:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d200/0x607405d401ae5efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd1 expref: 18 pid: 28648 timeout: 1327 lvb_type: 0 00010000:00010000:3.0:1763343034.252542:0:28424:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a340665d200/0x607405d401ae5efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd1 expref: 18 pid: 28648 timeout: 1327 lvb_type: 0 00002000:00010000:3.0:1763343034.252551:0:28424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a34062f0000 00000100:00100000:3.0:1763343034.252596:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 104 00000100:00100000:3.0:1763343034.252607:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993504128:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:1.0:1763343034.254422:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.255066:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993504256 00000100:00100000:2.0:1763343034.255080:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993504256 00000100:00100000:2.0:1763343034.255160:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9168 00000100:00100000:2.0:1763343034.255173:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56858:x1848997993504256:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.255204:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.255239:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae5fa6 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9009 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.255573:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae5fad lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255591:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae5fad lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255604:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae5fad lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255616:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae5fb4 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255644:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae5fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255652:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae5fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255701:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae5fad lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255709:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae5fad lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255715:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae5fad lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255722:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.255728:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae5fad lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255737:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae5fad lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255756:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935d00) 00010000:00010000:2.0:1763343034.255760:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.255766:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae5fad lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255773:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae5fad lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255789:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae5fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255795:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae5fb4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255800:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae5fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255806:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058ddc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.255809:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae5fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255815:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae5fb4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255822:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935200) 00010000:00010000:2.0:1763343034.255824:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.255828:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae5fb4 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255833:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae5fb4 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.255869:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae5fa6 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9009 expref: 245 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.255881:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935d00) 00010000:00010000:2.0:1763343034.255884:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.255888:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae5fa6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9009 expref: 245 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.255903:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd000, rc 0) 00000100:00100000:2.0:1763343034.257026:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56858:x1848997993504256:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1449us (2211us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343034.257040:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9168 00000100:00100000:3.0:1763343034.258920:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993504128:12345-192.168.204.21@tcp:4:bash.0 Request processed in 6300us (7749us total) trans 17179871550 rc 0/0 00000100:00100000:3.0:1763343034.259096:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 104 00002000:00100000:3.0:1763343034.259114:0:28424:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x297:0x0] (0->4) req@ffff9a34062f0000 x1848997993504128/t17179871550(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:530/0 lens 496/448 e 0 to 0 dl 1763343045 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343034.259125:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062f0000 with x1848997993504128 ext(0->4) 00010000:00010000:3.0:1763343034.259136:0:28424:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d200/0x607405d401ae5efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd1 expref: 20 pid: 28648 timeout: 1327 lvb_type: 0 00010000:00010000:3.0:1763343034.259155:0:28424:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a340665d200/0x607405d401ae5efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd1 expref: 20 pid: 28648 timeout: 1327 lvb_type: 0 00002000:00010000:3.0:1763343034.259162:0:28424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a34062f0000 00000100:00100000:1.0:1763343034.260924:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.261073:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993504384 00000100:00100000:2.0:1763343034.261087:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993504384 00000100:00100000:2.0:1763343034.261167:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9169 00000100:00100000:2.0:1763343034.261178:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56858:x1848997993504384:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.261205:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.261237:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae5fbb lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9010 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.261343:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae5fc2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261360:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae5fc2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261376:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae5fc2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261389:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae5fc9 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261402:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae5fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261409:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae5fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261474:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae5fc2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261483:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae5fc2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261490:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae5fc2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261500:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.261505:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae5fc2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261512:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae5fc2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261527:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935700) 00010000:00010000:2.0:1763343034.261531:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.261536:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae5fc2 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261542:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae5fc2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261558:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae5fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261564:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae5fc9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261570:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae5fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261574:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.261577:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae5fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261582:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae5fc9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261589:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935200) 00010000:00010000:2.0:1763343034.261592:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.261595:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae5fc9 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261601:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae5fc9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.261665:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae5fbb lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9010 expref: 245 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.261676:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935700) 00010000:00010000:2.0:1763343034.261679:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.261683:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae5fbb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9010 expref: 245 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.261697:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dda00, rc 0) 00000100:00100000:2.0:1763343034.261769:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56858:x1848997993504384:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 592us (857us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343034.261777:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9169 00000100:00100000:1.0:1763343034.263598:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.263751:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993504512 00000100:00100000:3.0:1763343034.263764:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993504512 00010000:00010000:3.0:1763343034.263813:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d200/0x607405d401ae5efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd1 expref: 20 pid: 28648 timeout: 1327 lvb_type: 0 00000100:00100000:3.0:1763343034.263856:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3020 00000100:00100000:3.0:1763343034.263867:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2431:x1848997993504512:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343034.263884:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1763343034.263903:0:13199:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:3.0:1763343034.263907:0:13199:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763343034.263913:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665d200/0x607405d401ae5efe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd1 expref: 20 pid: 28648 timeout: 1327 lvb_type: 0 00010000:00010000:3.0:1763343034.263927:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665d200/0x607405d401ae5efe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd1 expref: 20 pid: 28648 timeout: 1327 lvb_type: 0 00010000:00010000:3.0:1763343034.264550:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d200/0x607405d401ae5efe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd1 expref: 20 pid: 28648 timeout: 1327 lvb_type: 0 00010000:00010000:3.0:1763343034.264569:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.264572:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.264577:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5f9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.264588:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5f9f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.264652:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343034.264714:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2431:x1848997993504512:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 848us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.264723:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3020 00010000:00010000:2.0:1763343034.265219:0:8410:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5f9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.265240:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5f9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.265875:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5f9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.265888:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5f9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.265898:0:8410:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5f9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.265907:0:8410:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665da00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343034.265911:0:8410:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5f9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.265921:0:8410:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5f9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.265959:0:8410:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5f9f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.265969:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665da00/0x607405d401ae5f9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343034.266195:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.266293:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993504640 00000100:00100000:1.0:1763343034.266302:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993504640 00000100:00100000:1.0:1763343034.266366:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9170 00000100:00100000:1.0:1763343034.266375:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56858:x1848997993504640:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343034.266394:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.266416:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5fd0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9017 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.266494:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5fd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.266507:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343034.268169:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2432:x1848997993504000:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 31367us (31685us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.268187:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6424 00010000:00010000:1.0:1763343034.269117:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343034.269189:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343034.269196:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343034.269255:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae5fd0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9017 expref: 246 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.269280:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9017 expref: 245 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.269292:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdea00) 00010000:00010000:1.0:1763343034.269297:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343034.269302:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343034.269395:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56858:x1848997993504640:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3017us (3203us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343034.269410:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9170 00000100:00100000:1.0:1763343034.276125:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.276215:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993504768 00000100:00100000:0.0:1763343034.276227:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993504768 00000100:00100000:0.0:1763343034.276294:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9171 00000100:00100000:0.0:1763343034.276304:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56858:x1848997993504768:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343034.276324:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.276348:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae5fde lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac901e expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.276415:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae5fe5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276430:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae5fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276441:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae5fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276451:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae5fec lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276458:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae5fec lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276464:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae5fec lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276500:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae5fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276506:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae5fe5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276512:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae5fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276517:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343034.276520:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae5fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276527:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae5fe5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276539:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdea00) 00010000:00010000:0.0:1763343034.276542:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343034.276548:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae5fe5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276555:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae5fe5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276568:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae5fec lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276575:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae5fec lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276581:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae5fec lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276585:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343034.276588:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae5fec lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276594:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae5fec lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276601:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935200) 00010000:00010000:0.0:1763343034.276603:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343034.276606:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae5fec lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276610:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae5fec lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.276670:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae5fde lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac901e expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.276685:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdea00) 00010000:00010000:0.0:1763343034.276689:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343034.276693:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae5fde lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac901e expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.276708:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c400, rc 0) 00000100:00100000:0.0:1763343034.276784:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56858:x1848997993504768:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 480us (673us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343034.276792:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9171 00000100:00100000:1.0:1763343034.276954:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.277050:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993505024 00000100:00100000:0.0:1763343034.277055:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993505024 00000100:00100000:0.0:1763343034.277096:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9172 00000100:00100000:0.0:1763343034.277103:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56856:x1848997993505024:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343034.277132:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343034.277145:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae5f98 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9002 expref: 245 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.277154:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:0.0:1763343034.277158:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343034.277177:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae5ff3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.277186:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae5ff3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.277193:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae5ff3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:0.0:1763343034.277415:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1389, 88 off117520 00000004:00080000:0.0:1763343034.277423:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1227944802038ns, next at 1228493164729ns, rc = 0 00000040:00080000:0.0:1763343034.277464:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1388, 88 off117520 00000004:00080000:0.0:1763343034.277470:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1227944849630ns, next at 1228493192443ns, rc = 0 00000040:00080000:0.0:1763343034.277513:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1389, 88 off117608 00000004:00080000:0.0:1763343034.277518:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1227944897060ns, next at 1228493192443ns, rc = 0 00000040:00080000:0.0:1763343034.277535:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1390, 88 off117608 00000004:00080000:0.0:1763343034.277539:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1227944918266ns, next at 1228493164729ns, rc = 0 00000100:00100000:2.0:1763343034.280548:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.280669:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993505280 00000100:00100000:3.0:1763343034.280680:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993505280 00000100:00100000:3.0:1763343034.280734:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9173 00000100:00100000:3.0:1763343034.280745:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56858:x1848997993505280:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343034.280767:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.280770:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343034.280796:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae5fd7 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9017 expref: 246 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.280815:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdea00) 00010000:00010000:3.0:1763343034.280825:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343034.280843:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5ffa lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9025 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.281017:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6001 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.281031:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6001 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.281040:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6001 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.281052:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6008 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.281064:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6008 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.281071:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6008 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.281478:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae600f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.281489:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae600f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.281496:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae600f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343034.281506:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d5:0x0]: returning size 0 00010000:00010000:3.0:1763343034.281530:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6001 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.281536:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6001 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.281542:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6001 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.281548:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6001 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.281553:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343034.281557:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6001 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.281564:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6001 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.285067:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53ae00) 00010000:00010000:3.0:1763343034.285073:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343034.285080:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6001 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.285090:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6001 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00010000:3.0:1763343034.285111:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006ca861b9 reply state 00000000175ad12f transno 8589939845 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6008 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.285123:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6008 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.285129:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935200) 00010000:00010000:3.0:1763343034.285132:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343034.285135:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343034.285185:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae5ffa lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9025 expref: 248 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.285207:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae600f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9025 expref: 247 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.285214:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a350b53ac00) 00010000:00010000:3.0:1763343034.285216:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343034.285219:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92a00, rc 0) 00000100:00100000:3.0:1763343034.285293:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56858:x1848997993505280:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4550us (4754us total) trans 8589939845 rc 0/0 00000100:00100000:3.0:1763343034.285301:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9173 00000001:00080000:1.0:1763343034.286757:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939844 is committed 00000004:00080000:1.0:1763343034.286768:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 915 committed 00000004:00080000:1.0:1763343034.286783:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 916 committed 00000004:00080000:1.0:1763343034.286796:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 915 committed 00000004:00080000:1.0:1763343034.286799:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 914 committed 00010000:00010000:2.0:1763343034.286876:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae5f8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.286888:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae5f8a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.286895:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae5f8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.286901:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dcc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.286906:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae5f8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.286913:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae5f8a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.286926:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935200) 00010000:00010000:2.0:1763343034.286929:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.286933:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae5f8a lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.286948:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae5f8a lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343034.287167:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a0196c4d reply state 0000000040522247 transno 8589939844 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae5ff3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.287182:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae5ff3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.287189:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:0.0:1763343034.287192:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343034.287195:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1763343034.287292:0:28422:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343034.287307:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56856:x1848997993505024:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 10201us (10350us total) trans 8589939844 rc 0/0 00000100:00100000:0.0:1763343034.287315:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9172 00000100:00100000:2.0:1763343034.287430:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343034.287447:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010249344:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343034.287500:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343034.287578:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010249344 00000100:00100000:0.0:1763343034.287586:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010249344 00000100:00100000:0.0:1763343034.287661:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6425 00000100:00100000:0.0:1763343034.287670:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3657:x1848998010249344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343034.287795:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x295:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343034.287799:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x295:0x0] updating lvb mtime from disk: 1763343034 -> 1763343034 00002000:00010000:0.0:1763343034.287802:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x295:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.287804:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x295:0x0] updating lvb ctime from disk: 1763343034 -> 1763343034 00002000:00010000:0.0:1763343034.287807:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x295:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343034.287838:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:3657:x1848998010249344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 170us (338us total) trans 21474838850 rc 0/0 00000100:00100000:0.0:1763343034.287848:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6425 00000004:00080000:0.0:1763343034.287886:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34060adc00/2, rc 0, transno 21474838850 00000100:00100000:0.0:1763343034.287892:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010249344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343034.288102:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010249472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343034.288130:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343034.289543:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae5ff3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.289557:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae5ff3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.289564:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae5ff3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.289569:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343034.289573:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae5ff3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.289581:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae5ff3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.289595:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:3.0:1763343034.289598:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343034.289602:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae5ff3 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.289607:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae5ff3 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343034.289809:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343034.289869:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010249728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343034.289907:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343034.289929:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010249600:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343034.290218:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010249472 00000100:00100000:2.0:1763343034.290226:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010249472 00000100:00100000:2.0:1763343034.290265:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6426 00000100:00100000:2.0:1763343034.290273:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+55:3659:x1848998010249472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763343034.290402:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1763343034.290645:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010249728 00000100:00100000:0.0:1763343034.290649:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010249728 00000100:00100000:0.0:1763343034.290672:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6427 00000100:00100000:0.0:1763343034.290677:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3657:x1848998010249728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343034.290740:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343034.290743:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.290746:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.290748:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.290750:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343034.290786:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3657:x1848998010249728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (878us total) trans 17179871551 rc 0/0 00000100:00100000:0.0:1763343034.290793:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6427 00000004:00080000:0.0:1763343034.290831:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34060ace00/2, rc 0, transno 17179871551 00000100:00100000:0.0:1763343034.290837:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010249728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343034.290916:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1763343034.291380:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343034.291384:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343034.291386:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343034.291388:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343034.291428:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3659:x1848998010249472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1154us (3295us total) trans 21474838851 rc 0/0 00000100:00100000:2.0:1763343034.291434:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6426 00000100:00100000:2.0:1763343034.291446:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010249600 00000100:00100000:2.0:1763343034.291449:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010249600 00000100:00100000:2.0:1763343034.291468:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6428 00000100:00100000:2.0:1763343034.291473:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3659:x1848998010249600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343034.291545:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3659:x1848998010249600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (629us total) trans 17179871552 rc 0/0 00000100:00100000:2.0:1763343034.291551:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6428 00000004:00080000:2.0:1763343034.291575:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34060af100/2, rc 0, transno 17179871552 00000100:00100000:2.0:1763343034.291579:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010249600:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343034.291589:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34060afb80/2, rc 0, transno 21474838851 00000100:00100000:2.0:1763343034.291593:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010249472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343034.291734:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.291850:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993505536 00000100:00100000:2.0:1763343034.291854:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993505536 00000100:00100000:2.0:1763343034.291911:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9174 00000100:00100000:2.0:1763343034.291918:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56858:x1848997993505536:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.291932:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.291960:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae601d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac902c expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.292072:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6024 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.292087:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae600f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9025 expref: 240 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.292096:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6024 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.292123:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae600f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9025 expref: 240 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.292136:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae600f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9025 expref: 240 pid: 10041 timeout: 1327 lvb_type: 0 00000100:00100000:2.0:1763343034.292148:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010249856:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343034.292735:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509bdf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343034.293503:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.294060:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993505664 00000100:00100000:3.0:1763343034.294071:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993505664 00000100:00100000:3.0:1763343034.294331:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9175 00000100:00100000:3.0:1763343034.294342:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56856:x1848997993505664:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343034.294365:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.294383:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae602b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9033 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.294435:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae602b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9033 expref: 242 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.294453:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae602b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9033 expref: 242 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.294471:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:3.0:1763343034.294475:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343034.294479:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93a00, rc 0) 00000100:00100000:3.0:1763343034.294537:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56856:x1848997993505664:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 197us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.294545:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9175 00000100:00100000:1.0:1763343034.300541:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.300583:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.300723:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010249856:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343034.300751:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6024 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343034.300826:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993505792 00000100:00100000:3.0:1763343034.300834:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993505792 00000100:00100000:3.0:1763343034.300885:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9176 00000100:00100000:3.0:1763343034.300892:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56856:x1848997993505792:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343034.300909:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.300925:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6032 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac903a expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.300997:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6039 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.301011:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6039 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.301020:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6039 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343034.301057:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d4:0x0]: returning size 5 00000004:00200000:3.0:1763343034.301061:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343034.301079:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6039 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.301100:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6032 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac903a expref: 244 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.301114:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6039 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac903a expref: 243 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.301123:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:3.0:1763343034.301126:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763343034.301129:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343034.301172:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56856:x1848997993505792:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 280us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.301178:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9176 00000100:00100000:0.0:1763343034.301359:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993505920 00000100:00100000:0.0:1763343034.301363:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993505920 00010000:00010000:0.0:1763343034.301382:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae600f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9025 expref: 243 pid: 10041 timeout: 1327 lvb_type: 0 00000100:00100000:0.0:1763343034.301616:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3021 00000100:00100000:0.0:1763343034.301649:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:2429:x1848997993505920:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343034.301659:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343034.301664:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae600f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9025 expref: 243 pid: 10041 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.301675:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae600f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9025 expref: 243 pid: 10041 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.301688:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae600f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9025 expref: 243 pid: 10041 timeout: 1327 lvb_type: 0 00010000:00010000:0.0:1763343034.301697:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a350b53ac00) 00010000:00010000:0.0:1763343034.301701:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6024 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.301709:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6024 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.301715:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6024 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.301735:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343034.302215:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:2429:x1848997993505920:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 564us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.302223:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3021 00010000:00010000:3.0:1763343034.303090:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6024 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.303101:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6024 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343034.303121:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d5:0x0]: returning size 0 00000004:00080000:3.0:1763343034.303270:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x297:0x0], index 0: 0 00000004:00080000:3.0:1763343034.303277:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x299:0x0], index 1: 0 00000004:00080000:3.0:1763343034.303280:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x29a:0x0], index 1: 0 00000004:00080000:3.0:1763343034.303283:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x298:0x0], index 0: 0 00010000:00010000:3.0:1763343034.303371:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6024 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.303379:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6024 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.303390:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6024 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.303395:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343034.303399:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6024 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.303405:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6024 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.303417:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a350b53ac00) 00010000:00010000:3.0:1763343034.303419:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343034.303422:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6024 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.303428:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6024 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.303470:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae601d lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac902c expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.303478:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a350b53ac00) 00010000:00010000:3.0:1763343034.303480:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343034.303483:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae601d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac902c expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.303495:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd800, rc 0) 00000100:00100000:3.0:1763343034.303551:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56858:x1848997993505536:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 11634us (11819us total) trans 8589939846 rc 301/301 00000100:00100000:3.0:1763343034.303558:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9174 00000100:00100000:1.0:1763343034.309466:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.315576:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.318055:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993506048 00000100:00100000:0.0:1763343034.318070:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993506048 00000100:00100000:0.0:1763343034.318139:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6429 00000100:00100000:0.0:1763343034.318150:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993506048:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343034.318168:0:15756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.318191:0:15756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae6047 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9041 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343034.318215:0:15756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x297:0x0] initial LVB size: 5, mtime: 0x691a7aba, atime: 0x0, ctime: 0x691a7aba, blocks: 0x8 00010000:00010000:0.0:1763343034.318237:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.318240:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.318249:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae6047 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9041 expref: 19 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343034.318266:0:15756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae6047 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9041 expref: 19 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343034.318277:0:15756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c200, rc 0) 00000100:00100000:0.0:1763343034.318338:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993506048:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 189us (2771us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.318345:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6429 00000100:00100000:2.0:1763343034.318720:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993506304 00000100:00100000:2.0:1763343034.318726:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993506304 00000100:00100000:2.0:1763343034.319089:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3119 00000100:00100000:2.0:1763343034.319097:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56858:x1848997993506304:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343034.319347:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56858:x1848997993506304:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 250us (9889us total) trans 8589939847 rc 0/0 00000100:00100000:2.0:1763343034.319358:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3119 00000100:00100000:1.0:1763343034.324580:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.330172:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993506560 00000100:00100000:0.0:1763343034.330188:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993506560 00000100:00100000:0.0:1763343034.330273:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3120 00000100:00100000:0.0:1763343034.330282:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fbb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56858:x1848997993506560:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343034.330542:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fbb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56858:x1848997993506560:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 259us (5971us total) trans 8589939848 rc 0/0 00000100:00100000:0.0:1763343034.330550:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3120 00000100:00100000:1.0:1763343034.337079:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.338286:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993506816 00000100:00100000:0.0:1763343034.338298:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993506816 00000100:00100000:0.0:1763343034.342305:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9177 00000100:00100000:0.0:1763343034.342331:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:55941:x1848997993506816:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343034.342361:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.342387:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae604e lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9048 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.342553:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6055 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.342567:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6055 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.342580:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6055 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.342591:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae605c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.342598:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae605c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.342604:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae605c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.342680:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6063 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.342689:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6063 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.342697:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6063 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343034.343136:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d5:0x0]: returning size 0 00010000:00010000:0.0:1763343034.343217:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6055 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.343225:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6055 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.343230:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6055 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.343236:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343034.343240:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6055 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.343246:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6055 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.343257:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4c00) 00010000:00010000:0.0:1763343034.343260:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343034.343265:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6055 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.343270:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6055 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.343280:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae605c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.343285:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae605c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.343290:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae605c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.343299:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343034.343301:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae605c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.343306:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae605c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.343312:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935200) 00010000:00010000:0.0:1763343034.343314:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343034.343317:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae605c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.343322:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae605c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.343357:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae604e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9048 expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.343373:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6063 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9048 expref: 245 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.343381:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343034.343383:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343034.343386:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c400, rc 0) 00000100:00100000:0.0:1763343034.343447:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:55941:x1848997993506816:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1129us (6380us total) trans 8589939849 rc 0/0 00000100:00100000:0.0:1763343034.343455:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9177 00000100:00100000:1.0:1763343034.355231:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.356278:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993506944 00000100:00100000:0.0:1763343034.356290:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993506944 00000100:00100000:0.0:1763343034.356357:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9178 00000100:00100000:0.0:1763343034.356367:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:55941:x1848997993506944:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343034.356390:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.356412:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae6071 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac904f expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.356444:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6078 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.356456:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6078 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.356467:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6078 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.356578:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae6071 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac904f expref: 247 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.356594:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6078 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac904f expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.356602:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343034.356606:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343034.356610:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665cc00, rc 0) 00000100:00100000:0.0:1763343034.356705:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:55941:x1848997993506944:12345-192.168.204.21@tcp:101:bash.0 Request processed in 339us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.356712:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9178 00000100:00100000:1.0:1763343034.361381:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.361480:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993507200 00000100:00100000:2.0:1763343034.361491:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993507200 00000100:00100000:2.0:1763343034.361548:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9179 00000100:00100000:2.0:1763343034.361558:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:55941:x1848997993507200:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:2.0:1763343034.361608:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343034.361671:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6063 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9048 expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.361689:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:2.0:1763343034.361695:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343034.361876:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae607f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.361890:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae607f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.361900:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae607f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000001:00080000:2.0:1763343034.361958:0:6523:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939850 00000004:00010000:2.0:1763343034.361982:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000051c4e382 reply state 000000002368f555 transno 8589939851 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae607f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.361994:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae607f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.362000:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:2.0:1763343034.362003:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343034.362005:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343034.362086:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:55941:x1848997993507200:12345-192.168.204.21@tcp:36:bash.0 Request processed in 529us (715us total) trans 8589939851 rc 0/0 00000100:00100000:2.0:1763343034.362094:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9179 00000020:00080000:2.0:1763343034.362098:0:6523:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343034.366018:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.366118:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993507328 00000100:00100000:0.0:1763343034.366130:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993507328 00000100:00100000:0.0:1763343034.366193:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9180 00000100:00100000:0.0:1763343034.366207:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:55941:x1848997993507328:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343034.366234:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.366256:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae6086 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9056 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.366320:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae6086 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9056 expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.366337:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae6086 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9056 expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.366357:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343034.366361:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343034.366365:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d800, rc 0) 00000100:00100000:0.0:1763343034.366427:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:55941:x1848997993507328:12345-192.168.204.21@tcp:101:bash.0 Request processed in 222us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.366434:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9180 00000100:00100000:1.0:1763343034.375489:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.376567:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993507584 00000100:00100000:2.0:1763343034.376586:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993507584 00000100:00100000:3.0:1763343034.377598:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9181 00000100:00100000:3.0:1763343034.377614:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:55941:x1848997993507584:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343034.377695:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.377698:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343034.377741:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae6086 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9056 expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.377768:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:3.0:1763343034.377776:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343034.377795:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae608d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac905d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.377867:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6094 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343034.377883:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6094 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343034.377894:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6094 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:3.0:1763343034.378219:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1390, 88 off117696 00000004:00080000:3.0:1763343034.378229:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1228045607432ns, next at 1228493192443ns, rc = 0 00000040:00080000:3.0:1763343034.380949:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1391, 88 off117696 00000004:00080000:3.0:1763343034.380984:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228048361958ns, next at 1228493164729ns, rc = 0 00000040:00080000:3.0:1763343034.381215:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1392, 88 off117784 00000004:00080000:3.0:1763343034.381223:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228048601826ns, next at 1228493164729ns, rc = 0 00000040:00080000:3.0:1763343034.381250:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1391, 88 off117784 00000004:00080000:3.0:1763343034.381255:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1228048634648ns, next at 1228493192443ns, rc = 0 00000001:00080000:3.0:1763343034.384315:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939852 is committed 00000004:00080000:3.0:1763343034.384343:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 918 committed 00000004:00080000:3.0:1763343034.384349:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 917 committed 00000004:00080000:3.0:1763343034.384352:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 916 committed 00000004:00080000:3.0:1763343034.384354:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 917 committed 00010000:00010000:3.0:1763343034.384462:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6094 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac905d expref: 243 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.384480:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:3.0:1763343034.384484:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343034.384510:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae608d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac905d expref: 243 pid: 6523 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763343034.384534:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6094 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d5:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac905d expref: 242 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.384574:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:3.0:1763343034.384577:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343034.384580:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00010000:00010000:0.0:1763343034.384649:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6008 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.384660:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6008 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.384666:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6008 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.384672:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343034.384678:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6008 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.384693:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6008 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343034.384698:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:55941:x1848997993507584:12345-192.168.204.21@tcp:101:bash.0 Request processed in 7084us (9225us total) trans 8589939852 rc 0/0 00010000:00010000:0.0:1763343034.384704:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935200) 00010000:00010000:0.0:1763343034.384707:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343034.384709:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9181 00010000:00010000:0.0:1763343034.384712:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6008 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.384718:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6008 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.384740:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae607f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.384748:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae607f lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.384754:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae607f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.384761:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dcc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343034.384765:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae607f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.384771:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae607f lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.384779:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343034.384782:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343034.384785:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae607f lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.384791:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae607f lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:1.0:1763343034.384827:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010249984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343034.384898:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010250112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343034.384907:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343034.384954:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343034.384995:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010249984 00000100:00100000:1.0:1763343034.385005:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010249984 00000100:00100000:3.0:1763343034.385009:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010250112 00000100:00100000:3.0:1763343034.385015:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010250112 00000100:00100000:1.0:1763343034.385056:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6430 00000100:00100000:1.0:1763343034.385066:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3658:x1848998010249984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343034.385144:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6431 00000100:00100000:3.0:1763343034.385153:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3659:x1848998010250112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343034.385306:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3658:x1848998010249984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 241us (400us total) trans 17179871553 rc 0/0 00000100:00100000:1.0:1763343034.385312:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6430 00000004:00080000:1.0:1763343034.385359:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b9180/2, rc 0, transno 17179871553 00000100:00100000:1.0:1763343034.385366:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010249984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343034.386956:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3659:x1848998010250112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1785us (1984us total) trans 17179871554 rc 0/0 00000100:00100000:3.0:1763343034.386971:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6431 00000004:00080000:0.0:1763343034.387119:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095bbb80/2, rc 0, transno 17179871554 00000100:00100000:0.0:1763343034.387128:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010250112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343034.387466:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.387547:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993507712 00000100:00100000:3.0:1763343034.387557:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993507712 00000100:00100000:0.0:1763343034.387803:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010250240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343034.387853:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010250368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343034.387858:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343034.388190:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010250240 00000100:00100000:3.0:1763343034.388196:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010250240 00000100:00100000:3.0:1763343034.388228:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6432 00000100:00100000:3.0:1763343034.388238:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993507712:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:1.0:1763343034.388425:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6433 00000100:00100000:1.0:1763343034.388436:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:3660:x1848998010250240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343034.388926:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993507712:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 686us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.388947:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6432 00000100:00100000:1.0:1763343034.389064:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3660:x1848998010250240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 629us (1206us total) trans 21474838852 rc 0/0 00000100:00100000:1.0:1763343034.389072:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6433 00000100:00100000:1.0:1763343034.389192:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000004:00080000:0.0:1763343034.389292:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a4e00/2, rc 0, transno 21474838852 00000100:00100000:0.0:1763343034.389300:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010250240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343034.389321:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993507840 00000100:00100000:1.0:1763343034.389328:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993507840 00000100:00100000:1.0:1763343034.389379:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6434 00000100:00100000:1.0:1763343034.389388:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:55941:x1848997993507840:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343034.389404:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.389431:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae609b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9064 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343034.389458:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x297:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343034.389482:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343034.389485:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343034.389497:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae609b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9064 expref: 31 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.389518:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae609b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9064 expref: 31 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.389532:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:1.0:1763343034.389580:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:55941:x1848997993507840:12345-192.168.204.21@tcp:101:bash.0 Request processed in 193us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343034.389587:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6434 00000100:00100000:2.0:1763343034.390069:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343034.390093:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010250368 00000100:00100000:3.0:1763343034.390101:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010250368 00000100:00100000:3.0:1763343034.390138:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6435 00000100:00100000:3.0:1763343034.390147:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3657:x1848998010250368:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763343034.395163:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a7480/2, rc 0, transno 21474838853 00000100:00100000:2.0:1763343034.395183:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010250368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343034.395276:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3657:x1848998010250368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5127us (5205us total) trans 21474838853 rc 0/0 00000100:00100000:3.0:1763343034.395292:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6435 00000100:00100000:1.0:1763343034.395445:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.395521:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993507968 00000100:00100000:3.0:1763343034.395529:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993507968 00000100:00100000:3.0:1763343034.395588:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6436 00000100:00100000:3.0:1763343034.395598:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993507968:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:3.0:1763343034.395824:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993507968:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 227us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.395832:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6436 00000100:00100000:0.0:1763343034.406779:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.409769:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993508096 00000100:00100000:3.0:1763343034.409792:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993508096 00000100:00100000:2.0:1763343034.410460:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6437 00000100:00100000:2.0:1763343034.410475:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:55941:x1848997993508096:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343034.410503:0:8410:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.410539:0:8410:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae60a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac906b expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343034.410576:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x299:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343034.410610:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.410614:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.410670:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae60a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac906b expref: 20 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.410693:0:8410:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae60a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac906b expref: 20 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.410710:0:8410:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058ddc00, rc 0) 00000100:00100000:2.0:1763343034.410804:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:55941:x1848997993508096:12345-192.168.204.21@tcp:101:bash.0 Request processed in 331us (4041us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.410814:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6437 00000100:00100000:1.0:1763343034.411515:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.412682:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993508224 00000100:00100000:2.0:1763343034.412698:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993508224 00000100:00100000:2.0:1763343034.413262:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1574 00000100:00100000:2.0:1763343034.413276:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2432:x1848997993508224:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:2.0:1763343034.413327:0:28424:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae60a9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.413347:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.413349:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.413356:0:28424:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae60a9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.413372:0:28424:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae60a9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.413876:0:28424:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae60a9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.413886:0:28424:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae60a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.413894:0:28424:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae60a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.413900:0:28424:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343034.413904:0:28424:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae60a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.413918:0:28424:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae60a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.413945:0:28424:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae60a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.413951:0:28424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae60a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343034.414042:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2432:x1848997993508224:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 770us (2531us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763343034.414050:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1574 00000100:00100000:0.0:1763343034.414164:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.414307:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.414409:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993508352 00000100:00100000:2.0:1763343034.414416:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993508352 00002000:00010000:2.0:1763343034.414447:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/663 (0->18446744073709551615) 00002000:00100000:2.0:1763343034.414452:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060aca80 with x1848997993508352 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343034.414463:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34060aca80. 00000100:00100000:2.0:1763343034.414492:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993508480 00000100:00100000:2.0:1763343034.414495:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993508480 00002000:00010000:2.0:1763343034.414507:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/665 (0->18446744073709551615) 00002000:00100000:2.0:1763343034.414510:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060ac700 with x1848997993508480 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343034.414516:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34060ac700. 00000100:00100000:2.0:1763343034.414530:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1575 00000100:00100000:2.0:1763343034.414538:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993508352:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343034.414795:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x297:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343034.414799:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x297:0x0] updating lvb mtime from disk: 0 -> 1763343034 00002000:00010000:2.0:1763343034.414802:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x297:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343034.414805:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x297:0x0] updating lvb ctime from disk: 0 -> 1763343034 00002000:00010000:2.0:1763343034.414807:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x297:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343034.414844:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2430:x1848997993508352:12345-192.168.204.21@tcp:10:bash.0 Request processed in 307us (680us total) trans 21474838854 rc 0/0 00000100:00100000:2.0:1763343034.414852:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1575 00002000:00010000:2.0:1763343034.414856:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/663 (0->18446744073709551615) 00002000:00100000:2.0:1763343034.414859:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060aca80 with x1848997993508352 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343034.414863:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34060aca80. 00000100:00100000:2.0:1763343034.414877:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1576 00000100:00100000:2.0:1763343034.414884:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993508480:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343034.414992:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x299:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343034.414996:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x299:0x0] updating lvb mtime from disk: 0 -> 1763343034 00002000:00010000:2.0:1763343034.414998:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x299:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343034.415000:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x299:0x0] updating lvb ctime from disk: 0 -> 1763343034 00002000:00010000:2.0:1763343034.415002:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x299:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343034.415024:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993508480:12345-192.168.204.21@tcp:10:bash.0 Request processed in 140us (717us total) trans 17179871555 rc 0/0 00000100:00100000:2.0:1763343034.415031:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1576 00002000:00010000:2.0:1763343034.415034:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/665 (0->18446744073709551615) 00002000:00100000:2.0:1763343034.415037:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060ac700 with x1848997993508480 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343034.415041:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34060ac700. 00000100:00100000:0.0:1763343034.418579:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.419984:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993508608 00000100:00100000:3.0:1763343034.420002:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993508608 00000100:00100000:2.0:1763343034.420376:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9182 00000100:00100000:2.0:1763343034.420388:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56856:x1848997993508608:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.420421:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.420452:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae60b0 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9072 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.420494:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dde00/0x607405d401ae60b7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.420510:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dde00/0x607405d401ae60b7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.420523:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dde00/0x607405d401ae60b7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.420701:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae60b0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9072 expref: 242 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.420721:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dde00/0x607405d401ae60b7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9072 expref: 241 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.420731:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343034.420734:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343034.420738:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dde00, rc 0) 00000100:00100000:2.0:1763343034.420826:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56856:x1848997993508608:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 439us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.420835:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9182 00000100:00100000:1.0:1763343034.420894:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.423139:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993508864 00000100:00100000:2.0:1763343034.423158:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993508864 00000100:00100000:2.0:1763343034.423228:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3121 00000100:00100000:2.0:1763343034.423246:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:55941:x1848997993508864:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:2.0:1763343034.423683:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:55941:x1848997993508864:12345-192.168.204.21@tcp:35:bash.0 Request processed in 442us (2787us total) trans 8589939853 rc 0/0 00000100:00100000:2.0:1763343034.423696:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3121 00000100:00100000:1.0:1763343034.432137:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.436441:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993508992 00000100:00100000:0.0:1763343034.436463:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993508992 00000100:00100000:0.0:1763343034.436607:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1577 00000100:00100000:0.0:1763343034.436770:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2429:x1848997993508992:12345-192.168.204.21@tcp:4:lfs.0 00010000:00010000:0.0:1763343034.436827:0:24024:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae60be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.436854:0:24024:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae5e72 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa0 expref: 32 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343034.436863:0:24024:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.436866:0:24024:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.436870:0:24024:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae60be lrc: 4/0,1 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.436917:0:24024:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae5e72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa0 expref: 32 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343034.436947:0:24024:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae5e72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa0 expref: 32 pid: 28996 timeout: 1328 lvb_type: 1 00000100:00100000:0.0:1763343034.436968:0:24024:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0000_UUID:24024:1848998010250496:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343034.437091:0:24024:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404bf3840 going to sleep for 11 seconds 00000100:00100000:1.0:1763343034.440401:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.440565:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993509120 00000100:00100000:3.0:1763343034.440579:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993509120 00010000:00010000:3.0:1763343034.440672:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae5e72 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa0 expref: 33 pid: 28996 timeout: 1328 lvb_type: 1 00000100:00100000:3.0:1763343034.440796:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3022 00000100:00100000:3.0:1763343034.440809:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+33:2429:x1848997993509120:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343034.440830:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343034.440874:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae5e72 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa0 expref: 33 pid: 28996 timeout: 1328 lvb_type: 1 00010000:00010000:3.0:1763343034.440891:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae5e72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa0 expref: 33 pid: 28996 timeout: 1328 lvb_type: 1 00010000:00010000:3.0:1763343034.440925:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.440927:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.440942:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae60be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.440955:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae60be lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.440981:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343034.441051:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+33:2429:x1848997993509120:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 243us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.441061:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3022 00010000:00010000:0.0:1763343034.441839:0:24024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae5e72 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa0 expref: 32 pid: 28996 timeout: 1328 lvb_type: 1 00000100:00100000:0.0:1763343034.441861:0:24024:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_008:lustre-OST0000_UUID:24024:1848998010250496:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343034.441892:0:24024:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae60be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.441904:0:24024:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae60be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.441911:0:24024:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae60be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1763343034.448431:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838855 is committed 00000001:00080000:1.0:1763343034.448456:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838853 is committed 00002000:00010000:0.0:1763343034.448943:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763343034.448949:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb mtime from disk: 0 -> 1763343034 00002000:00010000:0.0:1763343034.448951:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb ctime from disk: 0 -> 1763343034 00002000:00010000:0.0:1763343034.448953:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763343034.448972:0:24024:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae60be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.448993:0:24024:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae60be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.449002:0:24024:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae60be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.449009:0:24024:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343034.449014:0:24024:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae60be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.449023:0:24024:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae60be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.449047:0:24024:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae60be lrc: 2/0,0 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.449055:0:24024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665ce00/0x607405d401ae60be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343034.449425:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2429:x1848997993508992:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 12798us (17295us total) trans 21474838855 rc 0/0 00000100:00100000:0.0:1763343034.449439:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1577 00000100:00100000:1.0:1763343034.454954:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.455106:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993509248 00000100:00100000:3.0:1763343034.455122:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993509248 00000100:00100000:3.0:1763343034.455249:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9183 00000100:00100000:3.0:1763343034.455261:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56859:x1848997993509248:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:3.0:1763343034.455482:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.455516:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae60c5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9079 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.455613:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae60cc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.455774:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae60cc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.455788:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae60cc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.455806:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae60d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.455813:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae60d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.455819:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae60d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.455914:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae60da lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.455923:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae60da lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.455929:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae60da lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343034.455992:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d5:0x0]: returning size 5 00000004:00200000:3.0:1763343034.455997:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343034.456020:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae60da lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456033:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae60da lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456043:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae60cc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456050:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae60cc lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456058:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae60cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456065:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343034.456070:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae60cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456078:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae60cc lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456091:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8a00) 00010000:00010000:3.0:1763343034.456094:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343034.456099:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae60cc lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456106:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae60cc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456118:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae60d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456125:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae60d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456132:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae60d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456136:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343034.456139:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae60d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456144:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae60d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456150:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8900) 00010000:00010000:3.0:1763343034.456152:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343034.456154:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae60d3 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456160:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae60d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.456193:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae60c5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9079 expref: 244 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.456208:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae60da lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9079 expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.456215:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:3.0:1763343034.456217:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343034.456219:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93600, rc 0) 00000100:00100000:3.0:1763343034.457817:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56859:x1848997993509248:12345-192.168.204.21@tcp:101:rm.0 Request processed in 2543us (2871us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.457834:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9183 00000100:00100000:3.0:1763343034.462367:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.462556:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993509504 00000100:00100000:2.0:1763343034.462571:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993509504 00000100:00100000:2.0:1763343034.462980:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9184 00000100:00100000:2.0:1763343034.462994:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56859:x1848997993509504:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:2.0:1763343034.463073:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343034.463112:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6094 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac905d expref: 243 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.463139:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae60da lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9079 expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.463154:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6078 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac904f expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.463167:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:2.0:1763343034.463180:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343034.463223:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae60e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.463239:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae60e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.463252:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae60e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.463266:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae60e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.463274:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae60e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.463281:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae60e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.463389:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae60ef lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.463398:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae60ef lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.463406:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae60ef lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:2.0:1763343034.465787:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1392, 64 off117848 00000040:00080000:2.0:1763343034.465821:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1393, 64 off117848 00000040:00080000:2.0:1763343034.465832:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1394, 64 off117912 00000040:00080000:2.0:1763343034.465841:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1393, 64 off117912 00010000:00010000:2.0:1763343034.465928:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae60f6 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.465977:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae60f6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.465992:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae60f6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466001:0:28422:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae60f6 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466008:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae60f6 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466014:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae60f6 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466044:0:28422:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343034.466074:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae60ef lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466080:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae60ef lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466086:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae60ef lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466092:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.466096:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae60ef lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466104:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae60ef lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466118:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a3518935200) 00010000:00010000:2.0:1763343034.466122:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343034.466128:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae60ef lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466134:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae60ef lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466296:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae60e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466303:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae60e1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466310:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae60e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466320:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.466323:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae60e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466330:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae60e1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466338:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935500) 00010000:00010000:2.0:1763343034.466341:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.466344:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae60e1 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466349:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae60e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:2.0:1763343034.466364:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009064d326 reply state 000000003ce36ed6 transno 8589939854 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae60e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466376:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae60e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.466382:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935e00) 00010000:00010000:2.0:1763343034.466384:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343034.466388:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343034.466525:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56859:x1848997993509504:12345-192.168.204.21@tcp:36:rm.0 Request processed in 3528us (4177us total) trans 8589939854 rc 0/0 00000100:00100000:2.0:1763343034.466537:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9184 00010000:00010000:3.0:1763343034.466789:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343034.466797:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae60f6 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1d5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.466804:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343034.466808:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae60f6 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1d5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.466815:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae60f6 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.466825:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d5:0x0].0x0 (ffff9a3518935200) 00010000:00010000:3.0:1763343034.466828:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343034.466830:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae60f6 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1d5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.466836:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae60f6 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.466852:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343034.466854:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343034.466856:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343034.483737:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.483815:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993509760 00000100:00100000:2.0:1763343034.483829:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993509760 00000100:00100000:3.0:1763343034.484463:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9185 00000100:00100000:3.0:1763343034.484479:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56856:x1848997993509760:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:3.0:1763343034.484561:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343034.484601:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6039 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac903a expref: 242 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.484682:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:3.0:1763343034.484690:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343034.484780:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae60fd lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343034.484798:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae60fd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343034.484810:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae60fd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00010000:3.0:1763343034.484974:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000061b57c8b reply state 0000000057c663c7 transno 8589939855 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae60fd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343034.484988:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae60fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343034.484995:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:3.0:1763343034.484998:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343034.485001:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343034.485125:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56856:x1848997993509760:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 650us (1400us total) trans 8589939855 rc 0/0 00000100:00100000:3.0:1763343034.485134:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9185 00000100:00100000:1.0:1763343034.488138:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.488488:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993509888 00000100:00100000:0.0:1763343034.488501:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993509888 00000100:00100000:0.0:1763343034.488580:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6438 00000100:00100000:0.0:1763343034.488591:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:56856:x1848997993509888:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343034.488617:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.488677:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae6104 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9080 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343034.488707:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x296:0x0] initial LVB size: 4096, mtime: 0x691a7aba, atime: 0x0, ctime: 0x691a7aba, blocks: 0x8 00010000:00010000:0.0:1763343034.488735:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.488738:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.488747:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae6104 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9080 expref: 12 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.488766:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae6104 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9080 expref: 12 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.488781:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d200, rc 0) 00000100:00100000:0.0:1763343034.488864:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:56856:x1848997993509888:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 274us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.488872:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6438 00000100:00100000:0.0:1763343034.492558:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.493099:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.493205:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993510016 00000100:00100000:2.0:1763343034.493219:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993510016 00000100:00100000:2.0:1763343034.493295:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6439 00000100:00100000:2.0:1763343034.493307:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:56856:x1848997993510016:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.493334:0:8410:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.493361:0:8410:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd400/0x607405d401ae610b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9087 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.493405:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5e79 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa7 expref: 22 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343034.493415:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.493417:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.493422:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd400/0x607405d401ae610b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9087 expref: 22 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.493465:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5e79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa7 expref: 22 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343034.493481:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5e79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa7 expref: 22 pid: 28996 timeout: 1328 lvb_type: 1 00000100:00100000:2.0:1763343034.493498:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340465ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1848998010250624:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343034.493596:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35012ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343034.494878:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993510144 00000100:00100000:3.0:1763343034.494891:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993510144 00000100:00100000:2.0:1763343034.495243:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9186 00000100:00100000:2.0:1763343034.495255:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56860:x1848997993510144:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.495295:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.495323:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6112 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac908e expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.495410:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae6119 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495428:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae6119 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495442:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae6119 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495454:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae6120 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495462:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae6120 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495469:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae6120 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495525:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae6119 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495533:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae6119 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495540:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae6119 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495547:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.495552:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae6119 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495560:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae6119 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495578:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935500) 00010000:00010000:2.0:1763343034.495582:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.495588:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae6119 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495595:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae6119 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495611:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae6120 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495618:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae6120 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495681:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae6120 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495687:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dcc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.495690:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae6120 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495696:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae6120 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495704:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935e00) 00010000:00010000:2.0:1763343034.495706:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.495709:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae6120 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495715:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae6120 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.495751:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6112 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac908e expref: 244 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.495763:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935500) 00010000:00010000:2.0:1763343034.495766:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.495770:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6112 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac908e expref: 244 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.495786:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd200, rc 0) 00000100:00100000:2.0:1763343034.495861:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56860:x1848997993510144:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 608us (2762us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343034.495870:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9186 00000100:00100000:1.0:1763343034.500176:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.500605:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.500664:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340465ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1848998010250624:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343034.500716:0:8410:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd400/0x607405d401ae610b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9087 expref: 22 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343034.500728:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993510272 00000100:00100000:0.0:1763343034.500740:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993510272 00010000:00010000:3.0:1763343034.500753:0:8410:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd400, rc 0) 00010000:00010000:0.0:1763343034.500790:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5e79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa7 expref: 23 pid: 28996 timeout: 1328 lvb_type: 1 00000100:00100000:3.0:1763343034.500837:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:56856:x1848997993510016:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 7530us (8294us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.500842:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3023 00000100:00100000:0.0:1763343034.500857:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993510272:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1763343034.500864:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6439 00010000:00010000:0.0:1763343034.500878:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343034.500907:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5e79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x298:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa7 expref: 22 pid: 28996 timeout: 1328 lvb_type: 1 00010000:00010000:0.0:1763343034.500922:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5e79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x298:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa7 expref: 22 pid: 28996 timeout: 1328 lvb_type: 1 00010000:00010000:0.0:1763343034.500975:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93e00/0x607405d401ae5e79 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x298:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fa7 expref: 22 pid: 28996 timeout: 1328 lvb_type: 1 00010000:00010000:0.0:1763343034.500992:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.500994:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.501001:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd400/0x607405d401ae610b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9087 expref: 21 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.501014:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd400/0x607405d401ae610b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9087 expref: 21 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.501057:0:13199:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd400/0x607405d401ae610b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9087 expref: 21 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343034.501073:0:13199:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13199:1848998010250752:192.168.204.21@tcp:105: 00000100:00100000:0.0:1763343034.501163:0:13199:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404bf3840 going to sleep for 11 seconds 00000100:00100000:2.0:1763343034.502957:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993510400 00000100:00100000:2.0:1763343034.502975:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993510400 00000100:00100000:2.0:1763343034.503131:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9187 00000100:00100000:2.0:1763343034.503144:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56860:x1848997993510400:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.503170:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.503201:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae6127 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9095 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.503299:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae612e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503318:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae612e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503333:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae612e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503346:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6135 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503472:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6135 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503482:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6135 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503538:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae612e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503545:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae612e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503563:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae612e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503570:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae612e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503576:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.503581:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae612e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503589:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae612e lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503603:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935100) 00010000:00010000:2.0:1763343034.503607:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.503614:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae612e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503657:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae612e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503683:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6135 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503692:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6135 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503697:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6135 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503702:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.503705:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6135 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503711:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6135 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503718:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935e00) 00010000:00010000:2.0:1763343034.503721:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.503724:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6135 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503729:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6135 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.503758:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae6127 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9095 expref: 244 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.503770:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935100) 00010000:00010000:2.0:1763343034.503772:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.503776:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae6127 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9095 expref: 244 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.503791:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc600, rc 0) 00000100:00100000:2.0:1763343034.503876:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56860:x1848997993510400:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 733us (3271us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343034.503885:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9187 00000100:00100000:3.0:1763343034.505117:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.505163:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.505288:0:13199:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13199:1848998010250752:192.168.204.21@tcp:105: 00010000:00010000:0.0:1763343034.505315:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343034.505366:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993510272:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 4512us (5209us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.505377:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3023 00000100:00100000:1.0:1763343034.505570:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993510656 00000100:00100000:1.0:1763343034.505580:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993510656 00002000:00010000:1.0:1763343034.505650:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/664 (0->18446744073709551615) 00002000:00100000:1.0:1763343034.505655:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537912a00 with x1848997993510656 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343034.505668:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537912a00. 00000100:00100000:1.0:1763343034.505692:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993510528 00000100:00100000:1.0:1763343034.505695:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993510528 00002000:00010000:1.0:1763343034.505709:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/662 (5->18446744073709551615) 00002000:00100000:1.0:1763343034.505712:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537911500 with x1848997993510528 ext(5->18446744073709551615) 00002000:00010000:1.0:1763343034.505720:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537911500. 00000100:00100000:1.0:1763343034.505744:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1578 00000100:00100000:1.0:1763343034.505753:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993510656:12345-192.168.204.21@tcp:10:lfs.0 00000100:00100000:2.0:1763343034.505949:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1579 00000100:00100000:2.0:1763343034.505958:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2430:x1848997993510528:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:1.0:1763343034.506476:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343034.506481:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb mtime from disk: 0 -> 1763343034 00002000:00010000:1.0:1763343034.506483:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343034.506486:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb ctime from disk: 0 -> 1763343034 00002000:00010000:1.0:1763343034.506488:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343034.506556:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993510656:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 803us (1448us total) trans 17179871556 rc 0/0 00000100:00100000:1.0:1763343034.506564:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1578 00002000:00010000:1.0:1763343034.506568:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/664 (0->18446744073709551615) 00002000:00100000:1.0:1763343034.506571:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537912a00 with x1848997993510656 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343034.506576:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537912a00. 00002000:00010000:2.0:1763343034.508004:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:2.0:1763343034.508013:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb mtime from disk: 1763343034 -> 1763343034 00002000:00010000:2.0:1763343034.508016:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343034.508018:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb ctime from disk: 1763343034 -> 1763343034 00002000:00010000:2.0:1763343034.508020:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343034.508086:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993510528:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 2124us (2917us total) trans 21474838856 rc 0/0 00000100:00100000:2.0:1763343034.508096:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1579 00002000:00010000:2.0:1763343034.508102:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/662 (5->18446744073709551615) 00002000:00100000:2.0:1763343034.508105:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537911500 with x1848997993510528 ext(5->18446744073709551615) 00002000:00010000:2.0:1763343034.508113:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537911500. 00000100:00100000:3.0:1763343034.510327:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.510486:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993510784 00000100:00100000:2.0:1763343034.510499:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993510784 00000100:00100000:2.0:1763343034.510578:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9188 00000100:00100000:2.0:1763343034.510589:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56860:x1848997993510784:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.510648:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.510680:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae613c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac909c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.510797:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae6143 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.510815:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae6143 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.510831:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae6143 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343034.510898:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343034.510905:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343034.510966:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae613c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac909c expref: 245 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.510994:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae6143 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac909c expref: 244 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.511007:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935200) 00010000:00010000:2.0:1763343034.511011:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343034.511016:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd000, rc 0) 00000100:00100000:2.0:1763343034.511216:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56860:x1848997993510784:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 627us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.511225:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9188 00000100:00100000:3.0:1763343034.523293:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.523351:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.523447:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993511040 00000100:00100000:0.0:1763343034.523463:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993511040 00000100:00100000:0.0:1763343034.523540:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993511168 00000100:00100000:0.0:1763343034.523543:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993511168 00000100:00100000:0.0:1763343034.523581:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9189 00000100:00100000:0.0:1763343034.523593:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56856:x1848997993511040:12345-192.168.204.21@tcp:36:lfs.0 00000100:00100000:3.0:1763343034.523653:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9190 00000100:00100000:3.0:1763343034.523663:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56860:x1848997993511168:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343034.523675:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.523703:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae614a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac90a3 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.523729:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6151 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.523747:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6151 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.523766:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6151 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.523806:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6158 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.523814:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6158 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.523821:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6158 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.523830:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae615f lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.523836:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae615f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.523843:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae615f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.523888:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6158 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.523894:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6158 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.523900:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6158 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.523907:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6158 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.523913:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343034.523918:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6158 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.523926:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6158 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00000004:00010000:0.0:1763343034.523943:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f369e885 reply state 00000000ce13eb5e transno 8589939856 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6151 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.523947:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935200) 00010000:00010000:3.0:1763343034.523951:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343034.523957:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6158 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.523957:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6151 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.523964:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:3.0:1763343034.523965:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6158 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.523966:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343034.523969:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343034.523978:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae615f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.523983:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae615f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.523988:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae615f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.523993:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343034.523996:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae615f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.524000:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae615f lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.524007:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935e00) 00010000:00010000:3.0:1763343034.524009:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343034.524011:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae615f lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.524016:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae615f lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.524038:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae614a lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90a3 expref: 248 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.524048:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935200) 00010000:00010000:3.0:1763343034.524050:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343034.524053:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae614a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90a3 expref: 248 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.524062:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:0.0:1763343034.524105:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56856:x1848997993511040:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 513us (827us total) trans 8589939856 rc 0/0 00000100:00100000:0.0:1763343034.524113:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9189 00000100:00100000:3.0:1763343034.524344:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56860:x1848997993511168:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 681us (991us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343034.524351:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9190 00000100:00100000:0.0:1763343034.531142:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.531260:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.531995:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993511552 00000100:00100000:1.0:1763343034.532012:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993511552 00000100:00100000:1.0:1763343034.532105:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9191 00000100:00100000:1.0:1763343034.532118:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56860:x1848997993511552:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343034.532152:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.532155:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343034.532191:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae6143 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac909c expref: 246 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.532217:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935200) 00010000:00010000:1.0:1763343034.532231:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343034.532251:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae6166 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac90aa expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.532392:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae616d lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.532408:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae616d lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.532419:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae616d lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.532431:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6174 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.532441:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6174 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.532447:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6174 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:3.0:1763343034.532879:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993511296 00000100:00100000:3.0:1763343034.532886:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993511296 00000100:00100000:3.0:1763343034.532958:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6440 00000100:00100000:3.0:1763343034.532969:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993511296:12345-192.168.204.21@tcp:2:lfs.0 00010000:00010000:1.0:1763343034.533037:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae617b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.533048:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae617b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.533056:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae617b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343034.533067:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d7:0x0]: returning size 0 00010000:00010000:1.0:1763343034.533101:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae616d lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.533108:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae616d lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.533115:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae616d lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.533123:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae616d lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.533130:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.533135:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae616d lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.533143:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae616d lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00002000:00010000:3.0:1763343034.533156:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb size from disk: 5 -> 5 00010000:00010000:1.0:1763343034.533159:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab700) 00002000:00010000:3.0:1763343034.533161:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb mtime from disk: 1763343034 -> 1763343034 00010000:00010000:1.0:1763343034.533165:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:3.0:1763343034.533166:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb atime from disk: 0 -> 1763343034 00002000:00010000:3.0:1763343034.533170:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb ctime from disk: 1763343034 -> 1763343034 00010000:00010000:1.0:1763343034.533172:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae616d lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00002000:00010000:3.0:1763343034.533173:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:1.0:1763343034.533183:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae616d lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:1.0:1763343034.533199:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004c9c0e07 reply state 00000000551005bb transno 8589939857 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6174 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.533212:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6174 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.533218:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935e00) 00010000:00010000:1.0:1763343034.533221:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343034.533224:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343034.533257:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae6166 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90aa expref: 248 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.533277:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae617b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90aa expref: 247 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.533285:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aabd00) 00010000:00010000:1.0:1763343034.533288:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343034.533290:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:2.0:1763343034.535034:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2429:x1848997993511296:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 2050us (3890us total) trans 17179871557 rc 0/0 00000100:00100000:2.0:1763343034.535053:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6440 00000100:00100000:1.0:1763343034.537343:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56860:x1848997993511552:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 5210us (6065us total) trans 8589939857 rc 0/0 00000100:00100000:1.0:1763343034.537358:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9191 00000100:00100000:0.0:1763343034.540846:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.540986:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993511808 00000100:00100000:1.0:1763343034.541002:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993511808 00000100:00100000:1.0:1763343034.541086:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3122 00000100:00100000:1.0:1763343034.541099:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56856:x1848997993511808:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:1.0:1763343034.541188:0:14879:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1d4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f75 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ffb expref: 248 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.541260:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343034.541277:0:14879:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae602b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9033 expref: 248 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.541289:0:14879:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343034.541333:0:14879:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae602b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9033 expref: 248 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.541348:0:14879:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae602b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9033 expref: 248 pid: 10041 timeout: 1328 lvb_type: 0 00000100:00100000:1.0:1763343034.541365:0:14879:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010250880:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343034.542082:0:14879:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe540 going to sleep for 11 seconds 00000100:00100000:0.0:1763343034.543550:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.543762:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993512064 00000100:00100000:1.0:1763343034.543776:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993512064 00000100:00100000:1.0:1763343034.544036:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9192 00000100:00100000:1.0:1763343034.544049:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56860:x1848997993512064:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343034.544083:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.544112:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6190 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac90b1 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.544261:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6197 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.544278:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae617b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90aa expref: 250 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.544290:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6197 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.544344:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae617b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90aa expref: 250 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.544358:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae617b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90aa expref: 250 pid: 10042 timeout: 1328 lvb_type: 0 00000100:00100000:1.0:1763343034.544376:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010251008:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343034.544487:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe240 going to sleep for 11 seconds 00000100:00100000:0.0:1763343034.548003:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.548138:0:14879:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010250880:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343034.548173:0:14879:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00000100:00100000:3.0:1763343034.548744:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993512192 00000100:00100000:3.0:1763343034.548755:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993512192 00010000:00010000:3.0:1763343034.548804:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae602b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9033 expref: 251 pid: 10041 timeout: 1328 lvb_type: 0 00000100:00100000:3.0:1763343034.548850:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3024 00000100:00100000:3.0:1763343034.548861:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:2429:x1848997993512192:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343034.548881:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343034.548890:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae602b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9033 expref: 251 pid: 10041 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343034.548903:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae602b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9033 expref: 251 pid: 10041 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343034.548930:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae602b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9033 expref: 251 pid: 10041 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343034.548961:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:3.0:1763343034.548967:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343034.548980:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343034.548988:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343034.549023:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343034.549090:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:2429:x1848997993512192:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 230us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.549099:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3024 00010000:00010000:2.0:1763343034.549219:0:14879:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343034.549228:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00000040:00080000:2.0:1763343034.550006:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1395, 88 off118000 00000004:00080000:2.0:1763343034.550018:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228217396749ns, next at 1228493164729ns, rc = 0 00000040:00080000:2.0:1763343034.550062:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1394, 88 off118000 00000004:00080000:2.0:1763343034.550068:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1228217446992ns, next at 1228493192443ns, rc = 0 00000040:00080000:2.0:1763343034.550086:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1395, 88 off118088 00000004:00080000:2.0:1763343034.550090:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1228217469071ns, next at 1228493192443ns, rc = 0 00000040:00080000:2.0:1763343034.550100:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1396, 88 off118088 00000004:00080000:2.0:1763343034.550104:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228217483058ns, next at 1228493164729ns, rc = 0 00000100:00100000:2.0:1763343034.551464:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.551464:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010251008:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343034.551496:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6197 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:3.0:1763343034.551832:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993512320 00000100:00100000:3.0:1763343034.551844:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993512320 00010000:00010000:2.0:1763343034.551975:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae617b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90aa expref: 251 pid: 10042 timeout: 1328 lvb_type: 0 00000100:00100000:2.0:1763343034.552022:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3025 00000100:00100000:2.0:1763343034.552033:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:2430:x1848997993512320:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343034.552056:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343034.552063:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae617b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90aa expref: 251 pid: 10042 timeout: 1328 lvb_type: 0 00010000:00010000:2.0:1763343034.552076:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae617b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90aa expref: 251 pid: 10042 timeout: 1328 lvb_type: 0 00010000:00010000:2.0:1763343034.552107:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae617b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90aa expref: 251 pid: 10042 timeout: 1328 lvb_type: 0 00010000:00010000:2.0:1763343034.552129:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aabd00) 00010000:00010000:2.0:1763343034.552134:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6197 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.552147:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6197 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.552156:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6197 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.552190:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343034.552247:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6197 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.552255:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6197 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:2.0:1763343034.552262:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:2430:x1848997993512320:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 231us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.552271:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3025 00000004:00200000:1.0:1763343034.552297:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d7:0x0]: returning size 0 00000004:00080000:1.0:1763343034.552554:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x29b:0x0], index 1: 0 00000004:00080000:1.0:1763343034.552565:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x299:0x0], index 0: 0 00000004:00080000:1.0:1763343034.552571:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x29a:0x0], index 0: 0 00000004:00080000:1.0:1763343034.552575:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x29c:0x0], index 1: 0 00010000:00010000:1.0:1763343034.552731:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6197 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.552758:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6197 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.552766:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6197 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.552772:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.552776:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6197 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.552785:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6197 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.552797:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aabd00) 00010000:00010000:1.0:1763343034.552800:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343034.552804:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6197 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.552810:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6197 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.552870:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6190 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90b1 expref: 250 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.552881:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aabd00) 00010000:00010000:1.0:1763343034.552883:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343034.552888:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6190 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90b1 expref: 250 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.552904:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:1.0:1763343034.552970:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56860:x1848997993512064:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8924us (9431us total) trans 8589939859 rc 301/301 00000100:00100000:1.0:1763343034.552978:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9192 00000100:00100000:2.0:1763343034.555857:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.555902:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993512576 00000100:00100000:1.0:1763343034.555916:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993512576 00000100:00100000:1.0:1763343034.556000:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3123 00000100:00100000:1.0:1763343034.556011:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56860:x1848997993512576:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343034.556392:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56860:x1848997993512576:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 381us (548us total) trans 8589939860 rc 0/0 00000100:00100000:1.0:1763343034.556399:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3123 00000001:00080000:0.0:1763343034.557614:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939858 is committed 00000004:00080000:0.0:1763343034.557648:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 919 committed 00000004:00080000:0.0:1763343034.557660:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 920 committed 00010000:00010000:2.0:1763343034.557664:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae60e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00000004:00080000:0.0:1763343034.557672:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 919 committed 00000004:00080000:0.0:1763343034.557677:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 918 committed 00010000:00010000:2.0:1763343034.557684:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae60e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.557694:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae60e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.557702:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.557707:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae60e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.557717:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae60e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.557738:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935e00) 00010000:00010000:2.0:1763343034.557742:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.557749:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae60e8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.557761:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae60e8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.557784:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae60fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.557790:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae60fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.557795:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae60fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.557801:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.557804:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae60fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.557810:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae60fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.557816:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343034.557819:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.557823:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae60fd lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.557829:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae60fd lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.557839:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6151 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.557843:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6151 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.557849:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6151 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.557854:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.557857:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6151 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.557864:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6151 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.557872:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343034.557875:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.557878:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6151 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.557883:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6151 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.557893:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6174 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.557899:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6174 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.557904:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6174 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.557908:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.557911:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6174 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.557916:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6174 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.557924:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935e00) 00010000:00010000:2.0:1763343034.557927:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.557930:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6174 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.557945:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6174 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000100:00100000:2.0:1763343034.558027:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010251136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343034.558105:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343034.558173:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010251264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343034.558203:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343034.558222:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010251648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343034.558232:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010251776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343034.558267:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343034.558271:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010251520:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343034.558346:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010251392:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343034.558387:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010251136 00000100:00100000:3.0:1763343034.558396:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010251136 00000100:00100000:3.0:1763343034.558442:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010251264 00000100:00100000:3.0:1763343034.558445:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010251264 00000100:00100000:3.0:1763343034.558464:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010251648 00000100:00100000:3.0:1763343034.558466:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010251648 00000100:00100000:3.0:1763343034.558489:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6441 00000100:00100000:3.0:1763343034.558499:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3658:x1848998010251136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343034.558537:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:663 count 1 00010000:00010000:3.0:1763343034.558566:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae61a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.558594:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae609b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9064 expref: 12 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.558603:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343034.558605:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343034.558610:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae61a5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343034.558769:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343034.558779:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010252032:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343034.558785:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1763343034.558832:0:14879:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a251f65d reply state 0000000052d1c964 transno 8589939858 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343034.558854:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343034.558862:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:0.0:1763343034.558868:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343034.558875:0:14879:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343034.558881:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:0.0:1763343034.558883:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343034.558889:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae5f75 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8ffb expref: 239 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.558902:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae609b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9064 expref: 12 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.558922:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae609b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9064 expref: 12 pid: 28648 timeout: 1328 lvb_type: 0 00000100:00100000:3.0:1763343034.558946:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010252160:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343034.561375:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343034.561420:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010251520 00000100:00100000:2.0:1763343034.561433:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010251520 00000100:00100000:1.0:1763343034.561450:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010252032 00000100:00100000:1.0:1763343034.561456:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010252032 00000100:00100000:2.0:1763343034.561496:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6442 00000100:00100000:2.0:1763343034.561508:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3659:x1848998010251264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343034.561550:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:664 count 1 00002000:00010000:2.0:1763343034.561615:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x298:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343034.561642:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae61ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.561660:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.561663:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.561670:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae61ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.561692:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae61ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.561702:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae61ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.561710:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae61ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.561731:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343034.562051:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3659:x1848998010251264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 545us (3846us total) trans 21474838857 rc 0/0 00000100:00100000:2.0:1763343034.562060:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6442 00000100:00100000:2.0:1763343034.562084:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6443 00000100:00100000:2.0:1763343034.562091:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3658:x1848998010251648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763343034.562208:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343034.562212:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb mtime from disk: 1763343034 -> 1763343034 00002000:00010000:2.0:1763343034.562214:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb atime from disk: 1763343034 -> 1763343034 00002000:00010000:2.0:1763343034.562217:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb ctime from disk: 1763343034 -> 1763343034 00002000:00010000:2.0:1763343034.562220:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x297:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343034.562256:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3658:x1848998010251648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 166us (3990us total) trans 17179871558 rc 0/0 00000100:00100000:2.0:1763343034.562263:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6443 00000100:00100000:2.0:1763343034.562276:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6444 00000100:00100000:2.0:1763343034.562283:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3657:x1848998010251520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343034.562296:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:666 count 1 00002000:00010000:2.0:1763343034.562314:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343034.562319:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae61b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.562328:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.562330:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.562333:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae61b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.562344:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae61b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.562352:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae61b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.562359:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae61b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.562380:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763343034.562503:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3657:x1848998010251520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 220us (3723us total) trans 17179871559 rc 0/0 00000100:00100000:2.0:1763343034.562510:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6444 00000100:00100000:2.0:1763343034.562529:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6445 00000100:00100000:2.0:1763343034.562538:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3658:x1848998010252032:12345-0@lo:2:osp-syn-0-0.0 00010000:00080000:0.0:1763343034.562567:0:14879:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763343034.562580:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343034.562592:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56856:x1848997993511808:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 21490us (21758us total) trans 8589939858 rc 0/0 00002000:00010000:2.0:1763343034.562600:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343034.562606:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb mtime from disk: 1763343034 -> 1763343034 00000100:00100000:0.0:1763343034.562606:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3122 00002000:00010000:2.0:1763343034.562612:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343034.562615:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb ctime from disk: 1763343034 -> 1763343034 00002000:00010000:2.0:1763343034.562639:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x296:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343034.562660:0:3659:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838853 gen 2 00000004:00080000:1.0:1763343034.562669:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406551c00, transno 21474838786 00010000:00010000:0.0:1763343034.562671:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00000100:00100000:2.0:1763343034.562675:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3658:x1848998010252032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (1312us total) trans 21474838858 rc 0/0 00000004:00080000:1.0:1763343034.562681:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406553800, transno 21474838787 00000004:00080000:1.0:1763343034.562688:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406552a00, transno 21474838788 00000100:00100000:2.0:1763343034.562693:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6445 00010000:00010000:0.0:1763343034.562693:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 00000004:00080000:1.0:1763343034.562695:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406552d80, transno 21474838789 00000004:00080000:1.0:1763343034.562702:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340664a680, transno 21474838790 00000004:00080000:1.0:1763343034.562708:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406648e00, transno 21474838791 00000100:00100000:2.0:1763343034.562713:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010251776 00010000:00010000:0.0:1763343034.562713:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00000004:00080000:1.0:1763343034.562714:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406648380, transno 21474838792 00000004:00080000:1.0:1763343034.562720:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406648000, transno 21474838793 00000100:00100000:2.0:1763343034.562722:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010251776 00010000:00010000:0.0:1763343034.562726:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00000004:00080000:1.0:1763343034.562728:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f38000, transno 21474838795 00000004:00080000:1.0:1763343034.562733:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f3b800, transno 21474838796 00010000:00010000:0.0:1763343034.562734:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00000004:00080000:1.0:1763343034.562736:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f3b100, transno 21474838797 00000004:00080000:1.0:1763343034.562742:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f38380, transno 21474838798 00000004:00080000:1.0:1763343034.562749:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537b0fb80, transno 21474838801 00010000:00010000:0.0:1763343034.562749:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 00000100:00100000:2.0:1763343034.562755:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6446 00000004:00080000:1.0:1763343034.562756:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537b0c380, transno 21474838802 00000004:00080000:1.0:1763343034.562764:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3404ba6d80, transno 21474838803 00000100:00100000:2.0:1763343034.562769:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3659:x1848998010251776:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763343034.562771:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d6680, transno 21474838804 00010000:00010000:0.0:1763343034.562775:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00000004:00080000:1.0:1763343034.562778:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c251500, transno 21474838808 00010000:00010000:0.0:1763343034.562781:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000004:00080000:1.0:1763343034.562784:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c250380, transno 21474838809 00000004:00080000:1.0:1763343034.562790:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c252d80, transno 21474838810 00010000:00010000:0.0:1763343034.562791:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00000004:00080000:1.0:1763343034.562793:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c251c00, transno 21474838811 00000004:00080000:1.0:1763343034.562799:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c250700, transno 21474838812 00010000:00010000:0.0:1763343034.562802:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6189 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00000004:00080000:1.0:1763343034.562804:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c252300, transno 21474838813 00000004:00080000:1.0:1763343034.562811:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406551880, transno 21474838814 00000004:00080000:1.0:1763343034.562817:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406550000, transno 21474838815 00000004:00080000:1.0:1763343034.562821:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478df80, transno 21474838817 00000004:00080000:1.0:1763343034.562827:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478e680, transno 21474838818 00000004:00080000:1.0:1763343034.562831:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478fb80, transno 21474838819 00002000:00010000:2.0:1763343034.562833:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:1.0:1763343034.562835:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478c000, transno 21474838820 00002000:00010000:2.0:1763343034.562838:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb mtime from disk: 1763343034 -> 1763343034 00000004:00080000:1.0:1763343034.562840:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340683aa00, transno 21474838822 00002000:00010000:2.0:1763343034.562844:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb atime from disk: 0 -> 0 00000004:00080000:1.0:1763343034.562847:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340683b100, transno 21474838823 00002000:00010000:2.0:1763343034.562848:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb ctime from disk: 1763343034 -> 1763343034 00000004:00080000:1.0:1763343034.562853:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3501219500, transno 21474838824 00002000:00010000:2.0:1763343034.562854:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x298:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:1.0:1763343034.562861:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a350121b800, transno 21474838825 00000004:00080000:1.0:1763343034.562866:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062f0e00, transno 21474838828 00000004:00080000:1.0:1763343034.562870:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062f2a00, transno 21474838829 00000100:00100000:2.0:1763343034.562890:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3659:x1848998010251776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (311us total) trans 17179871560 rc 0/0 00000004:00080000:1.0:1763343034.562891:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3501218380, transno 21474838831 00000004:00080000:1.0:1763343034.562898:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d6a00, transno 21474838832 00000100:00100000:2.0:1763343034.562902:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6446 00000004:00080000:1.0:1763343034.562904:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3409a4df80, transno 21474838836 00000004:00080000:1.0:1763343034.562911:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3409a4e680, transno 21474838837 00000004:00080000:1.0:1763343034.562915:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3409a4ce00, transno 21474838838 00000004:00080000:1.0:1763343034.562919:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3409a4c700, transno 21474838839 00000004:00080000:1.0:1763343034.562923:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3538755500, transno 21474838840 00000004:00080000:1.0:1763343034.562929:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3538754700, transno 21474838841 00010000:00010000:2.0:1763343034.562948:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000004:00080000:1.0:1763343034.562951:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537b0c700, transno 21474838842 00000100:00100000:3.0:1763343034.562953:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108ccc0 going to sleep for 11 seconds 00010000:00010000:2.0:1763343034.562957:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae61ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343034.562958:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537b0d500, transno 21474838843 00000004:00080000:1.0:1763343034.562965:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d10ea00, transno 21474838845 00010000:00010000:2.0:1763343034.562972:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc600 already unused, calling callback (ffffffffc0d8ab40) 00000004:00080000:1.0:1763343034.562972:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d10f800, transno 21474838846 00010000:00010000:2.0:1763343034.562980:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae61ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343034.562980:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d10dc00, transno 21474838847 00000004:00080000:1.0:1763343034.562987:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d10f480, transno 21474838848 00010000:00010000:2.0:1763343034.562994:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae61ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343034.562995:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34060adc00, transno 21474838850 00000004:00080000:1.0:1763343034.563002:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34060afb80, transno 21474838851 00000004:00080000:1.0:1763343034.563008:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a4e00, transno 21474838852 00000004:00080000:1.0:1763343034.563013:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a7480, transno 21474838853 00000100:00100000:1.0:1763343034.563026:0:3659:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a340d10d180 x1848998010251264/t21474838857(21474838857) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763343050 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1763343034.563027:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae61ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343034.563051:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d10d180/2, rc 0, transno 21474838857 00000100:00100000:1.0:1763343034.563059:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010251264:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763343034.563061:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae61ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343034.563085:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad0a80/2, rc 0, transno 17179871560 00010000:00010000:2.0:1763343034.563090:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1763343034.563092:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010251776:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763343034.563096:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae61b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.563106:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343034.563110:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae61b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.563118:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae61b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.563130:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae61b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.563137:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae61b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.563154:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343034.563156:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343034.563160:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343034.563170:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763343034.563199:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad1f80/2, rc 0, transno 17179871559 00000100:00100000:2.0:1763343034.563205:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010251520:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1763343034.563442:0:32355:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 4 in progress, 3 in flight, 52 done 00000100:00100000:1.0:1763343034.563461:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343034.563510:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010251904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343034.563512:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010251392 00000100:00100000:0.0:1763343034.563519:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010251392 00000100:00100000:0.0:1763343034.563558:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6447 00000100:00100000:1.0:1763343034.563563:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343034.563581:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3660:x1848998010251392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343034.563602:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:665 count 1 00000100:00100000:1.0:1763343034.563608:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010251904 00000100:00100000:1.0:1763343034.563614:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010251904 00010000:00010000:0.0:1763343034.563646:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae61ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343034.563663:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6448 00010000:00010000:0.0:1763343034.563666:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae60a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac906b expref: 22 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343034.563674:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3660:x1848998010251904:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763343034.563683:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343034.563688:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343034.563691:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae61ba lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.563731:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae60a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac906b expref: 22 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.563747:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae60a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac906b expref: 22 pid: 8410 timeout: 1328 lvb_type: 0 00000100:00100000:0.0:1763343034.563761:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010252288:192.168.204.21@tcp:104: 00002000:00010000:1.0:1763343034.563762:0:27833:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x295:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343034.563768:0:27833:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x295:0x0] updating lvb mtime from disk: 1763343034 -> 1763343034 00002000:00010000:1.0:1763343034.563772:0:27833:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x295:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343034.563774:0:27833:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x295:0x0] updating lvb ctime from disk: 1763343034 -> 1763343034 00002000:00010000:1.0:1763343034.563777:0:27833:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x295:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343034.563807:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404bf3840 going to sleep for 11 seconds 00000100:00100000:3.0:1763343034.565138:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.565907:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993512832 00000100:00100000:2.0:1763343034.565920:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993512832 00000100:00100000:2.0:1763343034.566020:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3124 00000100:00100000:2.0:1763343034.566031:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+238:56860:x1848997993512832:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343034.566341:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56860:x1848997993512832:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 310us (1211us total) trans 8589939861 rc 0/0 00000100:00100000:2.0:1763343034.566350:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3124 00000100:00100000:1.0:1763343034.566960:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3660:x1848998010251904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3284us (3395us total) trans 21474838859 rc 0/0 00000100:00100000:1.0:1763343034.566972:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6448 00000004:00080000:1.0:1763343034.567044:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b90700/2, rc 0, transno 21474838858 00000100:00100000:1.0:1763343034.567052:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010252032:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343034.567069:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad3480/2, rc 0, transno 17179871558 00000100:00100000:1.0:1763343034.567074:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010251648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343034.567192:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b91c00/2, rc 0, transno 21474838859 00000100:00100000:0.0:1763343034.567198:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010251904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343034.569407:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.569693:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993512960 00000100:00100000:1.0:1763343034.569705:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993512960 00000100:00100000:1.0:1763343034.569774:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9193 00000100:00100000:1.0:1763343034.569786:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56856:x1848997993512960:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343034.569818:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.569846:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae61c1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac90b8 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.569918:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae61c1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90b8 expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.569946:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177a00/0x607405d401ae61c1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90b8 expref: 240 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.569973:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:1.0:1763343034.569977:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343034.569981:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177a00, rc 0) 00000100:00100000:1.0:1763343034.570058:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56856:x1848997993512960:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 274us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343034.570066:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9193 00000100:00100000:3.0:1763343034.575375:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.575523:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993513088 00000100:00100000:1.0:1763343034.575536:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993513088 00010000:00010000:1.0:1763343034.575592:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae609b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9064 expref: 13 pid: 28648 timeout: 1328 lvb_type: 0 00000100:00100000:1.0:1763343034.575657:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3026 00000100:00100000:1.0:1763343034.575667:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2432:x1848997993513088:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343034.575687:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343034.575694:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae609b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9064 expref: 13 pid: 28648 timeout: 1328 lvb_type: 0 00010000:00010000:1.0:1763343034.575711:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae609b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9064 expref: 13 pid: 28648 timeout: 1328 lvb_type: 0 00010000:00010000:1.0:1763343034.575744:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343034.575746:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343034.575752:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae61a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.575765:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae61a5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.575834:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae609b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9064 expref: 13 pid: 28648 timeout: 1328 lvb_type: 0 00000100:00100000:2.0:1763343034.575853:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010252160:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343034.575882:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae61a5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343034.577095:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:0.0:1763343034.577096:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343034.577120:0:8410:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae61a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343034.577133:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993513216 00010000:00010000:2.0:1763343034.577133:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae61a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343034.577143:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993513216 00010000:00010000:2.0:1763343034.577147:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae61a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.577164:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae61a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343034.577175:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2432:x1848997993513088:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1503us (1814us total) trans 0 rc 0/0 00010000:00010000:3.0:1763343034.577184:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae60a2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac906b expref: 23 pid: 8410 timeout: 1328 lvb_type: 0 00000100:00100000:0.0:1763343034.577191:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3026 00010000:00010000:2.0:1763343034.577195:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343034.577231:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3027 00000100:00100000:3.0:1763343034.577242:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2431:x1848997993513216:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343034.577256:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343034.577262:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae60a2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac906b expref: 23 pid: 8410 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343034.577276:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae60a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac906b expref: 23 pid: 8410 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343034.577309:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.577311:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.577317:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae61ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.577327:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae61ba lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.577343:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343034.577366:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2431:x1848997993513216:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 127us (282us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343034.577474:0:28995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae60a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac906b expref: 23 pid: 8410 timeout: 1328 lvb_type: 0 00000100:00100000:1.0:1763343034.577490:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010252288:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343034.577817:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3658:x1848998010251136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19318us (19711us total) trans 21474838860 rc 0/0 00000100:00100000:2.0:1763343034.577827:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6441 00010000:00010000:1.0:1763343034.578067:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae61ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.578078:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae61ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.578084:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae61ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.578091:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae61ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.578098:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae61ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.578126:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763343034.578306:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3660:x1848998010251392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14727us (14843us total) trans 17179871561 rc 0/0 00000100:00100000:1.0:1763343034.578317:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6447 00000004:00080000:1.0:1763343034.578367:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d10c700/2, rc 0, transno 21474838860 00000100:00100000:1.0:1763343034.578375:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010251136:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763343034.578738:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343034.578748:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae61a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.578757:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343034.578763:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae61a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.578773:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae61a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.578795:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae61a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.578802:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae61a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.578888:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343034.578893:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae61ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.578900:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343034.578903:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae61ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.578910:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae61ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.578922:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae61ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.578928:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665d800/0x607405d401ae61ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.578951:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343034.578954:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343034.578956:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343034.579024:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343034.579254:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad0700/2, rc 0, transno 17179871561 00000100:00100000:0.0:1763343034.579276:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010251392:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343034.579446:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3027 00000100:00100000:2.0:1763343034.579593:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.579601:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.579653:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993513472 00000100:00100000:1.0:1763343034.579663:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993513472 00000100:00100000:1.0:1763343034.579715:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9194 00000100:00100000:1.0:1763343034.579724:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993513472:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343034.579756:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.579785:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae61c8 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac90bf expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.579982:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae61cf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.579997:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae61cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580009:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae61cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580022:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae61d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580030:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae61d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580036:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae61d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580105:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae61dd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580114:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae61dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580122:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae61dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343034.580132:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d7:0x0]: returning size 0 00010000:00010000:1.0:1763343034.580230:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae61cf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580238:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae61cf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580244:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae61cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580250:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae61cf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580256:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.580261:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae61cf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580267:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae61cf lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580278:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aabd00) 00010000:00010000:1.0:1763343034.580282:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.580287:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae61cf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580294:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae61cf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580311:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae61d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580317:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae61d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580322:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae61d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580326:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.580328:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae61d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580333:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae61d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580338:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab700) 00010000:00010000:1.0:1763343034.580340:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.580342:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae61d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580347:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae61d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.580392:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae61c8 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90bf expref: 243 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.580410:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae61dd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90bf expref: 242 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.580417:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:1.0:1763343034.580420:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343034.580423:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:1.0:1763343034.580493:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:55941:x1848997993513472:12345-192.168.204.21@tcp:101:bash.0 Request processed in 769us (902us total) trans 8589939862 rc 0/0 00000100:00100000:1.0:1763343034.580501:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9194 00000100:00100000:0.0:1763343034.580904:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993513728 00000100:00100000:0.0:1763343034.580913:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993513728 00000100:00100000:0.0:1763343034.580978:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3125 00000100:00100000:0.0:1763343034.580987:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56856:x1848997993513728:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:0.0:1763343034.581239:0:14879:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1d4:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343034.581831:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1397, 64 off118152 00000040:00080000:0.0:1763343034.581862:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1396, 64 off118152 00000040:00080000:0.0:1763343034.581872:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1397, 64 off118216 00000040:00080000:0.0:1763343034.581880:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1398, 64 off118216 00010000:00010000:0.0:1763343034.581999:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae61eb lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343034.582019:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae61eb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343034.582033:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae61eb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343034.582044:0:14879:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae61eb lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343034.582174:0:14879:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae61eb lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343034.582179:0:14879:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae61eb lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343034.582263:0:14879:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343034.582476:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343034.582487:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae61eb lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343034.582500:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343034.582505:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae61eb lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343034.582513:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae61eb lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343034.582530:0:13198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d4:0x0].0x0 (ffff9a3518935800) 00010000:00010000:2.0:1763343034.582534:0:13198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343034.582540:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae61eb lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343034.582546:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae61eb lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343034.582559:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343034.582561:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343034.582563:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343034.582611:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56856:x1848997993513728:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1621us (3006us total) trans 8589939863 rc 0/0 00000100:00100000:0.0:1763343034.582642:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3125 00000100:00100000:3.0:1763343034.583446:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.583533:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993513856 00000100:00100000:1.0:1763343034.583544:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993513856 00000100:00100000:1.0:1763343034.583609:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9195 00000100:00100000:1.0:1763343034.583649:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:55941:x1848997993513856:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343034.583684:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.583708:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae61f2 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac90c6 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.583751:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae61f9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.583765:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae61f9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.583779:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae61f9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.583925:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae61f2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90c6 expref: 245 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.583963:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae61f9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90c6 expref: 244 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.583973:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:1.0:1763343034.583976:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343034.583980:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343034.584035:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:55941:x1848997993513856:12345-192.168.204.21@tcp:101:bash.0 Request processed in 417us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343034.584044:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9195 00000100:00100000:0.0:1763343034.587973:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.588128:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993514368 00000100:00100000:1.0:1763343034.588143:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993514368 00000100:00100000:1.0:1763343034.588216:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9196 00000100:00100000:1.0:1763343034.588227:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:55941:x1848997993514368:12345-192.168.204.21@tcp:36:bash.0 00000100:00100000:0.0:1763343034.588975:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1848998010252416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1763343034.589052:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343034.589116:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010252416 00000100:00100000:0.0:1763343034.589123:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010252416 00000100:00100000:0.0:1763343034.589180:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:0.0:1763343034.589189:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1848998010252416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1763343034.589215:0:8411:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 28672 granted 484928576 pending 0 free 3920236544 avail 3688628224 00000100:00100000:0.0:1763343034.589279:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1848998010252416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.589288:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:0.0:1763343034.589346:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1848998010252416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1763343034.589518:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:1.0:1763343034.589685:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343034.589722:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae61dd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90bf expref: 244 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.589744:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:1.0:1763343034.589750:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343034.589996:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6200 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.590014:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6200 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.590025:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6200 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000001:00080000:1.0:1763343034.590081:0:10042:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939864 00000004:00010000:1.0:1763343034.590103:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000077484338 reply state 000000009bcba8f0 transno 8589939865 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6200 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.590115:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6200 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.590121:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:1.0:1763343034.590125:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343034.590127:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343034.590222:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:55941:x1848997993514368:12345-192.168.204.21@tcp:36:bash.0 Request processed in 1996us (2267us total) trans 8589939865 rc 0/0 00000100:00100000:1.0:1763343034.590230:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9196 00000020:00080000:1.0:1763343034.590233:0:10042:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343034.590255:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993514112 00000100:00100000:1.0:1763343034.590259:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993514112 00000100:00100000:1.0:1763343034.590289:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9197 00000100:00100000:1.0:1763343034.590296:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56856:x1848997993514112:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343034.590310:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.590320:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6207 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac90cd expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.590411:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae620e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.590420:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae620e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343034.590427:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae620e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343034.590437:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d7:0x0]: returning size 0 00010000:00010000:1.0:1763343034.590499:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6207 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90cd expref: 249 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.590515:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae620e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90cd expref: 248 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.590522:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:1.0:1763343034.590526:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763343034.590528:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343034.590556:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56856:x1848997993514112:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 260us (1040us total) trans 8589939866 rc 0/0 00000100:00100000:1.0:1763343034.590562:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9197 00000100:00080000:2.0:1763343034.590996:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763343034.591047:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343034.591066:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1848998010252544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1763343034.591120:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343034.591210:0:8851:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010252544 00000100:00100000:2.0:1763343034.591216:0:8851:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010252544 00000100:00100000:2.0:1763343034.591272:0:8851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:2.0:1763343034.591281:0:8851:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1848998010252544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1763343034.591301:0:8851:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484928576 pending 28672 free 3919175680 avail 3687624704 00000100:00100000:2.0:1763343034.591344:0:8851:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1848998010252544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.591350:0:8851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:2.0:1763343034.591402:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1848998010252544:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1763343034.591707:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763343034.594545:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.594723:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993514496 00000100:00100000:0.0:1763343034.594735:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993514496 00000100:00100000:0.0:1763343034.594850:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9198 00000100:00100000:0.0:1763343034.594861:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:55941:x1848997993514496:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343034.594890:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.594918:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae621c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac90d4 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.595007:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae621c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90d4 expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.595026:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae621c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90d4 expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.595048:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343034.595053:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343034.595057:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665cc00, rc 0) 00000100:00100000:0.0:1763343034.595139:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:55941:x1848997993514496:12345-192.168.204.21@tcp:101:bash.0 Request processed in 279us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.595147:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9198 00000100:00100000:3.0:1763343034.597679:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.598598:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993514624 00000100:00100000:0.0:1763343034.598613:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993514624 00000100:00100000:0.0:1763343034.598712:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9199 00000100:00100000:0.0:1763343034.598723:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56856:x1848997993514624:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343034.598756:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.598785:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6223 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac90db expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.598916:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae622a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.598944:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae622a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.598960:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae622a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343034.598996:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d7:0x0]: returning size 0 00000004:00200000:0.0:1763343034.599002:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343034.599027:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae622a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.599073:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6223 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90db expref: 251 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.599094:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae622a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90db expref: 250 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.599105:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343034.599109:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343034.599114:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665ce00, rc 0) 00000100:00100000:0.0:1763343034.600259:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56856:x1848997993514624:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1527us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.600276:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9199 00000100:00100000:1.0:1763343034.602667:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.602785:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993514880 00000100:00100000:0.0:1763343034.602798:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993514880 00000100:00100000:0.0:1763343034.602876:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9200 00000100:00100000:0.0:1763343034.602888:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:55941:x1848997993514880:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343034.602917:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.602921:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1763343034.602968:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae621c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90d4 expref: 250 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.602992:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae620e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90cd expref: 249 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.603004:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343034.603010:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343034.603027:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae6231 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac90e2 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.603104:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6238 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.603121:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae622a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90db expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.603132:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6238 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.603178:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae622a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90db expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.603201:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae622a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90db expref: 249 pid: 10041 timeout: 1328 lvb_type: 0 00000100:00100000:0.0:1763343034.603218:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010252672:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343034.603323:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a351ffa9840 going to sleep for 11 seconds 00000100:00100000:3.0:1763343034.603726:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.606223:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993515008 00000100:00100000:1.0:1763343034.606244:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993515008 00000100:00100000:1.0:1763343034.606345:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6449 00000100:00100000:1.0:1763343034.606359:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993515008:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343034.606386:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.606415:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae623f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac90e9 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343034.606448:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343034.606476:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343034.606480:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343034.606495:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae623f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90e9 expref: 23 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343034.606516:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae623f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90e9 expref: 23 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343034.606533:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00000100:00100000:1.0:1763343034.606659:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2429:x1848997993515008:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 302us (2934us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343034.606667:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6449 00000100:00100000:2.0:1763343034.609874:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.609899:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010252672:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343034.609949:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6238 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:2.0:1763343034.609995:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.610203:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993515264 00000100:00100000:0.0:1763343034.610213:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993515264 00000100:00100000:0.0:1763343034.610301:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9201 00000100:00100000:0.0:1763343034.610312:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56856:x1848997993515264:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343034.610347:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.610374:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6246 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac90f0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.610442:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6238 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.610453:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6246 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f0 expref: 251 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.610473:0:6523:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6238 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.610485:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6246 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f0 expref: 251 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.610502:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343034.610506:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343034.610509:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6238 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.610515:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665dc00, rc 0) 00000100:00100000:0.0:1763343034.610583:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56856:x1848997993515264:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 273us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.610590:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9201 00000100:00100000:3.0:1763343034.610793:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993515136 00000100:00100000:3.0:1763343034.610798:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993515136 00010000:00010000:3.0:1763343034.610828:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae622a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90db expref: 251 pid: 10041 timeout: 1328 lvb_type: 0 00000100:00100000:3.0:1763343034.610867:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3028 00000100:00100000:3.0:1763343034.610876:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:2429:x1848997993515136:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343034.610887:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343034.610893:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae622a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90db expref: 251 pid: 10041 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343034.610906:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae622a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90db expref: 251 pid: 10041 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343034.610930:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae622a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90db expref: 251 pid: 10041 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343034.610959:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:3.0:1763343034.610962:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6238 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.610970:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6238 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.610977:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6238 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.610986:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6246 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f0 expref: 250 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.611017:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343034.611062:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:2429:x1848997993515136:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 187us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.611069:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3028 00010000:00010000:2.0:1763343034.611575:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6238 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343034.611586:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6238 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00000040:00080000:2.0:1763343034.612550:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1399, 88 off118304 00000004:00080000:2.0:1763343034.612563:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228279941315ns, next at 1228493164729ns, rc = 0 00000040:00080000:2.0:1763343034.614535:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1398, 88 off118304 00000004:00080000:2.0:1763343034.614557:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1228281935998ns, next at 1228493192443ns, rc = 0 00000040:00080000:2.0:1763343034.614695:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1399, 88 off118392 00000004:00080000:2.0:1763343034.614700:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1228282079750ns, next at 1228493192443ns, rc = 0 00000040:00080000:2.0:1763343034.614718:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1400, 88 off118392 00000004:00080000:2.0:1763343034.614722:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228282101128ns, next at 1228493164729ns, rc = 0 00000001:00080000:0.0:1763343034.618175:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939867 is committed 00000004:00080000:0.0:1763343034.618193:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 921 committed 00000004:00080000:0.0:1763343034.618207:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 922 committed 00000004:00080000:0.0:1763343034.618214:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 921 committed 00000004:00080000:0.0:1763343034.618216:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 920 committed 00000100:00100000:1.0:1763343034.618536:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010253184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343034.618563:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010252800:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343034.618682:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343034.618750:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010253184 00000100:00100000:0.0:1763343034.618762:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010253184 00000100:00100000:1.0:1763343034.618763:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010253056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343034.618798:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343034.618819:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343034.618825:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010253056 00000100:00100000:1.0:1763343034.618827:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010252928:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343034.618831:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010253056 00000100:00100000:1.0:1763343034.618856:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343034.619271:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6200 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.619285:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6200 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.619294:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6200 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.619301:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.619307:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6200 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.619317:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6200 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.619337:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:2.0:1763343034.619341:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.619348:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6200 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.619355:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6200 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343034.619442:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6238 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90e2 expref: 241 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.619458:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:2.0:1763343034.619461:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:0.0:1763343034.619465:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010252928 00010000:00010000:2.0:1763343034.619466:0:10041:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6246 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f0 expref: 241 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343034.619472:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010252928 00010000:00010000:2.0:1763343034.619488:0:10041:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6246 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f0 expref: 241 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.619497:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6246 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f0 expref: 241 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343034.619505:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6450 00000100:00100000:0.0:1763343034.619513:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6451 00000100:00100000:1.0:1763343034.619519:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3659:x1848998010253184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343034.619525:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3658:x1848998010253056:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1763343034.619536:0:10041:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6246 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f0 expref: 241 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343034.619550:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34050f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010253312:192.168.204.21@tcp:105: 00000100:00100000:2.0:1763343034.619667:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35012edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343034.619759:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3659:x1848998010253184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 244us (1078us total) trans 21474838861 rc 0/0 00000100:00100000:1.0:1763343034.619767:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6450 00000100:00100000:1.0:1763343034.619789:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6452 00000100:00100000:1.0:1763343034.619796:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3658:x1848998010252928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343034.619812:0:27833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:662 count 1 00010000:00010000:1.0:1763343034.619833:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae624d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.619853:0:27833:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae6104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9080 expref: 11 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.619861:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343034.619864:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343034.619868:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae624d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.619895:0:27833:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae6104 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9080 expref: 11 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.619915:0:27833:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae6104 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9080 expref: 11 pid: 27835 timeout: 1328 lvb_type: 0 00000100:00100000:1.0:1763343034.619927:0:27833:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c252d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27833:1848998010253440:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343034.620064:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3658:x1848998010253056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 542us (1264us total) trans 21474838862 rc 0/0 00000100:00100000:0.0:1763343034.620072:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6451 00000004:00080000:2.0:1763343034.620107:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035e9c00/2, rc 0, transno 21474838862 00000100:00100000:2.0:1763343034.620117:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010253056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343034.620414:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010253824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343034.620446:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343034.620467:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763343034.620473:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010253696:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343034.620494:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343034.621274:0:27833:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abed80 going to sleep for 11 seconds 00000100:00100000:1.0:1763343034.621304:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010253952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343034.621427:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010253824 00000100:00100000:0.0:1763343034.621437:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010253824 00000100:00100000:2.0:1763343034.621452:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343034.621486:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010253696 00000100:00100000:0.0:1763343034.621489:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010253696 00000004:00080000:2.0:1763343034.621496:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035eaa00/2, rc 0, transno 21474838861 00000100:00100000:2.0:1763343034.621502:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010253184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343034.621506:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010253952 00000100:00100000:0.0:1763343034.621508:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010253952 00000100:00100000:2.0:1763343034.621513:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343034.621518:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010253568:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343034.621528:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6453 00000100:00100000:0.0:1763343034.621536:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3658:x1848998010253824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343034.621541:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343034.621810:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343034.622743:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010253568 00000100:00100000:1.0:1763343034.622752:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010253568 00000100:00100000:3.0:1763343034.622780:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010252800 00000100:00100000:1.0:1763343034.622791:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6454 00000100:00100000:1.0:1763343034.622800:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3658:x1848998010253696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763343034.622829:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:664 count 1 00010000:00010000:1.0:1763343034.622861:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6254 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.622885:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd400/0x607405d401ae610b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9087 expref: 22 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.622895:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343034.622897:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343034.622902:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6254 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343034.622928:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6455 00000100:00100000:2.0:1763343034.622946:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3659:x1848998010253952:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1763343034.622954:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd400/0x607405d401ae610b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9087 expref: 22 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.622976:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd400/0x607405d401ae610b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9087 expref: 22 pid: 8410 timeout: 1328 lvb_type: 0 00000100:00100000:3.0:1763343034.622994:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010252800 00000100:00100000:1.0:1763343034.622994:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c251c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010254080:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343034.623087:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe9c0 going to sleep for 11 seconds 00002000:00010000:0.0:1763343034.623763:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343034.623769:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.623771:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.623774:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.623776:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343034.623997:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6456 00000100:00100000:3.0:1763343034.624010:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3659:x1848998010253568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343034.624036:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:663 count 1 00010000:00010000:3.0:1763343034.624053:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae625b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.624070:0:28993:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae6047 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9041 expref: 22 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343034.624077:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.624079:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.624082:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae625b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.624113:0:28993:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae6047 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9041 expref: 22 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343034.624123:0:28993:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae6047 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9041 expref: 22 pid: 15756 timeout: 1328 lvb_type: 1 00000100:00100000:3.0:1763343034.624136:0:28993:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:28993:1848998010254208:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343034.624205:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6457 00000100:00100000:1.0:1763343034.624216:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354111dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3660:x1848998010252800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343034.624233:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:661 count 1 00010000:00010000:1.0:1763343034.624248:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae6262 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.624261:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae5f05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd8 expref: 11 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.624268:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343034.624269:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343034.624272:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae6262 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.624289:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae5f05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd8 expref: 11 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.624297:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae5f05 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd8 expref: 11 pid: 8410 timeout: 1328 lvb_type: 0 00000100:00100000:1.0:1763343034.624307:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c250700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010254336:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343034.624498:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3659:x1848998010253952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1552us (3044us total) trans 17179871562 rc 0/0 00000100:00100000:2.0:1763343034.624507:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6455 00000100:00100000:3.0:1763343034.624987:0:28993:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343034.625001:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe240 going to sleep for 11 seconds 00000004:00080000:2.0:1763343034.625114:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a4000/2, rc 0, transno 17179871562 00000100:00100000:2.0:1763343034.625123:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010253952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343034.625293:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.625612:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3658:x1848998010253824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4074us (5162us total) trans 17179871563 rc 0/0 00000100:00100000:0.0:1763343034.625653:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6453 00000100:00100000:2.0:1763343034.625655:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34050f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010253312:192.168.204.21@tcp:105: 00010000:00010000:2.0:1763343034.625710:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae6231 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90e2 expref: 241 pid: 10041 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343034.625734:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6238 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90e2 expref: 240 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.625771:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665da00, rc 0) 00000100:00100000:2.0:1763343034.625825:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993514880:12345-192.168.204.21@tcp:101:bash.0 Request processed in 22938us (23172us total) trans 8589939867 rc 0/0 00000100:00100000:2.0:1763343034.625833:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9200 00000004:00080000:2.0:1763343034.625874:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a7480/2, rc 0, transno 17179871563 00000100:00100000:2.0:1763343034.625878:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010253824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343034.625917:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.625971:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993515520 00000100:00100000:2.0:1763343034.625979:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993515520 00000100:00100000:2.0:1763343034.626021:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3126 00000100:00100000:2.0:1763343034.626029:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56856:x1848997993515520:12345-192.168.204.21@tcp:49:lfs.0 00000100:00100000:2.0:1763343034.626124:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56856:x1848997993515520:12345-192.168.204.21@tcp:49:lfs.0 Request processed in 96us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.626131:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3126 00000100:00100000:3.0:1763343034.626333:0:27833:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c252d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27833:1848998010253440:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343034.626349:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993515392 00000100:00100000:1.0:1763343034.626353:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993515392 00010000:00010000:3.0:1763343034.626355:0:27833:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae624d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.626377:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae6104 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9080 expref: 12 pid: 27835 timeout: 1328 lvb_type: 0 00000100:00100000:1.0:1763343034.626411:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3029 00000100:00100000:1.0:1763343034.626418:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993515392:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343034.626431:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343034.626437:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae6104 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9080 expref: 12 pid: 27835 timeout: 1328 lvb_type: 0 00010000:00010000:1.0:1763343034.626449:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae6104 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9080 expref: 12 pid: 27835 timeout: 1328 lvb_type: 0 00010000:00010000:1.0:1763343034.626472:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d200/0x607405d401ae6104 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9080 expref: 12 pid: 27835 timeout: 1328 lvb_type: 0 00010000:00010000:1.0:1763343034.626497:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343034.626500:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343034.626505:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae624d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.626516:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae624d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.626551:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343034.626590:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2429:x1848997993515392:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 172us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343034.626597:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3029 00010000:00010000:0.0:1763343034.626793:0:27833:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae624d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.626802:0:27833:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae624d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.626812:0:27833:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae624d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.626820:0:27833:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae624d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.626849:0:27833:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343034.628054:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343034.628068:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae624d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.628079:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343034.628084:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae624d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.628096:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae624d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.628117:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae624d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.628125:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae624d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.628150:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343034.628153:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343034.628155:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3658:x1848998010252928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8352us (9291us total) trans 21474838863 rc 0/0 00010000:00010000:1.0:1763343034.628156:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343034.628169:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6452 00000004:00080000:3.0:1763343034.628643:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035e9180/2, rc 0, transno 21474838863 00000100:00100000:3.0:1763343034.628652:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010252928:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343034.629274:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c251c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010254080:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343034.629307:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6254 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343034.630121:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c250700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010254336:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343034.630146:0:28648:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae6262 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343034.630232:0:28993:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340664a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:28993:1848998010254208:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343034.630264:0:28993:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae625b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343034.630665:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.630699:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.630731:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.630761:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993515648 00000100:00100000:3.0:1763343034.630770:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993515648 00010000:00010000:3.0:1763343034.630815:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd400/0x607405d401ae610b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9087 expref: 23 pid: 8410 timeout: 1328 lvb_type: 0 00000100:00100000:3.0:1763343034.630849:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993515904 00000100:00100000:3.0:1763343034.630852:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993515904 00010000:00010000:3.0:1763343034.630869:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae5f05 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd8 expref: 11 pid: 8410 timeout: 1328 lvb_type: 0 00000100:00100000:3.0:1763343034.630888:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993515776 00000100:00100000:3.0:1763343034.630890:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993515776 00010000:00010000:3.0:1763343034.630901:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae6047 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9041 expref: 24 pid: 15756 timeout: 1328 lvb_type: 1 00000100:00100000:3.0:1763343034.630917:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3030 00000100:00100000:3.0:1763343034.630926:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993515648:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343034.630954:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343034.630960:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd400/0x607405d401ae610b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9087 expref: 24 pid: 8410 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343034.630974:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd400/0x607405d401ae610b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9087 expref: 24 pid: 8410 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343034.631004:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd400/0x607405d401ae610b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9087 expref: 24 pid: 8410 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343034.631025:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.631027:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.631033:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.631044:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6254 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.631122:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343034.631188:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993515648:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 263us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.631197:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3030 00000100:00100000:3.0:1763343034.631217:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3031 00000100:00100000:3.0:1763343034.631223:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351c5fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2430:x1848997993515904:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343034.631233:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343034.631238:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae5f05 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd8 expref: 11 pid: 8410 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343034.631247:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae5f05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd8 expref: 11 pid: 8410 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343034.631264:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae5f05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac8fd8 expref: 11 pid: 8410 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343034.631275:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.631277:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.631280:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae6262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.631288:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae6262 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.631305:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343034.631323:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351c5fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+10:2430:x1848997993515904:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 101us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.631330:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3031 00000100:00100000:3.0:1763343034.631393:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3032 00000100:00100000:3.0:1763343034.631401:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993515776:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343034.631409:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343034.631413:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae6047 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9041 expref: 22 pid: 15756 timeout: 1328 lvb_type: 1 00010000:00010000:3.0:1763343034.631423:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae6047 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9041 expref: 22 pid: 15756 timeout: 1328 lvb_type: 1 00010000:00010000:3.0:1763343034.631435:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c200/0x607405d401ae6047 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9041 expref: 22 pid: 15756 timeout: 1328 lvb_type: 1 00010000:00010000:3.0:1763343034.631448:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.631450:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.631452:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae625b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.631460:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae625b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.631477:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343034.631496:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993515776:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 96us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.631502:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3032 00010000:00010000:3.0:1763343034.631535:0:28993:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae625b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.631543:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae625b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.631553:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae625b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.631561:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae625b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.631583:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343034.632047:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3659:x1848998010253568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8039us (10501us total) trans 17179871564 rc 0/0 00000100:00100000:3.0:1763343034.632061:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6456 00010000:00010000:3.0:1763343034.632094:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343034.632103:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae625b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.632112:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343034.632116:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae625b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.632126:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae625b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.632141:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae625b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.632149:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae625b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.632169:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343034.632171:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343034.632173:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343034.632186:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.632201:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.632209:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.632217:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6254 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.632231:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343034.632356:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3658:x1848998010253696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9556us (11859us total) trans 17179871565 rc 0/0 00000100:00100000:3.0:1763343034.632363:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6454 00000004:00080000:3.0:1763343034.632423:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a4e00/2, rc 0, transno 17179871565 00000100:00100000:3.0:1763343034.632431:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010253696:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343034.632657:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.632695:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993516032 00000100:00100000:3.0:1763343034.632704:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993516032 00000100:00100000:3.0:1763343034.632752:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3127 00000100:00100000:3.0:1763343034.632761:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993516032:12345-192.168.204.21@tcp:49:bash.0 00000100:00100000:3.0:1763343034.632958:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:55941:x1848997993516032:12345-192.168.204.21@tcp:49:bash.0 Request processed in 198us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.632966:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3127 00010000:00010000:1.0:1763343034.633017:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343034.633025:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6254 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.633034:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343034.633038:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6254 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.633045:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6254 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.633060:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6254 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.633067:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6254 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.633084:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343034.633086:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343034.633088:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343034.633101:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.633116:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993516288 00000100:00100000:3.0:1763343034.633120:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993516288 00000100:00100000:3.0:1763343034.633145:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3128 00000100:00100000:3.0:1763343034.633151:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56856:x1848997993516288:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:2.0:1763343034.633310:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537910a80/2, rc 0, transno 17179871564 00000100:00100000:2.0:1763343034.633317:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010253568:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1763343034.633341:0:28648:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae6262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.633351:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae6262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343034.633356:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56856:x1848997993516288:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 205us (255us total) trans 8589939868 rc 0/0 00010000:00010000:2.0:1763343034.633361:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae6262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343034.633368:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3128 00010000:00010000:2.0:1763343034.633370:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae6262 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.633401:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343034.633651:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354111dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3660:x1848998010252800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9437us (11840us total) trans 21474838864 rc 0/0 00000100:00100000:2.0:1763343034.633660:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6457 00000004:00080000:0.0:1763343034.633799:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035ea300/2, rc 0, transno 21474838864 00000100:00100000:0.0:1763343034.633806:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010252800:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763343034.633917:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343034.633924:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae6262 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.633942:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343034.633945:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae6262 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.633954:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae6262 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.633971:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae6262 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.633978:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae6262 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.633997:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343034.633999:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343034.634001:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343034.636371:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.636869:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.637472:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993516416 00000100:00100000:2.0:1763343034.637486:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993516416 00000100:00100000:2.0:1763343034.637569:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6458 00000100:00100000:2.0:1763343034.637581:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:55941:x1848997993516416:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343034.637607:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.637651:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac90f7 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.637692:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae623f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90e9 expref: 22 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343034.637702:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.637705:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.637710:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 22 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.637759:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae623f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90e9 expref: 22 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343034.637775:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae623f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90e9 expref: 22 pid: 28995 timeout: 1328 lvb_type: 1 00000100:00100000:2.0:1763343034.637791:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010254464:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343034.637907:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35012edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343034.639216:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993516672 00000100:00100000:0.0:1763343034.639231:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993516672 00000100:00100000:0.0:1763343034.639321:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9202 00000100:00100000:0.0:1763343034.639333:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56856:x1848997993516672:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343034.639362:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.639389:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6270 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac90fe expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.639491:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6277 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639508:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6277 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639522:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6277 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639535:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae627e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639542:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae627e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639548:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae627e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639745:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6285 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639757:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6285 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639764:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6285 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343034.639777:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d7:0x0]: returning size 2 00010000:00010000:0.0:1763343034.639897:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6277 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639905:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6277 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639912:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6277 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639917:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6277 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639923:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343034.639927:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6277 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639944:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6277 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639957:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4100) 00010000:00010000:0.0:1763343034.639961:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343034.639966:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6277 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639973:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6277 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639992:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae627e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.639998:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae627e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.640003:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae627e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.640007:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343034.640009:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae627e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.640014:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae627e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.640019:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:0.0:1763343034.640021:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343034.640023:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae627e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.640027:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae627e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.640076:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6270 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90fe expref: 244 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.640093:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6285 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90fe expref: 243 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.640098:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343034.640101:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343034.640104:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665cc00, rc 0) 00000100:00100000:0.0:1763343034.640201:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56856:x1848997993516672:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 871us (3332us total) trans 8589939869 rc 0/0 00000100:00100000:0.0:1763343034.640209:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9202 00000100:00100000:1.0:1763343034.641308:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.642673:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993516800 00000100:00100000:0.0:1763343034.642690:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993516800 00010000:00010000:0.0:1763343034.642744:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae623f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90e9 expref: 23 pid: 28995 timeout: 1328 lvb_type: 1 00000100:00100000:0.0:1763343034.643753:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3033 00000100:00100000:0.0:1763343034.643779:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2429:x1848997993516800:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343034.643807:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343034.643818:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae623f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90e9 expref: 23 pid: 28995 timeout: 1328 lvb_type: 1 00010000:00010000:0.0:1763343034.643837:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae623f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90e9 expref: 23 pid: 28995 timeout: 1328 lvb_type: 1 00010000:00010000:0.0:1763343034.643874:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.643876:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343034.643886:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 23 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.643899:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 23 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.643970:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 23 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343034.643991:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1848998010254592:192.168.204.21@tcp:105: 00000100:00100000:0.0:1763343034.644126:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a353c6e8f00 going to sleep for 11 seconds 00010000:00010000:0.0:1763343034.644184:0:28648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae623f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90e9 expref: 23 pid: 28995 timeout: 1328 lvb_type: 1 00000100:00100000:0.0:1763343034.644200:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010254464:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343034.644230:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 22 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.644240:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dce00, rc 0) 00000100:00100000:0.0:1763343034.644283:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:55941:x1848997993516416:12345-192.168.204.21@tcp:101:bash.0 Request processed in 6704us (7927us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.644291:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6458 00000100:00100000:1.0:1763343034.646185:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.647428:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993517056 00000100:00100000:2.0:1763343034.647444:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993517056 00000100:00100000:2.0:1763343034.647520:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3129 00000100:00100000:2.0:1763343034.647530:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56856:x1848997993517056:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343034.647921:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56856:x1848997993517056:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 390us (1747us total) trans 8589939870 rc 0/0 00000100:00100000:2.0:1763343034.647940:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3129 00000100:00100000:1.0:1763343034.650117:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.650118:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1848998010254592:192.168.204.21@tcp:105: 00010000:00010000:0.0:1763343034.650157:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343034.650239:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993516800:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 6471us (8937us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.650254:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3033 00000100:00100000:2.0:1763343034.650888:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993517184 00000100:00100000:2.0:1763343034.650899:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993517184 00000100:00100000:2.0:1763343034.650975:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6459 00000100:00100000:2.0:1763343034.650986:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+10:55941:x1848997993517184:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343034.651013:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.651045:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae6293 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9105 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343034.651078:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x299:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343034.651105:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.651108:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.651120:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae6293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9105 expref: 11 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.651138:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae6293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9105 expref: 11 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.651154:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc600, rc 0) 00000100:00100000:2.0:1763343034.651190:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:55941:x1848997993517184:12345-192.168.204.21@tcp:101:bash.0 Request processed in 207us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.651197:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6459 00000100:00100000:1.0:1763343034.652906:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.653089:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993517312 00000100:00100000:3.0:1763343034.653103:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993517312 00000100:00100000:3.0:1763343034.653163:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3130 00000100:00100000:3.0:1763343034.653173:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fb9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56856:x1848997993517312:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:3.0:1763343034.653391:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fb9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56856:x1848997993517312:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 219us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.653398:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3130 00000100:00100000:3.0:1763343034.657100:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.657141:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.657677:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993517440 00000100:00100000:2.0:1763343034.657691:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993517440 00002000:00010000:2.0:1763343034.657752:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/667 (0->18446744073709551615) 00002000:00100000:2.0:1763343034.657758:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340664a680 with x1848997993517440 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343034.657786:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340664a680. 00000100:00100000:2.0:1763343034.657826:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993517568 00000100:00100000:2.0:1763343034.657830:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993517568 00002000:00010000:2.0:1763343034.657860:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/665 (0->18446744073709551615) 00002000:00100000:2.0:1763343034.657863:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406648380 with x1848997993517568 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343034.657871:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406648380. 00000100:00100000:2.0:1763343034.657900:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1580 00000100:00100000:2.0:1763343034.657912:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993517440:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:3.0:1763343034.658986:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1581 00000100:00100000:3.0:1763343034.659006:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2430:x1848997993517568:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343034.659231:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x299:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343034.659236:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x299:0x0] updating lvb mtime from disk: 0 -> 1763343034 00002000:00010000:3.0:1763343034.659239:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x299:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343034.659242:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x299:0x0] updating lvb ctime from disk: 0 -> 1763343034 00002000:00010000:3.0:1763343034.659245:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x299:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343034.659351:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2430:x1848997993517568:12345-192.168.204.21@tcp:10:bash.0 Request processed in 350us (2208us total) trans 21474838865 rc 0/0 00000100:00100000:3.0:1763343034.659361:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1581 00002000:00010000:3.0:1763343034.659367:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/665 (0->18446744073709551615) 00002000:00100000:3.0:1763343034.659371:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406648380 with x1848997993517568 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343034.659378:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406648380. 00002000:00010000:2.0:1763343034.659508:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343034.659512:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb mtime from disk: 0 -> 1763343034 00002000:00010000:2.0:1763343034.659515:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343034.659517:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb ctime from disk: 0 -> 1763343034 00002000:00010000:2.0:1763343034.659519:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343034.659545:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993517440:12345-192.168.204.21@tcp:10:bash.0 Request processed in 1635us (2459us total) trans 17179871566 rc 0/0 00000100:00100000:2.0:1763343034.659553:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1580 00002000:00010000:2.0:1763343034.659556:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/667 (0->18446744073709551615) 00002000:00100000:2.0:1763343034.659559:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340664a680 with x1848997993517440 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343034.659563:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340664a680. 00000100:00100000:1.0:1763343034.671514:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.671677:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993517824 00000100:00100000:0.0:1763343034.671691:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993517824 00000100:00100000:0.0:1763343034.671769:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9203 00000100:00100000:0.0:1763343034.671780:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56861:x1848997993517824:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343034.671810:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.671841:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae629a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac910c expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.672121:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae62a1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.672139:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae62a1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.672153:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae62a1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343034.672167:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d7:0x0]: returning size 2 00010000:00010000:0.0:1763343034.672329:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae629a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac910c expref: 247 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.672350:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae62a1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac910c expref: 246 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.672360:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343034.672363:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763343034.672368:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d800, rc 0) 00000100:00100000:0.0:1763343034.672455:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56861:x1848997993517824:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 676us (955us total) trans 8589939871 rc 0/0 00000100:00100000:0.0:1763343034.672463:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9203 00000100:00100000:1.0:1763343034.681146:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.681280:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993518336 00000100:00100000:0.0:1763343034.681295:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993518336 00000100:00100000:0.0:1763343034.681372:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9204 00000100:00100000:0.0:1763343034.681383:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3507841450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56861:x1848997993518336:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343034.681413:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.681438:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae62af lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9113 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.681607:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.681722:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6285 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90fe expref: 247 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.681733:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.681778:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6285 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90fe expref: 247 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.681797:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6285 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90fe expref: 247 pid: 10041 timeout: 1328 lvb_type: 0 00000100:00100000:0.0:1763343034.681812:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010254720:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343034.682866:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a353c6e8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1763343034.683093:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.683298:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993518080 00000100:00100000:2.0:1763343034.683307:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993518080 00000100:00100000:2.0:1763343034.683374:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3131 00000100:00100000:2.0:1763343034.683384:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:55941:x1848997993518080:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:2.0:1763343034.683762:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:55941:x1848997993518080:12345-192.168.204.21@tcp:35:bash.0 Request processed in 378us (670us total) trans 8589939872 rc 0/0 00000100:00100000:2.0:1763343034.683770:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3131 00000100:00100000:0.0:1763343034.688539:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010254720:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343034.688582:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:3.0:1763343034.690885:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.692032:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993518464 00000100:00100000:0.0:1763343034.692048:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993518464 00010000:00010000:0.0:1763343034.692104:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6285 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90fe expref: 249 pid: 10041 timeout: 1328 lvb_type: 0 00000100:00100000:0.0:1763343034.692163:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3034 00000100:00100000:0.0:1763343034.692174:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:2430:x1848997993518464:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343034.692194:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343034.692202:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6285 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90fe expref: 249 pid: 10041 timeout: 1328 lvb_type: 0 00010000:00010000:0.0:1763343034.692216:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6285 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90fe expref: 249 pid: 10041 timeout: 1328 lvb_type: 0 00010000:00010000:0.0:1763343034.692245:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6285 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90fe expref: 249 pid: 10041 timeout: 1328 lvb_type: 0 00010000:00010000:0.0:1763343034.692267:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343034.692273:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.692286:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.692295:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.692339:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343034.692398:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.692410:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343034.692423:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:2430:x1848997993518464:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 249us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.692432:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3034 00000004:00200000:1.0:1763343034.692442:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d7:0x0]: returning size 2 00010000:00010000:1.0:1763343034.692674:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae62af lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9113 expref: 249 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.692693:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9113 expref: 248 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.692709:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:1.0:1763343034.692712:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763343034.692715:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d200, rc 0) 00000100:00100000:1.0:1763343034.692751:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3507841450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56861:x1848997993518336:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 11370us (11621us total) trans 8589939873 rc 0/0 00000100:00100000:1.0:1763343034.692760:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9204 00000100:00100000:3.0:1763343034.697121:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.697252:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993518592 00000100:00100000:1.0:1763343034.697270:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993518592 00000100:00100000:1.0:1763343034.697343:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9205 00000100:00100000:1.0:1763343034.697355:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56862:x1848997993518592:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:1.0:1763343034.697470:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.697502:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae62c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac911a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.697593:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae62cb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.697609:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae62cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.698443:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae62cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.698475:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.698485:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.698497:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.698601:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae62d9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.698614:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9113 expref: 249 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.698640:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae62d9 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.698689:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9113 expref: 249 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.698707:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9113 expref: 249 pid: 6523 timeout: 1328 lvb_type: 0 00000100:00100000:1.0:1763343034.698725:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c250a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010254848:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343034.699141:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe540 going to sleep for 11 seconds 00000100:00100000:0.0:1763343034.699662:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.699829:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993518720 00000100:00100000:2.0:1763343034.699839:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993518720 00000100:00100000:2.0:1763343034.699907:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9206 00000100:00100000:2.0:1763343034.699917:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56861:x1848997993518720:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.699945:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.699963:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae62e0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9121 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.700072:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343034.700085:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343034.700094:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:1.0:1763343034.703170:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c250a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010254848:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343034.703210:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae62d9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343034.705842:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.708224:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993518848 00000100:00100000:2.0:1763343034.708248:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993518848 00010000:00010000:2.0:1763343034.708329:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9113 expref: 252 pid: 6523 timeout: 1328 lvb_type: 0 00000100:00100000:2.0:1763343034.708394:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3035 00000100:00100000:2.0:1763343034.708408:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:2430:x1848997993518848:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343034.708429:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343034.708439:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9113 expref: 252 pid: 6523 timeout: 1328 lvb_type: 0 00010000:00010000:2.0:1763343034.708454:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9113 expref: 252 pid: 6523 timeout: 1328 lvb_type: 0 00010000:00010000:2.0:1763343034.708483:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae62b6 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1d7:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9113 expref: 252 pid: 6523 timeout: 1328 lvb_type: 0 00010000:00010000:2.0:1763343034.708504:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:2.0:1763343034.708511:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae62d9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.708525:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae62d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.708535:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae62d9 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.708544:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343034.708551:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343034.708557:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343034.708604:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343034.708657:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae62d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708666:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae62d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343034.708707:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:2430:x1848997993518848:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 302us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.708717:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3035 00000004:00200000:1.0:1763343034.708734:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d7:0x0]: returning size 5 00000004:00200000:1.0:1763343034.708740:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343034.708763:0:6523:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae62d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708799:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae62d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708814:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae62cb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708822:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae62cb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708828:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae62cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708835:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae62cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708842:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.708847:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae62cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708856:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae62cb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708874:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aabe00) 00010000:00010000:1.0:1763343034.708877:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.708882:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae62cb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708889:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae62cb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708905:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708911:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708918:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708927:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.708938:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708944:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708954:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab200) 00010000:00010000:1.0:1763343034.708957:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.708960:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.708965:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.709009:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae62c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac911a expref: 251 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.709028:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae62d9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac911a expref: 250 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.709036:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:1.0:1763343034.709039:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343034.709042:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343034.709089:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56862:x1848997993518592:12345-192.168.204.21@tcp:101:rm.0 Request processed in 11737us (11983us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343034.709098:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9205 00010000:00010000:0.0:1763343034.709198:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.709207:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343034.709237:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d7:0x0]: returning size 5 00000004:00200000:0.0:1763343034.709240:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343034.709252:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343034.709277:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae62e0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9121 expref: 250 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.709293:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9121 expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.709299:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343034.709301:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343034.709304:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc000, rc 0) 00000100:00100000:0.0:1763343034.709348:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56861:x1848997993518720:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 9432us (9688us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.709355:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9206 00000100:00100000:3.0:1763343034.716798:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.717107:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993519104 00000100:00100000:0.0:1763343034.717122:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993519104 00000100:00100000:0.0:1763343034.717203:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3132 00000100:00100000:0.0:1763343034.717215:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56862:x1848997993519104:12345-192.168.204.21@tcp:35:rm.0 00000100:00100000:0.0:1763343034.717681:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56862:x1848997993519104:12345-192.168.204.21@tcp:35:rm.0 Request processed in 465us (893us total) trans 8589939874 rc 0/0 00000100:00100000:0.0:1763343034.717691:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3132 00000100:00100000:1.0:1763343034.720094:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.720345:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993519360 00000100:00100000:0.0:1763343034.720360:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993519360 00000100:00100000:3.0:1763343034.720521:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.720857:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993519616 00000100:00100000:1.0:1763343034.720862:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993519616 00000100:00100000:1.0:1763343034.720904:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9207 00000100:00100000:1.0:1763343034.720916:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56861:x1848997993519360:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:3.0:1763343034.720921:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9208 00000100:00100000:3.0:1763343034.720939:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56862:x1848997993519616:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:1.0:1763343034.720954:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.720986:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae62ee lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9128 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.721003:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1763343034.721033:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae62a1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac910c expref: 252 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.721099:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62f5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.721115:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62f5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343034.721127:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62f5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343034.721133:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae6238 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90e2 expref: 251 pid: 10041 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1763343034.721141:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d7:0x0]: returning size 5 00010000:00010000:3.0:1763343034.721147:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6246 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f0 expref: 250 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.721157:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae62d9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac911a expref: 249 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.721174:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae61f9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90c6 expref: 248 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.721188:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:3.0:1763343034.721194:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343034.721215:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6303 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.721223:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6303 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.721234:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6303 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.721245:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae630a lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.721250:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae630a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.721256:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae630a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.721278:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae62ee lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9128 expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.721292:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62f5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9128 expref: 248 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.721311:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:1.0:1763343034.721314:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343034.721317:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00010000:00010000:3.0:1763343034.721336:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6311 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.721346:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9121 expref: 248 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.721354:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6311 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.721391:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9121 expref: 248 pid: 10041 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343034.721396:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56861:x1848997993519360:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 483us (1320us total) trans 8589939875 rc 0/0 00000100:00100000:1.0:1763343034.721403:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9207 00010000:00010000:3.0:1763343034.721406:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9121 expref: 248 pid: 10041 timeout: 1328 lvb_type: 0 00000100:00100000:3.0:1763343034.721421:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406649c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010254976:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343034.721508:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a351ffa9840 going to sleep for 11 seconds 00000100:00100000:3.0:1763343034.726075:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.726139:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993519744 00000100:00100000:2.0:1763343034.726154:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993519744 00000100:00100000:0.0:1763343034.726204:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406649c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010254976:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343034.726213:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9121 expref: 248 pid: 10041 timeout: 1328 lvb_type: 0 00010000:00010000:0.0:1763343034.726246:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6311 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343034.729189:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3036 00000100:00100000:2.0:1763343034.729223:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:2429:x1848997993519744:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343034.729255:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343034.729267:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9121 expref: 248 pid: 10041 timeout: 1328 lvb_type: 0 00010000:00010000:2.0:1763343034.729287:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9121 expref: 248 pid: 10041 timeout: 1328 lvb_type: 0 00010000:00010000:2.0:1763343034.729325:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae62e7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9121 expref: 248 pid: 10041 timeout: 1328 lvb_type: 0 00010000:00010000:2.0:1763343034.729346:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:2.0:1763343034.729353:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6311 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.729366:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6311 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.729374:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6311 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.729416:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343034.729503:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:2429:x1848997993519744:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 296us (3445us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.729513:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3036 00000100:00100000:2.0:1763343034.729780:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.730315:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993519872 00000100:00100000:3.0:1763343034.730327:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993519872 00000100:00100000:3.0:1763343034.730390:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9209 00000100:00100000:3.0:1763343034.730400:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56861:x1848997993519872:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343034.730427:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.730452:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6318 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac912f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.730520:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6318 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac912f expref: 248 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.730536:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6318 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac912f expref: 248 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.730557:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:3.0:1763343034.730560:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343034.730696:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92a00, rc 0) 00000100:00100000:3.0:1763343034.730763:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56861:x1848997993519872:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 364us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.730771:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9209 00010000:00010000:0.0:1763343034.732323:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6311 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732341:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6311 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00080000:0.0:1763343034.732727:0:28422:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1d7:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1763343034.732833:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6311 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732842:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6311 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732850:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6311 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732855:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343034.732859:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6311 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732866:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6311 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732883:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343034.732886:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343034.732890:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6311 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732895:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6311 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732914:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6303 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732920:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6303 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732925:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6303 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732939:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343034.732942:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6303 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732947:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6303 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732954:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8a00) 00010000:00010000:0.0:1763343034.732956:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343034.732959:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6303 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732964:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6303 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343034.732979:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002bde3361 reply state 000000008eff0f5f transno 8589939876 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae630a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732991:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae630a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.732998:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8900) 00010000:00010000:0.0:1763343034.733000:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343034.733004:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343034.733102:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56862:x1848997993519616:12345-192.168.204.21@tcp:36:rm.0 Request processed in 12169us (12577us total) trans 8589939876 rc 0/0 00000100:00100000:0.0:1763343034.733112:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9208 00000100:00100000:1.0:1763343034.739530:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.739848:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993520000 00000100:00100000:3.0:1763343034.739863:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993520000 00000100:00100000:3.0:1763343034.739950:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6460 00000100:00100000:3.0:1763343034.739962:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993520000:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:3.0:1763343034.740026:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae631f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.740051:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 22 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.740065:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343034.740067:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343034.740073:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae631f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.740121:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 22 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.740137:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 22 pid: 28648 timeout: 1328 lvb_type: 0 00000100:00100000:3.0:1763343034.740155:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406649180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010255104:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343034.740275:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a351ffa9840 going to sleep for 11 seconds 00000100:00100000:3.0:1763343034.742696:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406649180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010255104:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343034.742735:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae631f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343034.745481:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.745910:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993520128 00000100:00100000:0.0:1763343034.745924:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993520128 00002000:00100000:0.0:1763343034.745997:0:28424:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x29b:0x0] (0->4) req@ffff9a340c250000 x1848997993520128/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:530/0 lens 496/0 e 0 to 0 dl 1763343045 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343034.746009:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340c250000 with x1848997993520128 ext(0->4) 00010000:00010000:0.0:1763343034.746019:0:28424:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 23 pid: 28648 timeout: 1328 lvb_type: 0 00010000:00010000:0.0:1763343034.746036:0:28424:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 23 pid: 28648 timeout: 1328 lvb_type: 0 00002000:00010000:0.0:1763343034.746044:0:28424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a340c250000 00000100:00100000:0.0:1763343034.746082:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 105 00000100:00100000:0.0:1763343034.746093:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2429:x1848997993520128:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:0.0:1763343034.752008:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.752679:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993520256 00000100:00100000:3.0:1763343034.752693:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993520256 00000100:00100000:1.0:1763343034.752819:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2429:x1848997993520128:12345-192.168.204.21@tcp:4:bash.0 Request processed in 6722us (7350us total) trans 17179871567 rc 0/0 00000100:00100000:1.0:1763343034.752837:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 105 00002000:00100000:1.0:1763343034.752852:0:28424:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x29b:0x0] (0->4) req@ffff9a340c250000 x1848997993520128/t17179871567(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:530/0 lens 496/448 e 0 to 0 dl 1763343045 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763343034.752862:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340c250000 with x1848997993520128 ext(0->4) 00010000:00010000:1.0:1763343034.752874:0:28424:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 25 pid: 28648 timeout: 1328 lvb_type: 0 00010000:00010000:1.0:1763343034.752892:0:28424:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 25 pid: 28648 timeout: 1328 lvb_type: 0 00002000:00010000:1.0:1763343034.752900:0:28424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a340c250000 00000100:00100000:3.0:1763343034.753381:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9210 00000100:00100000:3.0:1763343034.753392:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56863:x1848997993520256:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343034.753420:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.753451:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6326 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9136 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.755308:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae632d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755334:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae632d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755350:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae632d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755363:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6334 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755371:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6334 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755378:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6334 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755445:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae632d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755453:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae632d lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755461:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae632d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755468:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058ddc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.755473:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae632d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755481:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae632d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755496:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:2.0:1763343034.755500:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.755520:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae632d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755527:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae632d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755545:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6334 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755550:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6334 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755555:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6334 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755560:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.755562:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6334 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755568:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6334 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755575:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8900) 00010000:00010000:2.0:1763343034.755577:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.755580:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6334 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755585:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6334 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.755714:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6326 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9136 expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.755733:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:2.0:1763343034.755736:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.755740:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6326 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9136 expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.755758:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:2.0:1763343034.755868:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56863:x1848997993520256:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2476us (3873us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343034.755877:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9210 00000100:00100000:0.0:1763343034.757032:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.757108:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993520384 00000100:00100000:2.0:1763343034.757119:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993520384 00010000:00010000:2.0:1763343034.757166:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 25 pid: 28648 timeout: 1328 lvb_type: 0 00000100:00100000:2.0:1763343034.757290:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3037 00000100:00100000:2.0:1763343034.757302:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2430:x1848997993520384:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343034.757321:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763343034.757343:0:13199:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763343034.757347:0:13199:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343034.757353:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 25 pid: 28648 timeout: 1328 lvb_type: 0 00010000:00010000:2.0:1763343034.757368:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 25 pid: 28648 timeout: 1328 lvb_type: 0 00010000:00010000:2.0:1763343034.757392:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dce00/0x607405d401ae6269 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac90f7 expref: 25 pid: 28648 timeout: 1328 lvb_type: 0 00010000:00010000:2.0:1763343034.757409:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.757411:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.757417:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae631f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.757428:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae631f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.757937:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae631f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.757949:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae631f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.757973:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae631f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.757982:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae631f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.757989:0:28995:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae631f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.757995:0:28995:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343034.757999:0:28995:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae631f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.758008:0:28995:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae631f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.758022:0:28995:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae631f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343034.758123:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993520000:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 18161us (18608us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343034.758133:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6460 00010000:00010000:2.0:1763343034.758202:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae631f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.758228:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343034.758252:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993520384:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 953us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.758260:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3037 00000100:00100000:3.0:1763343034.763874:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.763953:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.764044:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993520512 00000100:00100000:2.0:1763343034.764059:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993520512 00000100:00100000:2.0:1763343034.764129:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993520768 00000100:00100000:2.0:1763343034.764133:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993520768 00000100:00100000:2.0:1763343034.764175:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9211 00000100:00100000:2.0:1763343034.764186:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56863:x1848997993520512:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.764215:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.764246:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae633b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac913d expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343034.764308:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9212 00000100:00100000:0.0:1763343034.764321:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56861:x1848997993520768:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343034.764377:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343034.764487:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6318 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac912f expref: 251 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.764508:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343034.764515:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343034.764530:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6342 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.764541:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6349 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.764551:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6342 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.764551:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6349 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.764562:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6342 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343034.764562:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6349 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.764573:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae6350 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764579:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae6350 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764585:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae6350 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764716:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6342 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764724:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6342 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764732:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6342 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764738:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058ddc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.764742:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6342 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764750:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6342 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764759:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7e00) 00010000:00010000:2.0:1763343034.764763:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.764767:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6342 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764774:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6342 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764785:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae6350 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764791:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae6350 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764797:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae6350 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764802:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.764804:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae6350 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764809:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae6350 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764815:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8900) 00010000:00010000:2.0:1763343034.764818:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.764821:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae6350 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.764827:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae6350 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000040:00080000:0.0:1763343034.765037:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1401, 88 off118480 00000004:00080000:0.0:1763343034.765047:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228432425158ns, next at 1228493164729ns, rc = 0 00000040:00080000:0.0:1763343034.765095:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1400, 88 off118480 00000004:00080000:0.0:1763343034.765100:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1228432479535ns, next at 1228493192443ns, rc = 0 00000040:00080000:0.0:1763343034.765129:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1401, 88 off118568 00000004:00080000:0.0:1763343034.765134:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1228432513203ns, next at 1228493192443ns, rc = 0 00000040:00080000:0.0:1763343034.765144:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1402, 88 off118568 00000004:00080000:0.0:1763343034.765148:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228432527789ns, next at 1228493164729ns, rc = 0 00010000:00010000:2.0:1763343034.765419:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae633b lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac913d expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.765431:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7e00) 00010000:00010000:2.0:1763343034.765434:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.765438:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae633b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac913d expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.766205:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd200, rc 0) 00000100:00100000:2.0:1763343034.766317:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56863:x1848997993520512:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2129us (2457us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343034.766327:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9211 00000001:00080000:0.0:1763343034.768304:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939877 is committed 00000004:00080000:0.0:1763343034.768319:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 923 committed 00000004:00080000:0.0:1763343034.768334:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 924 committed 00010000:00010000:3.0:1763343034.768345:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae630a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00000004:00080000:0.0:1763343034.768345:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 923 committed 00000004:00080000:0.0:1763343034.768347:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 922 committed 00010000:00010000:3.0:1763343034.768362:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae630a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343034.768440:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009498e111 reply state 000000000afbc42c transno 8589939877 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6349 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.768463:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6349 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.768474:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00000100:00100000:2.0:1763343034.768477:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:0.0:1763343034.768477:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343034.768483:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343034.768515:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993520896 00010000:00010000:3.0:1763343034.768520:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae630a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343034.768528:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993520896 00010000:00010000:3.0:1763343034.768529:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343034.768536:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae630a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.768547:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae630a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.768562:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8900) 00010000:00010000:3.0:1763343034.768566:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343034.768571:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae630a lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343034.768578:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae630a lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343034.768589:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9213 00000100:00100000:2.0:1763343034.768601:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56863:x1848997993520896:12345-192.168.204.21@tcp:101:lfs.0 00010000:00080000:0.0:1763343034.768607:0:6523:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343034.768649:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56861:x1848997993520768:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 4332us (4695us total) trans 8589939877 rc 0/0 00010000:00010000:2.0:1763343034.768651:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6349 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.768658:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6349 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343034.768658:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9212 00010000:00010000:2.0:1763343034.768664:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6349 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.768669:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.768672:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6349 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.768678:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6349 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.768687:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:2.0:1763343034.768689:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343034.768693:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6349 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.768699:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6349 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:1.0:1763343034.768876:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010255360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343034.768940:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343034.769055:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343034.769062:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010255488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343034.769088:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343034.769116:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010255360 00000100:00100000:1.0:1763343034.769120:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010255360 00000100:00100000:1.0:1763343034.769148:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010255488 00000100:00100000:1.0:1763343034.769150:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010255488 00000100:00100000:1.0:1763343034.769173:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6461 00000100:00100000:1.0:1763343034.769179:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3657:x1848998010255360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343034.769335:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010255616:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343034.769365:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343034.769370:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3657:x1848998010255360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (439us total) trans 21474838866 rc 0/0 00000100:00100000:1.0:1763343034.769377:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6461 00000100:00100000:2.0:1763343034.769384:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343034.769389:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010255232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343034.769390:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010255616 00000100:00100000:1.0:1763343034.769393:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010255616 00000100:00100000:2.0:1763343034.769409:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343034.769410:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6462 00000100:00100000:1.0:1763343034.769414:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3657:x1848998010255488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343034.769434:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010255232 00000100:00100000:2.0:1763343034.769438:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010255232 00000100:00100000:2.0:1763343034.769460:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6463 00000100:00100000:2.0:1763343034.769467:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3659:x1848998010255616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343034.769508:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3657:x1848998010255488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (419us total) trans 17179871568 rc 0/0 00000100:00100000:1.0:1763343034.769515:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6462 00000100:00100000:1.0:1763343034.769528:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6464 00000100:00100000:1.0:1763343034.769533:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3659:x1848998010255232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343034.769550:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3659:x1848998010255616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (184us total) trans 17179871569 rc 0/0 00000100:00100000:2.0:1763343034.769556:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6463 00000004:00080000:2.0:1763343034.769599:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c253100/2, rc 0, transno 17179871569 00002000:00010000:1.0:1763343034.769602:0:28648:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x299:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1763343034.769606:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010255616:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763343034.769606:0:28648:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x299:0x0] updating lvb mtime from disk: 1763343034 -> 1763343034 00002000:00010000:1.0:1763343034.769609:0:28648:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x299:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343034.769612:0:28648:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x299:0x0] updating lvb ctime from disk: 1763343034 -> 1763343034 00002000:00010000:1.0:1763343034.769615:0:28648:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x299:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1763343034.769646:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763343034.769671:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3659:x1848998010255232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (260us total) trans 21474838867 rc 0/0 00010000:00010000:2.0:1763343034.769672:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae6357 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9144 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343034.769681:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6464 00000004:00080000:1.0:1763343034.769711:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c253800/2, rc 0, transno 21474838867 00000100:00100000:1.0:1763343034.769717:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010255232:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343034.769737:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c251f80/2, rc 0, transno 17179871568 00000100:00100000:1.0:1763343034.769740:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010255488:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763343034.769748:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c251880/2, rc 0, transno 21474838866 00000100:00100000:1.0:1763343034.769751:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010255360:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1763343034.771889:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae635e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.771919:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae635e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.771967:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae635e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343034.772033:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343034.772039:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343034.772088:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae6357 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9144 expref: 240 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.772108:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae635e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9144 expref: 239 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.772118:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7b00) 00010000:00010000:2.0:1763343034.772121:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343034.772124:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dce00, rc 0) 00000100:00100000:2.0:1763343034.772211:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56863:x1848997993520896:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3611us (3738us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.772226:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9213 00000100:00100000:2.0:1763343034.775298:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.775758:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993521024 00000100:00100000:0.0:1763343034.775771:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993521024 00000100:00100000:0.0:1763343034.775846:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9214 00000100:00100000:0.0:1763343034.775857:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56861:x1848997993521024:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343034.775888:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.775916:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6365 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac914b expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.776003:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6365 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac914b expref: 240 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.776021:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6365 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac914b expref: 240 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.776042:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343034.776047:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343034.776050:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665dc00, rc 0) 00000100:00100000:0.0:1763343034.776126:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56861:x1848997993521024:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 271us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.776133:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9214 00010000:00010000:1.0:1763343034.781455:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343034.782334:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.783073:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993521152 00000100:00100000:2.0:1763343034.783089:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993521152 00000100:00100000:2.0:1763343034.783211:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9215 00000100:00100000:2.0:1763343034.783223:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56861:x1848997993521152:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.783252:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.783280:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae636c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9152 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.783379:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6373 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.783398:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6373 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.783412:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6373 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343034.783468:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d7:0x0]: returning size 5 00000004:00200000:2.0:1763343034.783474:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343034.783497:0:6523:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6373 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.783528:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae636c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9152 expref: 242 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.783548:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6373 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9152 expref: 241 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.783560:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:2.0:1763343034.784320:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763343034.784327:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd200, rc 0) 00000100:00100000:2.0:1763343034.784501:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56861:x1848997993521152:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1276us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.784512:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9215 00000100:00100000:3.0:1763343034.786339:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.786577:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993521280 00000100:00100000:2.0:1763343034.786590:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993521280 00000100:00100000:2.0:1763343034.786680:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9216 00000100:00100000:2.0:1763343034.786691:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56863:x1848997993521280:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.786728:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.786757:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae637a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9159 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.786848:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6381 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.786866:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6381 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.786881:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6381 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.786898:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6388 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.786906:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6388 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.786912:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6388 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.786985:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6381 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.786993:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6381 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.787001:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6381 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.787009:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6381 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.787016:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058ddc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.787021:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6381 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.787034:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6381 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.787048:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7b00) 00010000:00010000:2.0:1763343034.787051:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.787057:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6381 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.787065:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae6381 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.787082:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6388 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.787089:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6388 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.787096:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6388 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.787102:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.787105:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6388 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.787112:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6388 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.787120:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3538bf7e00) 00010000:00010000:2.0:1763343034.787123:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.787126:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6388 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.787133:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae6388 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.787169:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae637a lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9159 expref: 242 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.787181:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7b00) 00010000:00010000:2.0:1763343034.787183:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.787186:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae637a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9159 expref: 242 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.787195:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd400, rc 0) 00000100:00100000:2.0:1763343034.787267:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56863:x1848997993521280:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 578us (939us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343034.787276:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9216 00000100:00100000:3.0:1763343034.791171:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.791501:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.791576:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993521408 00000100:00100000:0.0:1763343034.791591:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993521408 00000100:00100000:2.0:1763343034.792173:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993521664 00000100:00100000:2.0:1763343034.792180:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993521664 00000100:00100000:2.0:1763343034.792218:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6465 00000100:00100000:2.0:1763343034.792233:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2431:x1848997993521408:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.792259:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.792289:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae638f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9160 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343034.792321:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29b:0x0] initial LVB size: 5, mtime: 0x691a7aba, atime: 0x0, ctime: 0x691a7aba, blocks: 0x8 00010000:00010000:2.0:1763343034.792347:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.792350:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.792363:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae638f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9160 expref: 24 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343034.792385:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae638f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9160 expref: 24 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343034.792401:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dcc00, rc 0) 00000100:00100000:2.0:1763343034.792481:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2431:x1848997993521408:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 252us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.792490:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6465 00000100:00100000:1.0:1763343034.792612:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9217 00000100:00100000:1.0:1763343034.792642:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56863:x1848997993521664:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343034.792657:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.792660:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343034.792690:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae635e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9144 expref: 241 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.792711:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7b00) 00010000:00010000:1.0:1763343034.792722:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343034.792735:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6396 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9167 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.792852:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae639d lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.792866:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae639d lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.792882:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae639d lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.792895:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae63a4 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.792902:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae63a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.792908:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae63a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.797581:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae63ab lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.797614:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae63ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.797649:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae63ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343034.797665:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d9:0x0]: returning size 0 00010000:00010000:1.0:1763343034.797697:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae639d lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.797706:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae639d lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.797714:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae639d lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.797720:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.797725:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae639d lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.797735:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae639d lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.797748:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aabe00) 00010000:00010000:1.0:1763343034.797752:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.797757:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae639d lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.797764:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae639d lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:1.0:1763343034.797781:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000069b93664 reply state 00000000636fff36 transno 8589939878 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae63a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.797793:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae63a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.797799:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab200) 00010000:00010000:1.0:1763343034.797802:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343034.797805:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343034.797851:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6396 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9167 expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.797878:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae63ab lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9167 expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.797886:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a3403aabf00) 00010000:00010000:1.0:1763343034.797889:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343034.797891:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:1.0:1763343034.798015:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56863:x1848997993521664:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 5394us (6514us total) trans 8589939878 rc 0/0 00000100:00100000:1.0:1763343034.798030:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9217 00000100:00100000:3.0:1763343034.801426:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.801543:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993521920 00000100:00100000:2.0:1763343034.801558:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993521920 00000100:00100000:2.0:1763343034.801669:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9218 00000100:00100000:2.0:1763343034.801681:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56863:x1848997993521920:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.801715:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.801747:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae63b9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac916e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.801886:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae63c0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.801903:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae63ab lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9167 expref: 244 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.801913:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae63c0 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.801968:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae63ab lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9167 expref: 244 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.801982:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae63ab lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9167 expref: 244 pid: 28422 timeout: 1328 lvb_type: 0 00000100:00100000:2.0:1763343034.802003:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010255744:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343034.802110:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35012ed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343034.806489:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010255744:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343034.806530:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae63c0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:3.0:1763343034.810108:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.810442:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993522048 00000100:00100000:2.0:1763343034.810456:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993522048 00010000:00010000:2.0:1763343034.810509:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae63ab lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9167 expref: 245 pid: 28422 timeout: 1328 lvb_type: 0 00000100:00100000:2.0:1763343034.810562:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3038 00000100:00100000:2.0:1763343034.810573:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3517413c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:2430:x1848997993522048:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343034.810593:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343034.810602:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae63ab lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9167 expref: 245 pid: 28422 timeout: 1328 lvb_type: 0 00010000:00010000:2.0:1763343034.810615:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae63ab lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9167 expref: 245 pid: 28422 timeout: 1328 lvb_type: 0 00010000:00010000:2.0:1763343034.810764:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae63ab lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9167 expref: 245 pid: 28422 timeout: 1328 lvb_type: 0 00010000:00010000:2.0:1763343034.810785:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a3403aabf00) 00010000:00010000:2.0:1763343034.810792:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae63c0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.810812:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae63c0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.810820:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae63c0 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.812488:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343034.812593:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3517413c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:2430:x1848997993522048:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 2013us (2493us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.812610:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3038 00010000:00010000:2.0:1763343034.812895:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae63c0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.812908:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae63c0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343034.812951:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d9:0x0]: returning size 0 00000004:00080000:1.0:1763343034.813586:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x29b:0x0], index 0: 0 00000004:00080000:1.0:1763343034.813597:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x29d:0x0], index 1: 0 00000004:00080000:1.0:1763343034.813602:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x29e:0x0], index 1: 0 00000004:00080000:1.0:1763343034.813607:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x29c:0x0], index 0: 0 00010000:00010000:1.0:1763343034.813783:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae63c0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.813794:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae63c0 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.813803:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae63c0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.813809:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.813815:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae63c0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.813824:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae63c0 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.813844:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a3403aabf00) 00010000:00010000:1.0:1763343034.813848:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343034.813854:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae63c0 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.813860:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae63c0 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.813942:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae63b9 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac916e expref: 244 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.813963:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a3403aabf00) 00010000:00010000:1.0:1763343034.813966:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343034.813970:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae63b9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac916e expref: 244 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.813988:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd400, rc 0) 00000100:00100000:1.0:1763343034.814271:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56863:x1848997993521920:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 12590us (12860us total) trans 8589939879 rc 301/301 00000100:00100000:1.0:1763343034.814281:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9218 00000100:00100000:3.0:1763343034.820168:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.820415:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993522304 00000100:00100000:1.0:1763343034.820430:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993522304 00000100:00100000:1.0:1763343034.820510:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3133 00000100:00100000:1.0:1763343034.820523:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56863:x1848997993522304:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343034.820975:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56863:x1848997993522304:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 453us (820us total) trans 8589939880 rc 0/0 00000100:00100000:1.0:1763343034.820984:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3133 00000100:00100000:3.0:1763343034.825853:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.826043:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993522560 00000100:00100000:1.0:1763343034.826057:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993522560 00000100:00100000:1.0:1763343034.826874:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3134 00000100:00100000:1.0:1763343034.826893:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56863:x1848997993522560:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343034.827657:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56863:x1848997993522560:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 763us (1811us total) trans 8589939881 rc 0/0 00000100:00100000:1.0:1763343034.827670:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3134 00000100:00100000:2.0:1763343034.840795:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.840916:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993522816 00000100:00100000:1.0:1763343034.840939:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993522816 00000100:00100000:1.0:1763343034.841018:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9219 00000100:00100000:1.0:1763343034.841029:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:55941:x1848997993522816:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343034.841061:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.841091:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae63ce lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9175 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.841394:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae63d5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841413:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae63d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841427:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae63d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841441:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63dc lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841448:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841454:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841530:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae63e3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841539:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae63e3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841546:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae63e3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343034.841562:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d9:0x0]: returning size 0 00010000:00010000:1.0:1763343034.841798:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae63d5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841807:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae63d5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841813:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae63d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841819:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae63d5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841826:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.841830:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae63d5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841838:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae63d5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841853:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aabf00) 00010000:00010000:1.0:1763343034.841857:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.841863:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae63d5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841869:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae63d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841883:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841889:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841899:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841903:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.841906:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841911:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841918:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab200) 00010000:00010000:1.0:1763343034.841920:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.841924:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63dc lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.841941:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63dc lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.843262:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae63ce lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9175 expref: 248 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.843311:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae63e3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9175 expref: 247 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.843319:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a3403aabe00) 00010000:00010000:0.0:1763343034.843321:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343034.843324:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00000100:00100000:0.0:1763343034.843422:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:55941:x1848997993522816:12345-192.168.204.21@tcp:101:bash.0 Request processed in 2393us (2641us total) trans 8589939882 rc 0/0 00000100:00100000:0.0:1763343034.843432:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9219 00000100:00100000:3.0:1763343034.849051:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.849499:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993522944 00000100:00100000:0.0:1763343034.849512:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993522944 00000100:00100000:0.0:1763343034.849595:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9220 00000100:00100000:0.0:1763343034.849607:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:55941:x1848997993522944:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343034.849656:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.849684:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae63f1 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac917c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.849733:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae63f8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.849748:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae63f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.849761:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae63f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.849896:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae63f1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac917c expref: 249 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.849915:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae63f8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac917c expref: 248 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.849924:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a3403aabe00) 00010000:00010000:0.0:1763343034.849937:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343034.849941:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d800, rc 0) 00000100:00100000:0.0:1763343034.850032:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:55941:x1848997993522944:12345-192.168.204.21@tcp:101:bash.0 Request processed in 426us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343034.850043:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9220 00000100:00100000:3.0:1763343034.855676:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.855722:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.855810:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993523328 00000100:00100000:2.0:1763343034.855827:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993523328 00000100:00100000:1.0:1763343034.855837:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993523200 00000100:00100000:1.0:1763343034.855844:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993523200 00000100:00100000:2.0:1763343034.855916:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6466 00000100:00100000:1.0:1763343034.855917:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9221 00000100:00100000:1.0:1763343034.855943:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:55941:x1848997993523200:12345-192.168.204.21@tcp:36:bash.0 00000100:00100000:2.0:1763343034.855945:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993523328:12345-192.168.204.21@tcp:23:lfs.0 00010000:00010000:1.0:1763343034.856018:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343034.856057:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae63e3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9175 expref: 248 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.856083:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a3403aabe00) 00010000:00010000:1.0:1763343034.856089:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343034.856105:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993523328:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 175us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.856115:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6466 00010000:00010000:1.0:1763343034.856418:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63ff lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.856442:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63ff lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.856454:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63ff lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000001:00080000:1.0:1763343034.856516:0:28422:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939883 00000004:00010000:1.0:1763343034.856543:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000008864669 reply state 000000009bcba8f0 transno 8589939884 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63ff lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.856556:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343034.856570:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a3403aabe00) 00010000:00010000:1.0:1763343034.856572:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343034.856577:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343034.860569:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:55941:x1848997993523200:12345-192.168.204.21@tcp:36:bash.0 Request processed in 4623us (4936us total) trans 8589939884 rc 0/0 00000100:00100000:1.0:1763343034.860586:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9221 00000020:00080000:1.0:1763343034.860594:0:28422:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343034.866119:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.867093:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993523456 00000100:00100000:2.0:1763343034.867110:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993523456 00000100:00100000:2.0:1763343034.867204:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9222 00000100:00100000:2.0:1763343034.867353:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:55941:x1848997993523456:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343034.867391:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.867419:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae6406 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9183 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.867549:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae6406 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9183 expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.867567:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae6406 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9183 expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.867589:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a3403aabe00) 00010000:00010000:2.0:1763343034.867593:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343034.867598:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd800, rc 0) 00000100:00100000:2.0:1763343034.868088:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:55941:x1848997993523456:12345-192.168.204.21@tcp:101:bash.0 Request processed in 871us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.868097:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9222 00000100:00100000:0.0:1763343034.868745:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.868845:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993523584 00000100:00100000:3.0:1763343034.868856:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993523584 00000100:00100000:3.0:1763343034.868909:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6467 00000100:00100000:3.0:1763343034.868920:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2432:x1848997993523584:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:3.0:1763343034.869045:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2432:x1848997993523584:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 126us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.869053:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6467 00000100:00100000:1.0:1763343034.873731:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.873823:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993523840 00000100:00100000:2.0:1763343034.873838:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993523840 00000100:00100000:2.0:1763343034.873924:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9223 00000100:00100000:2.0:1763343034.873961:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:55941:x1848997993523840:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343034.873988:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.873992:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343034.874027:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae6406 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9183 expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.874048:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a3403aabe00) 00010000:00010000:2.0:1763343034.874055:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343034.874073:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae640d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac918a expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.874136:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae6414 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.874154:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae6414 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.874164:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae6414 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:2.0:1763343034.874484:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1402, 88 off118656 00000004:00080000:2.0:1763343034.874495:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1228541873737ns, next at 1228493192443ns, rc = 0 00000040:00080000:2.0:1763343034.874549:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1403, 88 off118656 00000004:00080000:2.0:1763343034.874555:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228541934599ns, next at 1228493164729ns, rc = 0 00000040:00080000:2.0:1763343034.874584:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1404, 88 off118744 00000004:00080000:2.0:1763343034.874590:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228541969469ns, next at 1228493164729ns, rc = 0 00000040:00080000:2.0:1763343034.874601:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1403, 88 off118744 00000004:00080000:2.0:1763343034.874605:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1228541984393ns, next at 1228493192443ns, rc = 0 00000100:00100000:0.0:1763343034.876500:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.876579:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993523968 00000100:00100000:1.0:1763343034.876593:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993523968 00000100:00100000:1.0:1763343034.876841:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1582 00000100:00100000:1.0:1763343034.876854:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2432:x1848997993523968:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:1.0:1763343034.876903:0:28424:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae641b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.876922:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343034.876936:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343034.876945:0:28424:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae641b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.876965:0:28424:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae641b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.877097:0:28424:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae641b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.877107:0:28424:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae641b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.877116:0:28424:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae641b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.877125:0:28424:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343034.877130:0:28424:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae641b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.877140:0:28424:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae641b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.877159:0:28424:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae641b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.877168:0:28424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae641b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343034.877273:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2432:x1848997993523968:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 420us (785us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763343034.877288:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1582 00000001:00080000:0.0:1763343034.878667:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939885 is committed 00000004:00080000:0.0:1763343034.878681:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 926 committed 00010000:00010000:2.0:1763343034.878690:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae63a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00000004:00080000:0.0:1763343034.878694:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 925 committed 00010000:00010000:2.0:1763343034.878706:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae63a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00000004:00080000:0.0:1763343034.878708:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 924 committed 00000004:00080000:0.0:1763343034.878714:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 925 committed 00010000:00010000:2.0:1763343034.878717:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae63a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.878724:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.878730:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae63a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.878737:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae63a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.878756:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab200) 00010000:00010000:2.0:1763343034.878761:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.878767:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae63a4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.878773:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae63a4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.878803:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.878810:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.878816:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.878821:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343034.878823:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.878830:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.878839:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a3403aabe00) 00010000:00010000:2.0:1763343034.878841:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343034.878844:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63ff lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.878850:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae63ff lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.878939:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae6414 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac918a expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.878954:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a3403aabe00) 00010000:00010000:2.0:1763343034.878956:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343034.878975:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae640d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac918a expref: 243 pid: 28422 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1763343034.878985:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1763343034.878994:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae6414 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac918a expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343034.879010:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340465c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010256000:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1763343034.879031:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a3403aabe00) 00010000:00010000:2.0:1763343034.879036:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343034.879039:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd000, rc 0) 00000100:00100000:0.0:1763343034.879277:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340465f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010255872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343034.879520:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343034.879532:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010256128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343034.880420:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343034.880487:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763343034.880498:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010256256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343034.880528:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343034.880674:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343034.880719:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010255872 00000100:00100000:3.0:1763343034.880728:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010255872 00000100:00100000:3.0:1763343034.880779:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010256256 00000100:00100000:3.0:1763343034.880781:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010256256 00000100:00100000:3.0:1763343034.880802:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010256000 00000100:00100000:3.0:1763343034.880805:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010256000 00000100:00100000:3.0:1763343034.880830:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6468 00000100:00100000:3.0:1763343034.880840:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3660:x1848998010255872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343034.880842:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6469 00000100:00100000:1.0:1763343034.880858:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3660:x1848998010256256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343034.881160:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6470 00000100:00100000:0.0:1763343034.881171:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010256000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343034.881563:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:55941:x1848997993523840:12345-192.168.204.21@tcp:101:bash.0 Request processed in 7599us (7841us total) trans 8589939885 rc 0/0 00000100:00100000:2.0:1763343034.881574:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9223 00000004:00080000:2.0:1763343034.882712:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c252300/2, rc 0, transno 17179871570 00000100:00100000:2.0:1763343034.882727:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010256256:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343034.883027:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340465f100/2, rc 0, transno 21474838868 00000100:00100000:2.0:1763343034.883033:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340465f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010255872:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763343034.883082:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340465c700/2, rc 0, transno 21474838869 00000100:00100000:2.0:1763343034.883087:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340465c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010256000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343034.883481:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3658:x1848998010256000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2307us (2800us total) trans 21474838869 rc 0/0 00000100:00100000:1.0:1763343034.883482:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3660:x1848998010256256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2621us (2946us total) trans 17179871570 rc 0/0 00000100:00100000:0.0:1763343034.883501:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6470 00000100:00100000:3.0:1763343034.883828:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3660:x1848998010255872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2986us (3409us total) trans 21474838868 rc 0/0 00000100:00100000:2.0:1763343034.884515:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343034.884658:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6469 00000100:00100000:1.0:1763343034.886702:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010256128 00000100:00100000:1.0:1763343034.886721:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010256128 00000100:00100000:1.0:1763343034.886841:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6471 00000100:00100000:1.0:1763343034.886855:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3657:x1848998010256128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343034.887195:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3657:x1848998010256128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 342us (3183us total) trans 17179871571 rc 0/0 00000100:00100000:1.0:1763343034.887203:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6471 00000004:00080000:2.0:1763343034.887732:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c251c00/2, rc 0, transno 17179871571 00000100:00100000:2.0:1763343034.887742:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010256128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343034.889389:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6468 00000100:00100000:0.0:1763343034.889722:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.889825:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.889888:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993524224 00000100:00100000:3.0:1763343034.889899:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993524224 00000100:00100000:3.0:1763343034.889964:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6472 00000100:00100000:3.0:1763343034.889974:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:55941:x1848997993524224:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343034.889998:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.890027:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6422 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9198 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343034.890057:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343034.890086:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.890089:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.890101:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6422 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9198 expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.890119:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6422 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9198 expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.890133:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93600, rc 0) 00000100:00100000:3.0:1763343034.890211:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:55941:x1848997993524224:12345-192.168.204.21@tcp:101:bash.0 Request processed in 238us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.890219:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6472 00000100:00100000:2.0:1763343034.890306:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993524096 00000100:00100000:2.0:1763343034.890312:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993524096 00000100:00100000:2.0:1763343034.890363:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9224 00000100:00100000:2.0:1763343034.890372:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56861:x1848997993524096:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343034.890383:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343034.890399:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae6429 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9191 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.890437:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae6430 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.890452:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae6430 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.890464:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae6430 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343034.890611:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae6429 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9191 expref: 244 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.891227:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd400/0x607405d401ae6430 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9191 expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.891237:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:2.0:1763343034.891241:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343034.891245:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd400, rc 0) 00000100:00100000:2.0:1763343034.891302:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56861:x1848997993524096:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 931us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343034.891311:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9224 00000100:00100000:0.0:1763343034.893923:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.894132:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.894257:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993524352 00000100:00100000:1.0:1763343034.894271:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993524352 00000100:00100000:1.0:1763343034.894343:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6473 00000100:00100000:1.0:1763343034.894355:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:55941:x1848997993524352:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343034.894378:0:27833:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.894405:0:27833:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae6437 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac919f expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343034.894434:0:27833:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343034.894460:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343034.894464:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343034.894475:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae6437 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac919f expref: 25 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.894492:0:27833:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae6437 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac919f expref: 25 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.894508:0:27833:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177600, rc 0) 00000100:00100000:1.0:1763343034.894586:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:55941:x1848997993524352:12345-192.168.204.21@tcp:101:bash.0 Request processed in 232us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343034.894593:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6473 00000100:00100000:2.0:1763343034.894713:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993524480 00000100:00100000:2.0:1763343034.894719:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993524480 00000100:00100000:2.0:1763343034.894768:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1583 00000100:00100000:2.0:1763343034.894776:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993524480:12345-192.168.204.21@tcp:4:lfs.0 00002000:00010000:2.0:1763343034.894814:0:28424:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343034.894821:0:28424:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dda00/0x607405d401ae643e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.894831:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.894832:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343034.894835:0:28424:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dda00/0x607405d401ae643e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.894848:0:28424:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34058dda00/0x607405d401ae643e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1763343034.900917:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838870 is committed 00000001:00080000:1.0:1763343034.900952:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838869 is committed 00000100:00100000:3.0:1763343034.901001:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00002000:00010000:2.0:1763343034.901448:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x29a:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:2.0:1763343034.901453:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x29a:0x0] updating lvb mtime from disk: 0 -> 1763343034 00002000:00010000:2.0:1763343034.901456:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x29a:0x0] updating lvb ctime from disk: 0 -> 1763343034 00002000:00010000:2.0:1763343034.901459:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x29a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343034.901474:0:28424:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dda00/0x607405d401ae643e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.901487:0:28424:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dda00/0x607405d401ae643e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.901496:0:28424:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a34058dda00/0x607405d401ae643e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.901503:0:28424:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dda00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343034.901508:0:28424:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34058dda00/0x607405d401ae643e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.901520:0:28424:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34058dda00/0x607405d401ae643e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.901546:0:28424:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a34058dda00/0x607405d401ae643e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343034.901553:0:28424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dda00/0x607405d401ae643e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343034.901596:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.901698:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2430:x1848997993524480:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 6920us (7563us total) trans 21474838870 rc 0/0 00000100:00100000:2.0:1763343034.901710:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1583 00000100:00100000:1.0:1763343034.901890:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993524608 00000100:00100000:1.0:1763343034.901902:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993524608 00002000:00010000:1.0:1763343034.901963:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/667 (0->18446744073709551615) 00002000:00100000:1.0:1763343034.901969:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340465c380 with x1848997993524608 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343034.902083:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340465c380. 00000100:00100000:1.0:1763343034.902110:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993524736 00000100:00100000:1.0:1763343034.902115:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993524736 00002000:00010000:1.0:1763343034.902131:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/669 (0->18446744073709551615) 00002000:00100000:1.0:1763343034.902134:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340465d180 with x1848997993524736 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343034.902141:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340465d180. 00000100:00100000:1.0:1763343034.902164:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1584 00000100:00100000:1.0:1763343034.902173:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2429:x1848997993524608:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:0.0:1763343034.902269:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1585 00000100:00100000:0.0:1763343034.902283:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2429:x1848997993524736:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:1.0:1763343034.902413:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x29b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343034.902417:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x29b:0x0] updating lvb mtime from disk: 0 -> 1763343034 00002000:00010000:1.0:1763343034.902420:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x29b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343034.902423:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x29b:0x0] updating lvb ctime from disk: 0 -> 1763343034 00002000:00010000:0.0:1763343034.902424:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x29d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343034.902427:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x29b:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763343034.902429:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x29d:0x0] updating lvb mtime from disk: 0 -> 1763343034 00002000:00010000:0.0:1763343034.902433:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x29d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.902436:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x29d:0x0] updating lvb ctime from disk: 0 -> 1763343034 00002000:00010000:0.0:1763343034.902439:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x29d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343034.902482:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993524608:12345-192.168.204.21@tcp:10:bash.0 Request processed in 308us (1487us total) trans 21474838871 rc 0/0 00000100:00100000:1.0:1763343034.902491:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1584 00002000:00010000:1.0:1763343034.902495:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/667 (0->18446744073709551615) 00002000:00100000:1.0:1763343034.902498:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340465c380 with x1848997993524608 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343034.902503:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340465c380. 00000100:00100000:0.0:1763343034.902577:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2429:x1848997993524736:12345-192.168.204.21@tcp:10:bash.0 Request processed in 298us (980us total) trans 17179871572 rc 0/0 00000100:00100000:0.0:1763343034.902584:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1585 00002000:00010000:0.0:1763343034.902587:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/669 (0->18446744073709551615) 00002000:00100000:0.0:1763343034.902590:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340465d180 with x1848997993524736 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343034.902595:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340465d180. 00000100:00100000:3.0:1763343034.906618:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.907389:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993524992 00000100:00100000:1.0:1763343034.907403:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993524992 00000100:00100000:1.0:1763343034.907478:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3135 00000100:00100000:1.0:1763343034.907491:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:55941:x1848997993524992:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343034.908194:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:55941:x1848997993524992:12345-192.168.204.21@tcp:35:bash.0 Request processed in 701us (1587us total) trans 8589939886 rc 0/0 00000100:00100000:0.0:1763343034.908205:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3135 00000100:00100000:3.0:1763343034.929124:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.930591:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.930880:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993525120 00000100:00100000:1.0:1763343034.930896:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993525120 00000100:00100000:1.0:1763343034.930981:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993525376 00000100:00100000:1.0:1763343034.930985:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993525376 00000100:00100000:1.0:1763343034.931260:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9225 00000100:00100000:1.0:1763343034.931273:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56864:x1848997993525120:12345-192.168.204.21@tcp:101:rm.0 00000100:00100000:0.0:1763343034.931320:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9226 00000100:00100000:0.0:1763343034.931333:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56861:x1848997993525376:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343034.931455:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343034.931492:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae6373 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d7:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9152 expref: 245 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.931516:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343034.931523:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343034.931611:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6445 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343034.931658:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6445 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343034.931669:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6445 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00010000:0.0:1763343034.931832:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002e614f29 reply state 0000000075ac32ca transno 8589939887 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6445 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343034.931847:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6445 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343034.931854:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343034.931856:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343034.931860:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343034.932023:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56861:x1848997993525376:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 691us (1434us total) trans 8589939887 rc 0/0 00000100:00100000:0.0:1763343034.932031:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9226 00010000:00010000:1.0:1763343034.932119:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343034.932143:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae644c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac91a6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.932219:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6453 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932356:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6453 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932366:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6453 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932384:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae645a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932392:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae645a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932399:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae645a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932502:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6461 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932512:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6461 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932519:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6461 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343034.932551:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1d9:0x0]: returning size 5 00000004:00200000:1.0:1763343034.932557:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343034.932575:0:6523:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6461 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932586:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6461 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932596:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6453 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932602:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6453 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932607:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6453 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932617:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6453 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932652:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.932657:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6453 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932665:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6453 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932675:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873b900) 00010000:00010000:1.0:1763343034.932678:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.932682:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6453 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932689:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6453 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932703:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae645a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932709:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae645a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932716:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae645a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932721:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.932724:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae645a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932730:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae645a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932741:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873b800) 00010000:00010000:1.0:1763343034.932744:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.932747:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae645a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932752:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae645a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.932782:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae644c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91a6 expref: 247 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.932798:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6461 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91a6 expref: 246 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.932806:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a3403aabe00) 00010000:00010000:1.0:1763343034.932808:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343034.932810:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:1.0:1763343034.932877:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56864:x1848997993525120:12345-192.168.204.21@tcp:101:rm.0 Request processed in 1606us (3765us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343034.932885:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9225 00000100:00100000:2.0:1763343034.938108:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343034.938169:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.938181:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993525760 00000100:00100000:1.0:1763343034.938199:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993525760 00000100:00100000:3.0:1763343034.938756:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993525504 00000100:00100000:3.0:1763343034.938761:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993525504 00000100:00100000:3.0:1763343034.939384:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6474 00000100:00100000:3.0:1763343034.939398:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:56861:x1848997993525504:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343034.939425:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.939455:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae6468 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac91ad expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343034.940142:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9227 00000100:00100000:1.0:1763343034.940162:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56864:x1848997993525760:12345-192.168.204.21@tcp:36:rm.0 00002000:00010000:3.0:1763343034.940336:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29a:0x0] initial LVB size: 4096, mtime: 0x691a7aba, atime: 0x0, ctime: 0x691a7aba, blocks: 0x8 00010000:00010000:3.0:1763343034.940371:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.940374:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.940384:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae6468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91ad expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.940404:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae6468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91ad expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.940419:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:3.0:1763343034.940501:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:56861:x1848997993525504:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1106us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.940508:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6474 00010000:00010000:1.0:1763343034.940729:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343034.940756:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae6414 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac918a expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.940786:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6461 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91a6 expref: 245 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.940800:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae63f8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1d9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac917c expref: 244 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343034.940811:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a3403aabe00) 00010000:00010000:1.0:1763343034.940821:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343034.940855:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae646f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.940866:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae646f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.940875:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae646f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.940886:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6476 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.940892:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6476 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.940897:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6476 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.942205:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae647d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.942224:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae647d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.942238:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae647d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:1.0:1763343034.942582:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1404, 64 off118808 00000004:00080000:1.0:1763343034.942593:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1228609971358ns, next at 1229609967587ns, rc = 0 00000040:00080000:1.0:1763343034.942653:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1405, 64 off118808 00000004:00080000:1.0:1763343034.942660:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228610038938ns, next at 1229610036645ns, rc = 0 00000040:00080000:1.0:1763343034.942674:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1406, 64 off118872 00000040:00080000:1.0:1763343034.942685:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1405, 64 off118872 00010000:00010000:1.0:1763343034.942758:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6484 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.942768:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6484 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.942776:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6484 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.942782:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6484 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.942788:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6484 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.942794:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6484 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.942816:0:6523:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343034.943243:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343034.943254:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6484 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.943262:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343034.943266:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6484 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.943274:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6484 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.943288:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a353873b400) 00010000:00010000:2.0:1763343034.943292:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343034.943297:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6484 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.943307:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6484 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343034.943324:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343034.943326:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343034.943328:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343034.945121:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae647d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945142:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae647d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945152:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae647d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945159:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.945165:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae647d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945173:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae647d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945193:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d9:0x0].0x0 (ffff9a353873b400) 00010000:00010000:1.0:1763343034.945197:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343034.945201:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae647d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945208:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae647d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945426:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae646f lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945435:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae646f lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945442:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae646f lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945449:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae646f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945456:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343034.945459:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae646f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945470:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae646f lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945479:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:1.0:1763343034.945482:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343034.945485:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae646f lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945491:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae646f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:1.0:1763343034.945505:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003eea4262 reply state 00000000886451a7 transno 8589939888 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6476 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945521:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6476 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.945529:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873bf00) 00010000:00010000:1.0:1763343034.945532:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343034.945536:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343034.946565:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56864:x1848997993525760:12345-192.168.204.21@tcp:36:rm.0 Request processed in 6401us (8465us total) trans 8589939888 rc 0/0 00000100:00100000:1.0:1763343034.946579:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9227 00000100:00100000:2.0:1763343034.961357:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.961450:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993525888 00000100:00100000:3.0:1763343034.961466:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993525888 00000100:00100000:3.0:1763343034.961535:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6475 00000100:00100000:3.0:1763343034.961549:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:56861:x1848997993525888:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343034.961579:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343034.961611:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae648b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac91b4 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343034.961830:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343034.961861:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.961864:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343034.963108:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae648b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91b4 expref: 27 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.963142:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae648b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91b4 expref: 27 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343034.963161:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343034.963265:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:56861:x1848997993525888:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1719us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343034.963276:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6475 00000100:00100000:3.0:1763343034.971514:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343034.971572:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.971608:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993526016 00000100:00100000:0.0:1763343034.971684:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993526016 00002000:00010000:0.0:1763343034.971744:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/666 (5->18446744073709551615) 00002000:00100000:0.0:1763343034.971750:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340465dc00 with x1848997993526016 ext(5->18446744073709551615) 00002000:00010000:0.0:1763343034.971766:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340465dc00. 00000100:00100000:0.0:1763343034.971793:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993526144 00000100:00100000:0.0:1763343034.971797:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993526144 00002000:00010000:0.0:1763343034.971815:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/668 (0->18446744073709551615) 00002000:00100000:0.0:1763343034.971818:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340465d880 with x1848997993526144 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343034.971826:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340465d880. 00000100:00100000:0.0:1763343034.971864:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1586 00000100:00100000:0.0:1763343034.971877:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993526016:12345-192.168.204.21@tcp:10:lfs.0 00000100:00100000:1.0:1763343034.972280:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1587 00000100:00100000:1.0:1763343034.972292:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2430:x1848997993526144:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:0.0:1763343034.972322:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x29a:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763343034.972327:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x29a:0x0] updating lvb mtime from disk: 1763343034 -> 1763343034 00002000:00010000:0.0:1763343034.972330:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x29a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343034.972332:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x29a:0x0] updating lvb ctime from disk: 1763343034 -> 1763343034 00002000:00010000:0.0:1763343034.972335:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x29a:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343034.972411:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993526016:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 534us (912us total) trans 21474838872 rc 0/0 00000100:00100000:0.0:1763343034.972421:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1586 00002000:00010000:0.0:1763343034.972426:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/666 (5->18446744073709551615) 00002000:00100000:0.0:1763343034.972430:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340465dc00 with x1848997993526016 ext(5->18446744073709551615) 00002000:00010000:0.0:1763343034.972435:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340465dc00. 00002000:00010000:1.0:1763343034.972441:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x29c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343034.972446:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x29c:0x0] updating lvb mtime from disk: 0 -> 1763343034 00002000:00010000:1.0:1763343034.972448:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x29c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343034.972451:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x29c:0x0] updating lvb ctime from disk: 0 -> 1763343034 00002000:00010000:1.0:1763343034.972455:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x29c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343034.972483:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2430:x1848997993526144:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 194us (911us total) trans 17179871573 rc 0/0 00000100:00100000:1.0:1763343034.972491:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1587 00002000:00010000:1.0:1763343034.972494:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/668 (0->18446744073709551615) 00002000:00100000:1.0:1763343034.972497:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340465d880 with x1848997993526144 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343034.972501:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340465d880. 00000100:00100000:2.0:1763343034.979518:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343034.981153:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993526400 00000100:00100000:1.0:1763343034.981172:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993526400 00000100:00100000:1.0:1763343034.981269:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9228 00000100:00100000:1.0:1763343034.981282:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56861:x1848997993526400:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:1.0:1763343034.981411:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6492 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.981434:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6492 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.981447:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6492 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00010000:1.0:1763343034.981604:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002ae65d10 reply state 00000000f282ec54 transno 8589939889 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6492 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.981664:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6492 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343034.981674:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:1.0:1763343034.981677:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343034.981683:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343034.981878:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56861:x1848997993526400:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 595us (2372us total) trans 8589939889 rc 0/0 00000100:00100000:0.0:1763343034.981887:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9228 00000100:00100000:2.0:1763343034.987119:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.987242:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993526528 00000100:00100000:0.0:1763343034.987258:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993526528 00000100:00100000:0.0:1763343034.987335:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6476 00000100:00100000:0.0:1763343034.987348:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2432:x1848997993526528:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:0.0:1763343034.987549:0:27833:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343034.987554:0:27833:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb mtime from disk: 1763343034 -> 1763343034 00002000:00010000:0.0:1763343034.987558:0:27833:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb atime from disk: 0 -> 1763343034 00002000:00010000:0.0:1763343034.987561:0:27833:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb ctime from disk: 1763343034 -> 1763343034 00002000:00010000:0.0:1763343034.987576:0:27833:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343034.987699:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2432:x1848997993526528:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 352us (594us total) trans 17179871574 rc 0/0 00000100:00100000:0.0:1763343034.987707:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6476 00000100:00100000:3.0:1763343034.993941:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.995374:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993526912 00000100:00100000:0.0:1763343034.995391:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993526912 00000100:00100000:0.0:1763343034.995490:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3136 00000100:00100000:0.0:1763343034.995501:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56861:x1848997993526912:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:0.0:1763343034.995586:0:6526:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1d7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62f5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9128 expref: 247 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.995692:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343034.995707:0:6526:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6365 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac914b expref: 247 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.995717:0:6526:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343034.995759:0:6526:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6365 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac914b expref: 247 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.995773:0:6526:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6365 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac914b expref: 247 pid: 28422 timeout: 1328 lvb_type: 0 00000100:00100000:0.0:1763343034.995790:0:6526:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1848998010256384:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343034.995905:0:6526:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a353c6e8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1763343034.998777:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343034.998890:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993526656 00000100:00100000:0.0:1763343034.998902:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993526656 00000100:00100000:0.0:1763343034.998983:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9229 00000100:00100000:0.0:1763343034.998992:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56865:x1848997993526656:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343034.999017:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343034.999046:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae64a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac91bb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.999126:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae64a7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999143:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae64a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999155:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae64a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999164:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae64ae lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999171:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae64ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999176:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae64ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999229:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae64a7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999235:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae64a7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999246:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae64a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999253:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae64a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999260:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343034.999265:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae64a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999273:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae64a7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999287:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2c00) 00010000:00010000:0.0:1763343034.999290:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343034.999295:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae64a7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999301:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665ce00/0x607405d401ae64a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999316:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae64ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999322:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae64ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999327:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae64ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999332:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343034.999335:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae64ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999343:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae64ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999349:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873bf00) 00010000:00010000:0.0:1763343034.999351:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343034.999354:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae64ae lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999358:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c200/0x607405d401ae64ae lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343034.999384:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae64a0 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91bb expref: 249 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.999394:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2c00) 00010000:00010000:0.0:1763343034.999397:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343034.999400:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae64a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91bb expref: 249 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343034.999413:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c400, rc 0) 00000100:00100000:0.0:1763343034.999488:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56865:x1848997993526656:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 497us (726us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343034.999497:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9229 00000100:00100000:3.0:1763343035.010556:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.010703:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.010882:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993527168 00000100:00100000:1.0:1763343035.010895:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993527168 00010000:00010000:1.0:1763343035.010980:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6365 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac914b expref: 248 pid: 28422 timeout: 1328 lvb_type: 0 00000100:00100000:1.0:1763343035.011032:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3039 00000100:00100000:1.0:1763343035.011044:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:2429:x1848997993527168:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343035.011064:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343035.011071:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6365 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac914b expref: 248 pid: 28422 timeout: 1328 lvb_type: 0 00010000:00010000:1.0:1763343035.011086:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6365 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac914b expref: 248 pid: 28422 timeout: 1328 lvb_type: 0 00010000:00010000:1.0:1763343035.011117:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:1.0:1763343035.011126:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343035.011139:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343035.011147:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343035.011170:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343035.011235:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:2429:x1848997993527168:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 193us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.011244:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3039 00010000:00010000:0.0:1763343035.011400:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6365 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac914b expref: 247 pid: 28422 timeout: 1328 lvb_type: 0 00000100:00100000:0.0:1763343035.011422:0:6526:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1848998010256384:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343035.011452:0:6526:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.011462:0:6526:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.011469:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00000040:00080000:0.0:1763343035.011810:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1407, 88 off118960 00000004:00080000:0.0:1763343035.011822:0:6526:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228679200773ns, next at 1229610036645ns, rc = 0 00000040:00080000:0.0:1763343035.011851:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1406, 88 off118960 00000004:00080000:0.0:1763343035.011858:0:6526:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1228679236844ns, next at 1229609967587ns, rc = 0 00000040:00080000:0.0:1763343035.011873:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1407, 88 off119048 00000004:00080000:0.0:1763343035.011877:0:6526:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1228679255813ns, next at 1229609967587ns, rc = 0 00000040:00080000:0.0:1763343035.011886:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1408, 88 off119048 00000004:00080000:0.0:1763343035.011890:0:6526:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228679269166ns, next at 1229610036645ns, rc = 0 00000100:00100000:2.0:1763343035.012568:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993527040 00000100:00100000:2.0:1763343035.012579:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993527040 00000100:00100000:2.0:1763343035.012673:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9230 00000100:00100000:2.0:1763343035.012684:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56865:x1848997993527040:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.012709:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.012741:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae64b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac91c2 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.012819:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae64bc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012831:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae64bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012842:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae64bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012852:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae64c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012859:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae64c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012865:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae64c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012900:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae64bc lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012906:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae64bc lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012912:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae64bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012918:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae64bc lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012932:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.012936:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae64bc lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012943:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae64bc lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012954:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7e00) 00010000:00010000:2.0:1763343035.012957:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.012960:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae64bc lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012966:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae64bc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012981:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae64c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012986:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae64c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012993:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae64c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.012997:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.013000:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae64c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.013004:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae64c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.013009:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873bf00) 00010000:00010000:2.0:1763343035.013011:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.013013:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae64c3 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.013018:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae64c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.013039:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae64b5 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91c2 expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.013047:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7e00) 00010000:00010000:2.0:1763343035.013048:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.013051:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae64b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91c2 expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.013062:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc000, rc 0) 00000100:00100000:2.0:1763343035.013119:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56865:x1848997993527040:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 437us (2579us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343035.013125:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9230 00000100:00080000:3.0:1763343035.013369:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1763343035.021746:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939890 is committed 00000004:00080000:1.0:1763343035.021767:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 928 committed 00010000:00010000:3.0:1763343035.022485:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6445 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.022500:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6445 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.022508:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6445 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.022514:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.022519:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6445 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.022531:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6445 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.022551:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:3.0:1763343035.022554:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.022561:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6445 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.022567:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6445 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.022593:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6476 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.022600:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6476 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.022605:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6476 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.022610:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.022613:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6476 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.022648:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6476 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.022657:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873bf00) 00010000:00010000:3.0:1763343035.022659:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.022662:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6476 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.022668:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6476 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.022691:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6492 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.022697:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6492 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.022702:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6492 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.022707:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.022711:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6492 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.022716:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6492 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.022723:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:3.0:1763343035.022725:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.022728:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6492 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.022734:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6492 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343035.022955:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000004:00080000:1.0:1763343035.023053:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 929 committed 00000004:00080000:1.0:1763343035.023066:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 928 committed 00000004:00080000:1.0:1763343035.023069:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 927 committed 00000100:00100000:3.0:1763343035.023116:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993527296 00000100:00100000:3.0:1763343035.023131:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993527296 00000100:00100000:3.0:1763343035.023197:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9231 00000100:00100000:3.0:1763343035.023207:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56865:x1848997993527296:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.023234:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.023260:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae64ca lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac91c9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.023342:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae64d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.023358:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae64d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.023369:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae64d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:3.0:1763343035.023433:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343035.023440:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343035.023485:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae64ca lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91c9 expref: 246 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.023501:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae64d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91c9 expref: 245 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.023509:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8100) 00010000:00010000:3.0:1763343035.023511:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343035.023514:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92a00, rc 0) 00000100:00100000:3.0:1763343035.023587:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56865:x1848997993527296:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 381us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.023595:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9231 00000100:00100000:2.0:1763343035.023995:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010256896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343035.024058:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.024095:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343035.024101:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010256512:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343035.024124:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.024154:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010256640:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343035.024177:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.024198:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343035.024203:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010256768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343035.024222:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.024252:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010256896 00000100:00100000:2.0:1763343035.024258:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010256896 00000100:00100000:2.0:1763343035.024299:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010256512 00000100:00100000:2.0:1763343035.024303:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010256512 00000100:00100000:2.0:1763343035.024321:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010256640 00000100:00100000:2.0:1763343035.024323:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010256640 00000100:00100000:2.0:1763343035.024339:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010256768 00000100:00100000:2.0:1763343035.024341:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010256768 00000100:00100000:2.0:1763343035.024360:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6477 00000100:00100000:2.0:1763343035.024366:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3659:x1848998010256896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763343035.024555:0:27833:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x29c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343035.024559:0:27833:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x29c:0x0] updating lvb mtime from disk: 1763343034 -> 1763343034 00002000:00010000:2.0:1763343035.024562:0:27833:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x29c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343035.024564:0:27833:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x29c:0x0] updating lvb ctime from disk: 1763343034 -> 1763343034 00002000:00010000:2.0:1763343035.024567:0:27833:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x29c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343035.024601:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3659:x1848998010256896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 235us (543us total) trans 17179871575 rc 0/0 00000100:00100000:2.0:1763343035.024609:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6477 00000100:00100000:2.0:1763343035.024654:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6478 00000100:00100000:2.0:1763343035.024661:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3659:x1848998010256512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343035.024676:0:27833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:669 count 1 00010000:00010000:2.0:1763343035.024694:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae64d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.024716:0:27833:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae6437 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac919f expref: 28 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.024724:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343035.024727:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343035.024731:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae64d8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.024762:0:27833:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae6437 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac919f expref: 28 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.024778:0:27833:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae6437 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac919f expref: 28 pid: 27833 timeout: 1328 lvb_type: 0 00000100:00100000:2.0:1763343035.024790:0:27833:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27833:1848998010257024:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343035.024850:0:27833:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35012edf00 going to sleep for 11 seconds 00000100:00100000:2.0:1763343035.024871:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6479 00000100:00100000:2.0:1763343035.024879:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3657:x1848998010256640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343035.024890:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:670 count 1 00002000:00010000:2.0:1763343035.024913:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343035.024919:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae64df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.024940:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.024942:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.024947:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae64df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.024959:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae64df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.024969:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae64df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.024977:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae64df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.024998:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343035.025202:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3657:x1848998010256640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 323us (1023us total) trans 17179871576 rc 0/0 00000100:00100000:2.0:1763343035.025210:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6479 00000100:00100000:2.0:1763343035.025223:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6480 00000100:00100000:2.0:1763343035.025229:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3657:x1848998010256768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763343035.025283:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343035.025286:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb mtime from disk: 1763343034 -> 1763343034 00002000:00010000:2.0:1763343035.025288:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb atime from disk: 1763343034 -> 1763343034 00002000:00010000:2.0:1763343035.025290:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb ctime from disk: 1763343034 -> 1763343034 00002000:00010000:2.0:1763343035.025292:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x29b:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343035.025318:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3657:x1848998010256768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (1094us total) trans 17179871577 rc 0/0 00000100:00100000:2.0:1763343035.025325:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6480 00000100:00080000:2.0:1763343035.025344:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1763343035.025397:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a6a00/2, rc 0, transno 17179871575 00000100:00100000:2.0:1763343035.025403:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010256896:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343035.025423:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a7b80/2, rc 0, transno 17179871577 00000100:00100000:2.0:1763343035.025427:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010256768:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343035.025435:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a5f80/2, rc 0, transno 17179871576 00000100:00100000:2.0:1763343035.025439:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010256640:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343035.025597:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010257536:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343035.025657:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.025679:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343035.025685:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010257152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343035.025704:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.025723:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010257280:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343035.025743:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.025757:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343035.025761:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010257408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343035.025778:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.025801:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010257536 00000100:00100000:2.0:1763343035.025807:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010257536 00000100:00100000:2.0:1763343035.025844:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010257152 00000100:00100000:2.0:1763343035.025847:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010257152 00000100:00100000:2.0:1763343035.025859:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010257280 00000100:00100000:2.0:1763343035.025861:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010257280 00000100:00100000:2.0:1763343035.025874:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010257408 00000100:00100000:2.0:1763343035.025876:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010257408 00000100:00100000:2.0:1763343035.025890:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6481 00000100:00100000:2.0:1763343035.025895:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3659:x1848998010257536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763343035.026001:0:28995:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x29a:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343035.026005:0:28995:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x29a:0x0] updating lvb mtime from disk: 1763343034 -> 1763343034 00002000:00010000:2.0:1763343035.026007:0:28995:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x29a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343035.026009:0:28995:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x29a:0x0] updating lvb ctime from disk: 1763343034 -> 1763343034 00002000:00010000:2.0:1763343035.026011:0:28995:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x29a:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343035.026043:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3659:x1848998010257536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 147us (385us total) trans 21474838873 rc 0/0 00000100:00100000:2.0:1763343035.026050:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6481 00000100:00100000:2.0:1763343035.026063:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6482 00000100:00100000:2.0:1763343035.026068:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3659:x1848998010257152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343035.026080:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:667 count 1 00010000:00010000:2.0:1763343035.026096:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae64e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.026113:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6422 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9198 expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.026120:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343035.026122:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343035.026125:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae64e6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.026150:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6422 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9198 expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.026161:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6422 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9198 expref: 13 pid: 8407 timeout: 1328 lvb_type: 0 00000100:00100000:2.0:1763343035.026173:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010257664:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343035.026220:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726900 going to sleep for 11 seconds 00000100:00100000:2.0:1763343035.026239:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6483 00000100:00100000:2.0:1763343035.026247:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3657:x1848998010257280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343035.026262:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:668 count 1 00002000:00010000:2.0:1763343035.026285:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343035.026290:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340683c200/0x607405d401ae64ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.026298:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.026300:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.026304:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340683c200/0x607405d401ae64ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.026315:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340683c200/0x607405d401ae64ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.026323:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340683c200/0x607405d401ae64ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.026331:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340683c200/0x607405d401ae64ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.026359:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763343035.026522:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010257280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 274us (776us total) trans 21474838874 rc 0/0 00000100:00100000:2.0:1763343035.026532:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6483 00000100:00100000:2.0:1763343035.026547:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6484 00000100:00100000:2.0:1763343035.026552:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3657:x1848998010257408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763343035.026605:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x299:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343035.026608:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x299:0x0] updating lvb mtime from disk: 1763343034 -> 1763343034 00002000:00010000:2.0:1763343035.026611:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x299:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343035.026613:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x299:0x0] updating lvb ctime from disk: 1763343034 -> 1763343034 00002000:00010000:2.0:1763343035.026615:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x299:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343035.026663:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010257408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (884us total) trans 21474838875 rc 0/0 00000100:00100000:2.0:1763343035.026670:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6484 00000100:00080000:2.0:1763343035.026690:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1763343035.026722:0:3659:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838869 gen 2 00000004:00080000:2.0:1763343035.026728:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d10d180, transno 21474838857 00000004:00080000:2.0:1763343035.026737:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b90700, transno 21474838858 00000004:00080000:2.0:1763343035.026740:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b91c00, transno 21474838859 00000004:00080000:2.0:1763343035.026742:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d10c700, transno 21474838860 00000004:00080000:2.0:1763343035.026746:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035eaa00, transno 21474838861 00000004:00080000:2.0:1763343035.026748:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035e9c00, transno 21474838862 00000004:00080000:2.0:1763343035.026752:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035e9180, transno 21474838863 00000004:00080000:2.0:1763343035.026754:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035ea300, transno 21474838864 00000004:00080000:2.0:1763343035.026757:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c251880, transno 21474838866 00000004:00080000:2.0:1763343035.026760:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c253800, transno 21474838867 00000004:00080000:2.0:1763343035.026763:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340465f100, transno 21474838868 00000004:00080000:2.0:1763343035.026765:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340465c700, transno 21474838869 00000100:00100000:2.0:1763343035.026772:0:3659:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a340c2c6300 x1848998010257536/t21474838873(21474838873) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343051 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763343035.026789:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c2c6300/2, rc 0, transno 21474838873 00000100:00100000:2.0:1763343035.026794:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010257536:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763343035.026815:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c2c5c00/2, rc 0, transno 21474838875 00000100:00100000:2.0:1763343035.026819:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010257408:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763343035.026827:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c2c5f80/2, rc 0, transno 21474838874 00000100:00100000:2.0:1763343035.026831:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010257280:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763343035.026989:0:32355:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 4 in progress, 1 in flight, 12 done 00010000:00010000:2.0:1763343035.027136:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343035.027145:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae64df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.027155:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058ddc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343035.027159:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae64df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.027170:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae64df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.027192:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae64df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.027200:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae64df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.027223:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343035.027227:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340683c200/0x607405d401ae64ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.027234:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340683c200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343035.027237:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340683c200/0x607405d401ae64ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.027244:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340683c200/0x607405d401ae64ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.027254:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340683c200/0x607405d401ae64ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.027261:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340683c200/0x607405d401ae64ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.027274:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343035.027276:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343035.027278:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343035.027301:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343035.028964:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 926 committed 00000004:00080000:1.0:1763343035.028976:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 927 committed 00000004:00010000:0.0:1763343035.029123:0:6526:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000155e065 reply state 00000000df2faf3a transno 8589939890 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.029151:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.029162:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343035.029166:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343035.029170:0:6526:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343035.029180:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343035.029182:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343035.029192:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae62f5 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9128 expref: 240 pid: 10041 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1763343035.029360:0:6526:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343035.029381:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56861:x1848997993526912:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 33880us (35466us total) trans 8589939890 rc 0/0 00000100:00100000:0.0:1763343035.029393:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3136 00010000:00010000:0.0:1763343035.029475:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.029484:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.029491:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.029497:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343035.029503:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.029510:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.029520:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:0.0:1763343035.029523:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343035.029526:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.029533:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6499 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 00000100:00100000:0.0:1763343035.033047:0:27833:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27833:1848998010257024:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343035.033090:0:27833:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae64d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343035.035957:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.036080:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010257664:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343035.036117:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae64e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343035.037449:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.037472:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993527424 00000100:00100000:1.0:1763343035.037483:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993527424 00010000:00010000:1.0:1763343035.037553:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae6437 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac919f expref: 29 pid: 27833 timeout: 1328 lvb_type: 0 00000100:00100000:1.0:1763343035.037608:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3040 00000100:00100000:1.0:1763343035.037643:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2430:x1848997993527424:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343035.037664:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343035.037670:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae6437 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac919f expref: 29 pid: 27833 timeout: 1328 lvb_type: 0 00010000:00010000:1.0:1763343035.037683:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae6437 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac919f expref: 29 pid: 27833 timeout: 1328 lvb_type: 0 00010000:00010000:1.0:1763343035.037714:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177600/0x607405d401ae6437 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac919f expref: 29 pid: 27833 timeout: 1328 lvb_type: 0 00010000:00010000:1.0:1763343035.037736:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343035.037739:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343035.037745:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae64d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.037757:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae64d8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.037789:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343035.037853:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2430:x1848997993527424:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 234us (1910us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.037862:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3040 00010000:00010000:1.0:1763343035.037920:0:27833:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae64d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.037942:0:27833:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae64d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.037954:0:27833:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae64d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.037963:0:27833:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae64d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.037983:0:27833:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343035.038296:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3659:x1848998010256512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13634us (14170us total) trans 17179871578 rc 0/0 00000100:00100000:1.0:1763343035.038305:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6478 00010000:00010000:1.0:1763343035.038331:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343035.038337:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae64d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.038345:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dda00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343035.038349:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae64d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.038359:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae64d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.038373:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae64d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.038380:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae64d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.038399:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343035.038401:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343035.038403:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343035.038448:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a6d80/2, rc 0, transno 17179871578 00000100:00100000:1.0:1763343035.038455:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010256512:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1763343035.038716:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1763343035.039074:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.039141:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993527552 00000100:00100000:0.0:1763343035.039150:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993527552 00010000:00010000:0.0:1763343035.039199:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6422 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9198 expref: 14 pid: 8407 timeout: 1328 lvb_type: 0 00000100:00100000:0.0:1763343035.039234:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3041 00000100:00100000:0.0:1763343035.039244:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993527552:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343035.039258:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343035.039263:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6422 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9198 expref: 14 pid: 8407 timeout: 1328 lvb_type: 0 00010000:00010000:0.0:1763343035.039276:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6422 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9198 expref: 14 pid: 8407 timeout: 1328 lvb_type: 0 00010000:00010000:0.0:1763343035.039295:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6422 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9198 expref: 14 pid: 8407 timeout: 1328 lvb_type: 0 00010000:00010000:0.0:1763343035.039308:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.039310:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.039314:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae64e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.039323:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae64e6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.039354:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343035.039396:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993527552:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 154us (1955us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.039403:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3041 00010000:00010000:0.0:1763343035.039427:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae64e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.039435:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae64e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.039444:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae64e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.039452:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae64e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.039467:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343035.039727:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3659:x1848998010257152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13657us (14019us total) trans 21474838876 rc 0/0 00000100:00100000:0.0:1763343035.039734:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6482 00000100:00100000:3.0:1763343035.040036:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993527680 00000100:00100000:3.0:1763343035.040043:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993527680 00000100:00100000:3.0:1763343035.040093:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9232 00000100:00100000:3.0:1763343035.040102:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+239:56861:x1848997993527680:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.040126:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.040149:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae64f4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac91d0 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.040211:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae64f4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91d0 expref: 240 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.040227:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93a00/0x607405d401ae64f4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91d0 expref: 240 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.040249:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:3.0:1763343035.040253:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343035.040257:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93a00, rc 0) 00000100:00100000:3.0:1763343035.040302:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56861:x1848997993527680:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 201us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.040309:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9232 00010000:00010000:2.0:1763343035.040399:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343035.040408:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae64e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.040416:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343035.040421:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae64e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.040431:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae64e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.040445:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae64e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.040453:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae64e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.040471:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343035.040473:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343035.040475:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1763343035.040485:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763343035.041812:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.042033:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993527808 00000100:00100000:2.0:1763343035.042045:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993527808 00000100:00100000:2.0:1763343035.042107:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9233 00000100:00100000:2.0:1763343035.042116:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56865:x1848997993527808:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.042140:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.042163:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae64fb lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac91d7 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.042253:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae6502 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.043766:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae6502 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.043803:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae6502 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.043838:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae6509 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.043846:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae6509 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.043852:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae6509 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.043916:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae6502 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.043933:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae6502 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.043940:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae6502 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.043946:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae6502 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.043952:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340683d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.043956:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae6502 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.043964:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae6502 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.043979:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8100) 00010000:00010000:2.0:1763343035.043982:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.043988:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae6502 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.043994:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae6502 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.044016:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae6509 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.044022:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae6509 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.044027:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae6509 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.044032:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340683d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.044035:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae6509 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.044040:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae6509 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.044047:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3538bf7000) 00010000:00010000:2.0:1763343035.044049:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.044052:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae6509 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.044057:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae6509 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.044108:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae64fb lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91d7 expref: 241 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.044119:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8100) 00010000:00010000:2.0:1763343035.044122:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.044125:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae64fb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91d7 expref: 241 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.044140:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340683ce00, rc 0) 00000100:00100000:2.0:1763343035.044237:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56865:x1848997993527808:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2120us (2436us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343035.044247:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9233 00000004:00080000:1.0:1763343035.045743:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c2c4700/2, rc 0, transno 21474838876 00000100:00100000:1.0:1763343035.045761:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010257152:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343035.046239:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.046504:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993528064 00000100:00100000:0.0:1763343035.046514:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993528064 00000100:00100000:0.0:1763343035.046577:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3137 00000100:00100000:0.0:1763343035.046588:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+240:56861:x1848997993528064:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:0.0:1763343035.046944:0:6526:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1d7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343035.047021:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1409, 64 off119112 00000040:00080000:0.0:1763343035.047045:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1408, 64 off119112 00000040:00080000:0.0:1763343035.047053:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1409, 64 off119176 00000040:00080000:0.0:1763343035.047060:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1410, 64 off119176 00010000:00010000:0.0:1763343035.047133:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6510 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.047156:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6510 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.047171:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6510 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.047179:0:6526:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6510 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.047185:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6510 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.047192:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6510 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343035.047220:0:6526:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343035.047463:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56861:x1848997993528064:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 874us (1223us total) trans 8589939891 rc 0/0 00000100:00100000:0.0:1763343035.047473:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3137 00010000:00010000:1.0:1763343035.047846:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343035.047855:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6510 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343035.047863:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343035.047867:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6510 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343035.047875:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6510 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343035.047891:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1d7:0x0].0x0 (ffff9a3403aab800) 00010000:00010000:1.0:1763343035.047894:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343035.047900:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6510 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343035.047910:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae6510 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1d7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343035.047922:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343035.047934:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343035.047936:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343035.051079:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.051172:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993528320 00000100:00100000:3.0:1763343035.051187:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993528320 00000100:00100000:3.0:1763343035.051260:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9234 00000100:00100000:3.0:1763343035.051272:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+241:56865:x1848997993528320:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.051300:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.051304:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343035.051338:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae64d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91c9 expref: 241 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.051361:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8100) 00010000:00010000:3.0:1763343035.051374:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343035.051394:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6517 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac91de expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.051525:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae651e lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.051541:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae651e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.051552:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae651e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.051567:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6525 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.051575:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6525 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.051582:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6525 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.056889:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae652c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.056920:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae652c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.056945:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae652c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343035.056961:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1db:0x0]: returning size 0 00010000:00010000:2.0:1763343035.056997:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae651e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.057005:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae651e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.057011:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae651e lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.057019:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae651e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.057025:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.057030:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae651e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.057038:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae651e lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.057055:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:2.0:1763343035.057059:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.057066:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae651e lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.057073:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae651e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:2.0:1763343035.057089:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fc2fbd6d reply state 00000000ca047c80 transno 8589939892 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6525 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.057102:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6525 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.057108:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8200) 00010000:00010000:2.0:1763343035.057111:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343035.057115:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343035.057163:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6517 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91de expref: 243 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.057190:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae652c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91de expref: 242 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.057198:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:2.0:1763343035.057200:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343035.057203:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403529e00, rc 0) 00000100:00100000:2.0:1763343035.057302:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56865:x1848997993528320:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6032us (6238us total) trans 8589939892 rc 0/0 00000100:00100000:2.0:1763343035.057312:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9234 00000100:00100000:3.0:1763343035.061802:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.062173:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.062892:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993528576 00000100:00100000:0.0:1763343035.062907:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993528576 00000100:00100000:0.0:1763343035.063005:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993528832 00000100:00100000:0.0:1763343035.063009:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993528832 00000100:00100000:0.0:1763343035.063036:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9235 00000100:00100000:0.0:1763343035.063047:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56865:x1848997993528576:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:1.0:1763343035.063178:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9236 00000100:00100000:1.0:1763343035.063189:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56861:x1848997993528832:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.063668:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.063699:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae653a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac91e5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.063850:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6541 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.063868:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae652c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91de expref: 245 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.063878:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6541 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.063934:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae652c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91de expref: 245 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.063952:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae652c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91de expref: 245 pid: 10042 timeout: 1328 lvb_type: 0 00000100:00100000:0.0:1763343035.063967:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010257792:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343035.064073:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34039e33c0 going to sleep for 11 seconds 00010000:00010000:1.0:1763343035.064242:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.064254:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6548 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac91ec expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.064612:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae654f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.064654:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae654f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.064668:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae654f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343035.064684:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1db:0x0]: returning size 0 00010000:00010000:1.0:1763343035.064793:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae654f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.064801:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae654f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.064808:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae654f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.064814:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.064820:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae654f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.064828:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae654f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.064842:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:1.0:1763343035.064846:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763343035.064852:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae654f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.064857:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae654f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.064913:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6548 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91ec expref: 247 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.064936:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:1.0:1763343035.064939:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343035.064943:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6548 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91ec expref: 247 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.064955:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343035.065026:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56861:x1848997993528832:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1839us (2853us total) trans 8589939893 rc 301/301 00000100:00100000:1.0:1763343035.065036:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9236 00000100:00100000:0.0:1763343035.071242:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010257792:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343035.071488:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6541 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343035.072427:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.072720:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993529088 00000100:00100000:3.0:1763343035.072733:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993529088 00000100:00100000:3.0:1763343035.072801:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3138 00000100:00100000:3.0:1763343035.072813:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56861:x1848997993529088:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343035.073152:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56861:x1848997993529088:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 341us (733us total) trans 8589939894 rc 0/0 00000100:00100000:3.0:1763343035.073161:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3138 00000100:00100000:2.0:1763343035.073884:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.074430:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993529216 00000100:00100000:3.0:1763343035.074443:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993529216 00010000:00010000:3.0:1763343035.074481:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae652c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91de expref: 247 pid: 10042 timeout: 1328 lvb_type: 0 00000100:00100000:3.0:1763343035.075205:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3042 00000100:00100000:3.0:1763343035.075219:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:2429:x1848997993529216:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343035.075239:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343035.075248:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae652c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91de expref: 247 pid: 10042 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343035.076701:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae652c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91de expref: 247 pid: 10042 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343035.076742:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae652c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91de expref: 247 pid: 10042 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343035.076766:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:3.0:1763343035.076773:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6541 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.076785:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6541 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.076793:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6541 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.077230:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343035.077346:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:2429:x1848997993529216:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 2128us (3462us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.077359:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3042 00010000:00010000:0.0:1763343035.083835:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6541 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.083860:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6541 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343035.083898:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1db:0x0]: returning size 0 00000004:00080000:1.0:1763343035.084291:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x29f:0x0], index 1: 0 00000004:00080000:1.0:1763343035.084301:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x29d:0x0], index 0: 0 00000004:00080000:1.0:1763343035.084306:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x29e:0x0], index 0: 0 00000004:00080000:1.0:1763343035.084310:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2a0:0x0], index 1: 0 00010000:00010000:1.0:1763343035.084452:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6541 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.084462:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6541 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.084470:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6541 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.084477:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.084482:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6541 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.084492:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6541 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.084512:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:1.0:1763343035.084516:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343035.084521:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6541 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.084528:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae6541 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.084600:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae653a lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91e5 expref: 246 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.084614:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a3538bf7300) 00010000:00010000:1.0:1763343035.084617:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343035.084660:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae653a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91e5 expref: 246 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.084678:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665dc00, rc 0) 00000100:00100000:1.0:1763343035.084774:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56865:x1848997993528576:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 21728us (22987us total) trans 8589939895 rc 301/301 00000100:00100000:1.0:1763343035.084786:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9235 00000100:00100000:1.0:1763343035.087522:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.088998:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993529472 00000100:00100000:0.0:1763343035.089019:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993529472 00000100:00100000:2.0:1763343035.089200:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3139 00000100:00100000:2.0:1763343035.089213:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56865:x1848997993529472:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343035.091588:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56865:x1848997993529472:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 2359us (4063us total) trans 8589939896 rc 0/0 00000100:00100000:2.0:1763343035.091607:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3139 00000100:00100000:2.0:1763343035.101707:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.101809:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993529728 00000100:00100000:1.0:1763343035.101824:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993529728 00000100:00100000:1.0:1763343035.101897:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9237 00000100:00100000:1.0:1763343035.101907:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56866:x1848997993529728:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.101942:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.101972:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6564 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac91f3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.102069:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae656b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102086:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae656b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102098:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae656b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102108:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6572 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102116:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102127:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102274:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6579 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102282:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6579 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102290:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6579 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343035.102303:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1db:0x0]: returning size 0 00010000:00010000:1.0:1763343035.102411:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae656b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102419:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae656b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102425:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae656b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102432:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae656b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102438:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.102443:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae656b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102451:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae656b lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102465:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:1.0:1763343035.102469:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.102476:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae656b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102482:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae656b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102500:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102506:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6572 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102512:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6572 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102516:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.102519:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6572 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102525:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6572 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102532:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8200) 00010000:00010000:1.0:1763343035.102535:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.102538:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6572 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102544:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6572 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.102590:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6564 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91f3 expref: 249 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.102611:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6579 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91f3 expref: 248 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.102657:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a353873b400) 00010000:00010000:1.0:1763343035.102661:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343035.102663:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:1.0:1763343035.102742:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56866:x1848997993529728:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 836us (1049us total) trans 8589939897 rc 0/0 00000100:00100000:1.0:1763343035.102751:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9237 00000100:00100000:2.0:1763343035.107568:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.107614:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.107734:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.107822:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993530112 00000100:00100000:0.0:1763343035.107836:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993530112 00000100:00100000:0.0:1763343035.107900:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993530240 00000100:00100000:0.0:1763343035.107903:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993530240 00000100:00100000:0.0:1763343035.107935:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6485 00000100:00100000:0.0:1763343035.107945:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993530112:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.107973:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.108006:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae6587 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac91fa expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343035.108039:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343035.108066:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.108068:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.108079:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae6587 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91fa expref: 14 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343035.108098:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae6587 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91fa expref: 14 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343035.108113:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c200, rc 0) 00000100:00100000:0.0:1763343035.108174:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993530112:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 231us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.108182:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6485 00000100:00100000:0.0:1763343035.108201:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6486 00000100:00100000:0.0:1763343035.108207:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2430:x1848997993530240:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.108215:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.108227:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae658e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9201 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343035.108242:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343035.108254:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.108255:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.108259:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae658e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9201 expref: 29 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343035.108287:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae658e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9201 expref: 29 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343035.108295:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665ce00, rc 0) 00000100:00100000:0.0:1763343035.108312:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2430:x1848997993530240:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 105us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.108318:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6486 00000100:00100000:3.0:1763343035.108658:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993529984 00000100:00100000:3.0:1763343035.108665:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993529984 00000100:00100000:3.0:1763343035.108695:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3140 00000100:00100000:3.0:1763343035.108701:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56865:x1848997993529984:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343035.108917:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56865:x1848997993529984:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 215us (1364us total) trans 8589939898 rc 0/0 00000100:00100000:3.0:1763343035.108935:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3140 00000100:00100000:3.0:1763343035.115739:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.115783:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.116020:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993530496 00000100:00100000:0.0:1763343035.116034:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993530496 00000100:00100000:0.0:1763343035.116104:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993530624 00000100:00100000:0.0:1763343035.116108:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993530624 00000100:00100000:0.0:1763343035.116135:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9238 00000100:00100000:0.0:1763343035.116146:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:55941:x1848997993530496:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343035.116181:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.116185:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343035.116225:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6579 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91f3 expref: 250 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.116251:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a353873b400) 00010000:00010000:0.0:1763343035.116277:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343035.116299:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6595 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9208 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.116453:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae659c lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.116470:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae659c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1db:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.116482:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae659c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1db:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343035.116497:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1db:0x0]: returning size 0 00000100:00100000:1.0:1763343035.116665:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9239 00000100:00100000:1.0:1763343035.116678:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56866:x1848997993530624:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.116688:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.116699:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae65aa lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac920f expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.116731:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae65aa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac920f expref: 252 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.116758:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae65aa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac920f expref: 253 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.116763:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae6595 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9208 expref: 253 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.116775:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae659c lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1db:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9208 expref: 252 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.116780:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343035.116783:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343035.116786:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:1.0:1763343035.116884:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56866:x1848997993530624:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 208us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.116891:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9239 00010000:00010000:0.0:1763343035.117143:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343035.117147:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1763343035.117152:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c400, rc 0) 00000100:00100000:1.0:1763343035.117255:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:55941:x1848997993530496:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1110us (1530us total) trans 8589939899 rc 0/0 00000100:00100000:1.0:1763343035.117264:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9238 00000100:00100000:2.0:1763343035.119285:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.119364:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.119456:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993531008 00000100:00100000:1.0:1763343035.119461:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993530752 00000100:00100000:1.0:1763343035.119469:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993530752 00000100:00100000:0.0:1763343035.119469:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993531008 00000100:00100000:1.0:1763343035.119540:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9240 00000100:00100000:1.0:1763343035.119551:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:55941:x1848997993530752:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343035.119580:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.119603:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae65b1 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9216 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.119676:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae65b8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.119694:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae65b8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.119706:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae65b8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.119842:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae65b1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9216 expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.119863:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae65b8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9216 expref: 253 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.119872:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343035.119875:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343035.119879:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343035.119953:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:55941:x1848997993530752:12345-192.168.204.21@tcp:101:bash.0 Request processed in 404us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.119963:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9240 00000100:00100000:0.0:1763343035.120039:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3141 00000100:00100000:0.0:1763343035.120048:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56866:x1848997993531008:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343035.120245:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56866:x1848997993531008:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 198us (879us total) trans 8589939900 rc 0/0 00000100:00100000:0.0:1763343035.120252:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3141 00000100:00100000:2.0:1763343035.121999:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.122664:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.123237:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993531264 00000100:00100000:1.0:1763343035.123252:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993531264 00000100:00100000:1.0:1763343035.123334:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993531520 00000100:00100000:1.0:1763343035.123339:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993531520 00000100:00100000:2.0:1763343035.123424:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9241 00000100:00100000:2.0:1763343035.123439:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:55941:x1848997993531264:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:2.0:1763343035.123516:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343035.123553:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae659c lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1db:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9208 expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.123579:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:2.0:1763343035.123586:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343035.123600:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9242 00000100:00100000:1.0:1763343035.123610:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56866:x1848997993531520:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.123638:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.123665:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae65bf lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac921d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.123727:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae65c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.123742:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae65c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.123752:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae65c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.123764:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae65cd lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.123771:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae65cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.123776:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae65cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.123843:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae65d4 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.123853:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae65d4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.123859:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae65d4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.123870:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae65db lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.123881:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae65db lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.123888:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae65db lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343035.123898:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1db:0x0]: returning size 0 00000001:00080000:2.0:1763343035.123919:0:10042:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939901 00000004:00010000:2.0:1763343035.123956:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000374ec9d reply state 000000008b210954 transno 8589939902 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae65d4 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.123969:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae65d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.123976:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:2.0:1763343035.123979:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343035.123982:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343035.123986:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae65c6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.123994:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae65c6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.124000:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae65c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.124006:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae65c6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.124013:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.124018:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae65c6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.124025:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae65c6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.124034:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:1.0:1763343035.124036:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.124040:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae65c6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.124046:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae65c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.124062:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae65cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.124067:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae65cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.124072:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae65cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.124076:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.124078:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae65cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.124083:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae65cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.124089:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8200) 00010000:00010000:1.0:1763343035.124092:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.124095:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae65cd lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343035.124098:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:55941:x1848997993531264:12345-192.168.204.21@tcp:36:bash.0 Request processed in 664us (2112us total) trans 8589939902 rc 0/0 00010000:00010000:1.0:1763343035.124102:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae65cd lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343035.124106:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9241 00000020:00080000:2.0:1763343035.124112:0:10042:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763343035.124131:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae65bf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac921d expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.124463:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae65db lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac921d expref: 257 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.124472:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343035.124476:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:1.0:1763343035.124478:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:1.0:1763343035.125542:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56866:x1848997993531520:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1927us (2873us total) trans 8589939903 rc 0/0 00000100:00100000:1.0:1763343035.125554:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9242 00000100:00100000:3.0:1763343035.127242:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.127306:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993531776 00000100:00100000:1.0:1763343035.127320:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993531776 00000100:00100000:3.0:1763343035.127342:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.127393:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993531904 00000100:00100000:1.0:1763343035.127397:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993531904 00000100:00100000:1.0:1763343035.127720:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9243 00000100:00100000:1.0:1763343035.127733:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:55941:x1848997993531776:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343035.127767:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.127771:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343035.127808:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae65aa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac920f expref: 258 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.127835:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343035.127843:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343035.127860:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae65e9 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9224 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343035.127862:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9244 00000100:00100000:0.0:1763343035.127873:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56866:x1848997993531904:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.127882:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.127894:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae65f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac922b expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.127937:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae65f7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.127952:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae65db lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac921d expref: 259 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.127963:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae65f7 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.127964:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.127980:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae65f7 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.127987:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.128189:0:28422:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae65f7 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.128204:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.128214:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae65db lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac921d expref: 259 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.128230:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae65db lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac921d expref: 259 pid: 6523 timeout: 1328 lvb_type: 0 00000100:00100000:1.0:1763343035.128247:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c251880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010257920:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343035.129057:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abed80 going to sleep for 11 seconds 00000100:00100000:2.0:1763343035.134222:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.134393:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c251880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010257920:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343035.134435:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae65f7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00000100:00100000:3.0:1763343035.134510:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993532032 00000100:00100000:3.0:1763343035.134520:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993532032 00010000:00010000:3.0:1763343035.134572:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae65db lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac921d expref: 260 pid: 6523 timeout: 1328 lvb_type: 0 00000100:00100000:3.0:1763343035.134660:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3043 00000100:00100000:3.0:1763343035.134673:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:2429:x1848997993532032:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343035.134693:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343035.134702:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae65db lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac921d expref: 260 pid: 6523 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343035.134716:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae65db lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac921d expref: 260 pid: 6523 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343035.134745:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae65db lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac921d expref: 260 pid: 6523 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343035.134766:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:3.0:1763343035.134772:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.134782:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae65f7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.134793:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae65f7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.134802:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae65f7 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.134811:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.134818:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x40 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.134845:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343035.134912:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:2429:x1848997993532032:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 240us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.134929:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3043 00010000:00010000:1.0:1763343035.135497:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae65f7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.135507:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae65f7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00000040:00080000:1.0:1763343035.135835:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1411, 88 off119264 00000004:00080000:1.0:1763343035.135845:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228803223067ns, next at 1229610036645ns, rc = 0 00000040:00080000:1.0:1763343035.135885:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1410, 88 off119264 00000004:00080000:1.0:1763343035.135890:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1228803269556ns, next at 1229609967587ns, rc = 0 00000040:00080000:1.0:1763343035.135918:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1411, 88 off119352 00000004:00080000:1.0:1763343035.135932:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1228803311003ns, next at 1229609967587ns, rc = 0 00000040:00080000:1.0:1763343035.135944:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1412, 88 off119352 00000004:00080000:1.0:1763343035.135948:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1228803327876ns, next at 1229610036645ns, rc = 0 00000001:00080000:0.0:1763343035.142988:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939904 is committed 00000004:00080000:0.0:1763343035.143013:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 930 committed 00000004:00080000:0.0:1763343035.143031:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 931 committed 00010000:00010000:2.0:1763343035.143140:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6525 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.143158:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6525 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.143167:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6525 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.143176:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.143183:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6525 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.143194:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6525 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.143221:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8200) 00010000:00010000:2.0:1763343035.143228:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.143236:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6525 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.143244:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6525 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000100:00100000:3.0:1763343035.143245:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010258048:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1763343035.143286:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae65d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.143293:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae65d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.143299:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae65d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.143305:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403528c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.143308:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae65d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.143314:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae65d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343035.143322:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:2.0:1763343035.143325:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.143329:0:3644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x40 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.143341:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae65d4 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000100:00100000:3.0:1763343035.143350:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343035.143352:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae65d4 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1db:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000100:00100000:3.0:1763343035.143400:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343035.143407:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010258432:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343035.143430:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343035.143473:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010258048 00000100:00100000:3.0:1763343035.143495:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010258048 00000100:00100000:3.0:1763343035.143551:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010258432 00000100:00100000:3.0:1763343035.143554:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010258432 00000100:00100000:3.0:1763343035.143577:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6487 00000100:00100000:3.0:1763343035.143587:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3660:x1848998010258048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343035.143658:0:27833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:667 count 1 00010000:00010000:3.0:1763343035.143691:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6605 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.143715:0:27833:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae638f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9160 expref: 28 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343035.143725:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.143727:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.143736:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6605 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.143767:0:27833:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae638f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9160 expref: 28 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343035.143782:0:27833:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae638f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9160 expref: 28 pid: 8407 timeout: 1328 lvb_type: 1 00000100:00100000:3.0:1763343035.143795:0:27833:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27833:1848998010258560:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343035.143864:0:27833:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a351ffa9840 going to sleep for 11 seconds 00000004:00080000:0.0:1763343035.143875:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 930 committed 00000100:00100000:3.0:1763343035.143887:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6488 00000100:00100000:3.0:1763343035.143895:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3660:x1848998010258432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343035.144081:0:28994:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2a0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343035.144085:0:28994:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2a0:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343035.144088:0:28994:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2a0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343035.144090:0:28994:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2a0:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343035.144093:0:28994:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2a0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343035.144140:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3660:x1848998010258432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 245us (707us total) trans 17179871579 rc 0/0 00000100:00100000:3.0:1763343035.144148:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6488 00000004:00080000:3.0:1763343035.144203:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34060ab800/2, rc 0, transno 17179871579 00000100:00100000:3.0:1763343035.144209:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010258432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343035.144525:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010258176:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343035.144565:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.144595:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343035.144601:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010258304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343035.144639:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.144675:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010258176 00000100:00100000:2.0:1763343035.144681:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010258176 00000100:00100000:2.0:1763343035.144711:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010258304 00000100:00100000:2.0:1763343035.144714:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010258304 00000100:00100000:2.0:1763343035.144735:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6489 00000100:00100000:2.0:1763343035.144742:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3657:x1848998010258176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343035.144762:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:668 count 1 00010000:00010000:2.0:1763343035.144783:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae660c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.144799:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae648b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91b4 expref: 28 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.144808:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343035.144809:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343035.144812:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae660c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.144840:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae648b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91b4 expref: 28 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.144851:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae648b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91b4 expref: 28 pid: 8407 timeout: 1328 lvb_type: 0 00000100:00100000:2.0:1763343035.144868:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010258688:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343035.144906:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34047260c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343035.144936:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6490 00000100:00100000:2.0:1763343035.144944:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3657:x1848998010258304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343035.145066:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3657:x1848998010258304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (425us total) trans 17179871580 rc 0/0 00000100:00100000:2.0:1763343035.145073:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6490 00000004:00080000:2.0:1763343035.145113:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34060ab480/2, rc 0, transno 17179871580 00000100:00100000:2.0:1763343035.145117:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010258304:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343035.145601:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 929 committed 00010000:00010000:1.0:1763343035.145864:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae65f7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1db:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9224 expref: 244 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.145883:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343035.145886:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343035.145891:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.145902:0:6523:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.145908:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.145965:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae65e9 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9224 expref: 244 pid: 6523 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343035.145984:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae65f7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1db:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9224 expref: 243 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.146025:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:1.0:1763343035.146071:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:55941:x1848997993531776:12345-192.168.204.21@tcp:101:bash.0 Request processed in 18340us (18839us total) trans 8589939904 rc 0/0 00000100:00100000:1.0:1763343035.146078:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9243 00010000:00010000:0.0:1763343035.146488:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.146498:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343035.146546:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1db:0x0]: returning size 2 00000004:00200000:0.0:1763343035.146552:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343035.146577:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.146589:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.146615:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae65f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac922b expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.146695:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac922b expref: 242 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.146703:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343035.146706:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763343035.146709:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d000, rc 0) 00000100:00100000:0.0:1763343035.146772:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56866:x1848997993531904:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 18901us (19428us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.146779:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9244 00000100:00100000:2.0:1763343035.147658:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010259072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343035.147721:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.147761:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763343035.147766:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010258944:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343035.147792:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.147833:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010259072 00000100:00100000:2.0:1763343035.147842:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010259072 00000100:00100000:2.0:1763343035.147879:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010258944 00000100:00100000:2.0:1763343035.147882:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010258944 00000100:00100000:2.0:1763343035.147898:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6491 00000100:00100000:2.0:1763343035.147905:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3658:x1848998010259072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343035.148119:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3658:x1848998010259072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (397us total) trans 21474838877 rc 0/0 00000100:00100000:2.0:1763343035.148126:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6491 00000100:00100000:2.0:1763343035.148141:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6492 00000100:00100000:2.0:1763343035.148146:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354111cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3658:x1848998010258944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343035.148159:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:666 count 1 00010000:00010000:2.0:1763343035.148178:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae6613 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.148198:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae6468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91ad expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.148207:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343035.148209:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343035.148213:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae6613 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.148239:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae6468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91ad expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.148251:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae6468 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91ad expref: 13 pid: 8407 timeout: 1328 lvb_type: 0 00000100:00100000:2.0:1763343035.148263:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010259328:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343035.148317:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726300 going to sleep for 11 seconds 00000004:00080000:2.0:1763343035.148358:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34097a6d80/2, rc 0, transno 21474838877 00000100:00100000:2.0:1763343035.148364:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010259072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343035.148577:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010259200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343035.148608:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343035.148648:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343035.148653:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010258816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343035.148670:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343035.148705:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010259200 00000100:00100000:1.0:1763343035.148709:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010259200 00000100:00100000:1.0:1763343035.148729:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010258816 00000100:00100000:1.0:1763343035.148731:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010258816 00000100:00100000:1.0:1763343035.148746:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6493 00000100:00100000:1.0:1763343035.148751:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3659:x1848998010259200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763343035.148836:0:28648:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x29e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343035.148840:0:28648:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x29e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343035.148842:0:28648:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x29e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343035.148844:0:28648:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x29e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343035.148847:0:28648:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x29e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343035.148872:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3659:x1848998010259200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (263us total) trans 21474838878 rc 0/0 00000100:00100000:1.0:1763343035.148878:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6493 00000100:00100000:1.0:1763343035.148892:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6494 00000100:00100000:1.0:1763343035.148897:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3659:x1848998010258816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343035.148907:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:665 count 1 00010000:00010000:1.0:1763343035.148931:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae661a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.148945:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae6293 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9105 expref: 13 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.148953:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343035.148954:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343035.148957:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae661a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.148981:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae6293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9105 expref: 13 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.148997:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae6293 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9105 expref: 13 pid: 28648 timeout: 1328 lvb_type: 0 00000100:00100000:1.0:1763343035.149007:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537968380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010259456:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343035.149039:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe240 going to sleep for 11 seconds 00000004:00080000:1.0:1763343035.149070:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34097a6a00/2, rc 0, transno 21474838878 00000100:00100000:1.0:1763343035.149075:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010259200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343035.150732:0:27833:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:27833:1848998010258560:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343035.150769:0:27833:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6605 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343035.155077:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.156259:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993532160 00000100:00100000:1.0:1763343035.156282:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993532160 00010000:00010000:1.0:1763343035.156354:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae638f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9160 expref: 29 pid: 8407 timeout: 1328 lvb_type: 1 00000100:00100000:1.0:1763343035.156416:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3044 00000100:00100000:1.0:1763343035.156428:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2429:x1848997993532160:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343035.156449:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343035.156456:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae638f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9160 expref: 29 pid: 8407 timeout: 1328 lvb_type: 1 00010000:00010000:1.0:1763343035.156473:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae638f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9160 expref: 29 pid: 8407 timeout: 1328 lvb_type: 1 00010000:00010000:1.0:1763343035.156513:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae638f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x29b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9160 expref: 29 pid: 8407 timeout: 1328 lvb_type: 1 00010000:00010000:1.0:1763343035.156536:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343035.156539:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343035.156546:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6605 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.156559:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6605 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.157047:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343035.157184:0:27833:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6605 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.157199:0:27833:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6605 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.157213:0:27833:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6605 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.157223:0:27833:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.157256:0:27833:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343035.157522:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2429:x1848997993532160:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1089us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.157535:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3044 00010000:00010000:1.0:1763343035.157641:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343035.157649:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.157658:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343035.157663:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.157673:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6605 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.157692:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6605 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.157700:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6605 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.157723:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343035.157724:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343035.157726:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343035.158360:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3660:x1848998010258048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14770us (15009us total) trans 17179871581 rc 0/0 00000100:00100000:2.0:1763343035.158373:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6487 00000100:00100000:3.0:1763343035.158775:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.158893:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993532416 00000100:00100000:1.0:1763343035.158904:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993532416 00000100:00100000:3.0:1763343035.158956:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537968380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010259456:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343035.158964:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6495 00000100:00100000:1.0:1763343035.158976:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:55941:x1848997993532416:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343035.158993:0:28648:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae661a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.158999:0:27833:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763343035.159041:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.159068:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:1.0:1763343035.159083:0:27833:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6621 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9232 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343035.159112:0:27833:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1763343035.159119:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010258688:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343035.159136:0:15756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae660c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.159140:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343035.159145:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343035.159158:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6621 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9232 expref: 29 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.159176:0:27833:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6621 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9232 expref: 29 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.159189:0:27833:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00000100:00100000:1.0:1763343035.159248:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:55941:x1848997993532416:12345-192.168.204.21@tcp:101:bash.0 Request processed in 273us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.159256:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6495 00000004:00080000:0.0:1763343035.159296:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34060a8000/2, rc 0, transno 17179871581 00000100:00100000:0.0:1763343035.159306:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010258048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343035.159332:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993532544 00000100:00100000:0.0:1763343035.159336:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993532544 00010000:00010000:0.0:1763343035.159362:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae6293 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9105 expref: 14 pid: 28648 timeout: 1328 lvb_type: 0 00000100:00100000:0.0:1763343035.159406:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3045 00000100:00100000:0.0:1763343035.159415:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3517410050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993532544:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343035.159428:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343035.159433:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae6293 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9105 expref: 14 pid: 28648 timeout: 1328 lvb_type: 0 00010000:00010000:0.0:1763343035.159444:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae6293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9105 expref: 14 pid: 28648 timeout: 1328 lvb_type: 0 00010000:00010000:0.0:1763343035.159468:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae6293 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9105 expref: 14 pid: 28648 timeout: 1328 lvb_type: 0 00010000:00010000:0.0:1763343035.159482:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.159484:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.159488:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae661a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.159496:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae661a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.159520:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343035.159544:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3517410050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993532544:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 130us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.159552:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3045 00010000:00010000:0.0:1763343035.159610:0:28648:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae661a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.159646:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae661a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.159661:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae661a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.159669:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae661a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.159690:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343035.159967:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3659:x1848998010258816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11068us (11293us total) trans 21474838879 rc 0/0 00000100:00100000:0.0:1763343035.159976:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6494 00010000:00010000:0.0:1763343035.160001:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343035.160009:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae661a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.160018:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343035.160023:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae661a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.160034:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae661a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.160048:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae661a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.160056:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae661a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.160080:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343035.160082:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343035.160084:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343035.160115:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c72d80/2, rc 0, transno 21474838879 00000100:00100000:0.0:1763343035.160122:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010258816:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343035.160151:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993532288 00000100:00100000:0.0:1763343035.160157:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993532288 00000100:00100000:2.0:1763343035.160181:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010259328:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343035.160199:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9245 00010000:00010000:2.0:1763343035.160208:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae6613 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343035.160210:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+242:56866:x1848997993532288:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.160236:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.160256:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6628 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9239 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.160321:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6628 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9239 expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.160336:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6628 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9239 expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.160358:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343035.160362:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343035.160367:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d200, rc 0) 00000100:00100000:0.0:1763343035.160415:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56866:x1848997993532288:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 207us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.160422:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9245 00000100:00100000:3.0:1763343035.161573:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.161618:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993532672 00000100:00100000:3.0:1763343035.161645:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993532672 00010000:00010000:3.0:1763343035.161686:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae648b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91b4 expref: 29 pid: 8407 timeout: 1328 lvb_type: 0 00000100:00100000:3.0:1763343035.161721:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3046 00000100:00100000:3.0:1763343035.161731:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2430:x1848997993532672:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343035.161749:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343035.161754:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae648b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91b4 expref: 29 pid: 8407 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343035.161772:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae648b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91b4 expref: 29 pid: 8407 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343035.161795:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae648b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91b4 expref: 29 pid: 8407 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343035.161812:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.161815:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.161820:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae660c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.161831:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae660c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.161857:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343035.161898:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2430:x1848997993532672:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 168us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.161906:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3046 00010000:00010000:3.0:1763343035.161954:0:15756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae660c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.161963:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae660c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.161975:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae660c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.161988:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae660c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.162017:0:15756:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343035.162219:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343035.162230:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae660c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.162241:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403528e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343035.162247:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae660c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.162259:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae660c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.162276:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae660c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.162285:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae660c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.162308:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343035.162311:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343035.162314:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343035.162439:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3657:x1848998010258176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17694us (17871us total) trans 17179871582 rc 0/0 00000100:00100000:3.0:1763343035.162451:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6489 00000100:00100000:3.0:1763343035.162547:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.162567:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993532800 00000100:00100000:3.0:1763343035.162573:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993532800 00010000:00010000:3.0:1763343035.162598:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae6468 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91ad expref: 13 pid: 8407 timeout: 1328 lvb_type: 0 00000100:00100000:3.0:1763343035.162647:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3047 00000100:00100000:3.0:1763343035.162655:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993532800:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343035.162667:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343035.162672:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae6468 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91ad expref: 13 pid: 8407 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343035.162683:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae6468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91ad expref: 13 pid: 8407 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343035.162700:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93e00/0x607405d401ae6468 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91ad expref: 13 pid: 8407 timeout: 1328 lvb_type: 0 00010000:00010000:3.0:1763343035.162717:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.162719:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.162723:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae6613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.162730:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae6613 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.162749:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343035.162775:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2430:x1848997993532800:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 121us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.162782:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3047 00010000:00010000:2.0:1763343035.162851:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae6613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.162861:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae6613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.162870:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae6613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.162878:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae6613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.162903:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343035.165563:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354111cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3658:x1848998010258944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17400us (17754us total) trans 21474838880 rc 0/0 00000100:00100000:2.0:1763343035.165579:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6492 00010000:00010000:1.0:1763343035.166437:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343035.166450:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae6613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.166464:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343035.166469:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae6613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.166480:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae6613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.166508:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae6613 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.166516:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae6613 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.166538:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343035.166540:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343035.166542:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343035.166581:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34060abb80/2, rc 0, transno 17179871582 00000100:00100000:1.0:1763343035.166589:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010258176:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763343035.167709:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c73b80/2, rc 0, transno 21474838880 00000100:00100000:3.0:1763343035.167725:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010258944:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343035.171337:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.172498:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993532928 00000100:00100000:2.0:1763343035.172514:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993532928 00000100:00100000:2.0:1763343035.172599:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6496 00000100:00100000:2.0:1763343035.172611:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:55941:x1848997993532928:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343035.172657:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.172688:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae662f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9240 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343035.172719:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343035.172748:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.172751:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.172764:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae662f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9240 expref: 13 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.172782:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae662f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9240 expref: 13 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.172797:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403528e00, rc 0) 00000100:00100000:2.0:1763343035.172880:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:55941:x1848997993532928:12345-192.168.204.21@tcp:101:bash.0 Request processed in 270us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343035.172888:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6496 00000100:00100000:2.0:1763343035.175568:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.176658:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.176701:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.176787:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993533440 00000100:00100000:1.0:1763343035.176802:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993533440 00000100:00100000:2.0:1763343035.176817:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00002000:00010000:1.0:1763343035.176860:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/671 (0->18446744073709551615) 00002000:00100000:1.0:1763343035.176866:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34097a4700 with x1848997993533440 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343035.176882:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34097a4700. 00000100:00100000:0.0:1763343035.176905:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993533184 00000100:00100000:1.0:1763343035.176909:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993533568 00000100:00100000:0.0:1763343035.176913:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993533184 00000100:00100000:1.0:1763343035.176916:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993533568 00002000:00010000:1.0:1763343035.176954:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/669 (0->18446744073709551615) 00002000:00100000:1.0:1763343035.176958:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34097a5180 with x1848997993533568 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343035.176967:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34097a5180. 00000100:00100000:0.0:1763343035.176975:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3142 00000100:00100000:0.0:1763343035.176990:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56866:x1848997993533184:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343035.176998:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1588 00000100:00100000:1.0:1763343035.177009:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2432:x1848997993533440:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:0.0:1763343035.177300:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56866:x1848997993533184:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 313us (1748us total) trans 8589939905 rc 0/0 00000100:00100000:0.0:1763343035.177311:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3142 00002000:00010000:1.0:1763343035.177380:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x29f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343035.177385:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x29f:0x0] updating lvb mtime from disk: 0 -> 1763343035 00002000:00010000:1.0:1763343035.177389:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x29f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343035.177391:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x29f:0x0] updating lvb ctime from disk: 0 -> 1763343035 00002000:00010000:1.0:1763343035.177394:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x29f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343035.177424:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2432:x1848997993533440:12345-192.168.204.21@tcp:10:bash.0 Request processed in 417us (720us total) trans 17179871583 rc 0/0 00000100:00100000:0.0:1763343035.177429:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1589 00000100:00100000:1.0:1763343035.177439:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1588 00002000:00010000:1.0:1763343035.177445:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/671 (0->18446744073709551615) 00000100:00100000:0.0:1763343035.177445:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2432:x1848997993533568:12345-192.168.204.21@tcp:10:bash.0 00002000:00100000:1.0:1763343035.177451:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34097a4700 with x1848997993533440 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343035.177459:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34097a4700. 00002000:00010000:0.0:1763343035.177570:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x29d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343035.177573:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x29d:0x0] updating lvb mtime from disk: 0 -> 1763343035 00002000:00010000:0.0:1763343035.177575:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x29d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343035.177577:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x29d:0x0] updating lvb ctime from disk: 0 -> 1763343035 00002000:00010000:0.0:1763343035.177579:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x29d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343035.177601:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2432:x1848997993533568:12345-192.168.204.21@tcp:10:bash.0 Request processed in 162us (785us total) trans 21474838881 rc 0/0 00000100:00100000:0.0:1763343035.177608:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1589 00002000:00010000:0.0:1763343035.177611:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/669 (0->18446744073709551615) 00002000:00100000:0.0:1763343035.177613:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34097a5180 with x1848997993533568 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343035.177655:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34097a5180. 00000100:00100000:3.0:1763343035.178716:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993533312 00000100:00100000:3.0:1763343035.178730:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993533312 00000100:00100000:3.0:1763343035.178808:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 408 00000100:00100000:3.0:1763343035.178818:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:2432:x1848997993533312:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343035.178835:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343035.178865:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6628 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9239 expref: 244 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.178888:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:3.0:1763343035.178895:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343035.178958:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:2432:x1848997993533312:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 141us (2305us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.178965:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 408 00000100:00100000:2.0:1763343035.185721:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.185832:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993534080 00000100:00100000:3.0:1763343035.185846:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993534080 00000100:00100000:3.0:1763343035.185912:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3143 00000100:00100000:3.0:1763343035.185943:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:55941:x1848997993534080:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:3.0:1763343035.186384:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:55941:x1848997993534080:12345-192.168.204.21@tcp:35:bash.0 Request processed in 462us (669us total) trans 8589939906 rc 0/0 00000100:00100000:3.0:1763343035.186393:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3143 00000100:00100000:0.0:1763343035.189025:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.189264:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993533824 00000100:00100000:2.0:1763343035.189281:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993533824 00000100:00100000:2.0:1763343035.189368:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9246 00000100:00100000:2.0:1763343035.189381:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56866:x1848997993533824:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.190189:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.190232:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae6636 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9247 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.190347:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae663d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190367:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae663d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190382:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae663d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190400:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6644 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190406:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6644 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190412:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6644 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190588:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17c00/0x607405d401ae664b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190604:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17c00/0x607405d401ae664b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190611:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17c00/0x607405d401ae664b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343035.190640:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1db:0x0]: returning size 5 00010000:00010000:2.0:1763343035.190760:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae663d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190769:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae663d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190776:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae663d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190783:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae663d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190790:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.190796:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae663d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190805:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae663d lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190819:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7b00) 00010000:00010000:2.0:1763343035.190823:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.190829:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae663d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190835:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae663d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190858:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6644 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190863:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6644 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190868:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6644 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190873:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.190876:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6644 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190880:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6644 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190887:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3538bf7200) 00010000:00010000:2.0:1763343035.190890:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.190893:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6644 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190898:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6644 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.190961:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae6636 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9247 expref: 247 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.190980:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17c00/0x607405d401ae664b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9247 expref: 246 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.190988:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:2.0:1763343035.190992:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343035.190995:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3404a17c00, rc 0) 00000100:00100000:2.0:1763343035.191114:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56866:x1848997993533824:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1736us (6512us total) trans 8589939907 rc 0/0 00000100:00100000:2.0:1763343035.191124:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9246 00000100:00100000:2.0:1763343035.199883:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.199981:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993534208 00000100:00100000:1.0:1763343035.199997:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993534208 00000100:00100000:1.0:1763343035.200080:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3144 00000100:00100000:1.0:1763343035.200093:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56866:x1848997993534208:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:1.0:1763343035.200333:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56866:x1848997993534208:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 241us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.200344:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3144 00000100:00100000:0.0:1763343035.206217:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.206275:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.206378:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993534464 00000100:00100000:1.0:1763343035.206393:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993534464 00000100:00100000:1.0:1763343035.206461:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993534720 00000100:00100000:1.0:1763343035.206465:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993534720 00000100:00100000:1.0:1763343035.206500:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9247 00000100:00100000:1.0:1763343035.206512:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56866:x1848997993534464:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.206538:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.206567:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6659 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac924e expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.206752:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6660 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.206771:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6660 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.206784:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6660 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343035.206799:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1db:0x0]: returning size 5 00010000:00010000:1.0:1763343035.206937:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6659 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac924e expref: 250 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.206957:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6660 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac924e expref: 249 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.206967:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343035.206971:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343035.206974:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:1.0:1763343035.207041:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56866:x1848997993534464:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 531us (839us total) trans 8589939908 rc 0/0 00000100:00100000:1.0:1763343035.207048:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9247 00000100:00100000:1.0:1763343035.207069:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9248 00000100:00100000:1.0:1763343035.207075:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56867:x1848997993534720:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:1.0:1763343035.207097:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1763343035.207112:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae65f7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1db:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9224 expref: 248 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.207125:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17c00/0x607405d401ae664b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9247 expref: 247 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.207144:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae65fe lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac922b expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.207155:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae65b8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1db:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9216 expref: 245 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.207162:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343035.207165:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343035.207183:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae666e lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207190:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae666e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207195:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae666e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207205:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6675 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207211:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6675 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207216:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6675 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207309:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae667c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207317:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae667c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207327:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae667c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00080000:1.0:1763343035.207577:0:10042:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1db:0x0] is inserted into orphan list, open count = 2 00010000:00010000:1.0:1763343035.207697:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae667c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207705:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae667c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207712:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae667c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207718:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.207722:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae667c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207730:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae667c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207738:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343035.207741:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343035.207745:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae667c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207751:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae667c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207763:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae666e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207769:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae666e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207778:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae666e lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207783:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae666e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207787:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.207790:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae666e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207795:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae666e lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207801:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aabc00) 00010000:00010000:1.0:1763343035.207803:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.207806:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae666e lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207811:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae666e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:1.0:1763343035.207823:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e3e2973d reply state 00000000f75f31b8 transno 8589939909 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6675 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207834:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6675 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.207840:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab500) 00010000:00010000:1.0:1763343035.207843:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343035.207845:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343035.207891:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56867:x1848997993534720:12345-192.168.204.21@tcp:36:rm.0 Request processed in 814us (1614us total) trans 8589939909 rc 0/0 00000100:00100000:1.0:1763343035.207901:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9248 00000100:00100000:0.0:1763343035.214505:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.214597:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993534976 00000100:00100000:3.0:1763343035.214611:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993534976 00000100:00100000:2.0:1763343035.215583:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3145 00000100:00100000:2.0:1763343035.215597:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56866:x1848997993534976:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:2.0:1763343035.215738:0:6526:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1db:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6660 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac924e expref: 246 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.215802:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6683 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343035.215820:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6683 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343035.215831:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6683 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00000004:00020000:2.0:1763343035.216063:0:6526:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0000-mdtlov: can not set all stale mirrors for [0x200000405:0x1db:0x0]: rc = -1 00010000:00010000:2.0:1763343035.216109:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6683 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343035.216119:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6683 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343035.216127:0:6526:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6683 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343035.216134:0:6526:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3404a16600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.216140:0:6526:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6683 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343035.216148:0:6526:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6683 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343035.216160:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:2.0:1763343035.216164:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763343035.216170:0:6526:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6683 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343035.216177:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6683 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1db:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343035.216190:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:2.0:1763343035.216193:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343035.216198:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6660 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac924e expref: 246 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343035.216407:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56866:x1848997993534976:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 812us (1916us total) trans 8589939910 rc -1/-1 00000100:00100000:2.0:1763343035.216416:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3145 00000100:00100000:1.0:1763343035.229121:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.230145:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993535104 00000100:00100000:3.0:1763343035.230161:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993535104 00000100:00100000:3.0:1763343035.230251:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9249 00000100:00100000:3.0:1763343035.230374:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56866:x1848997993535104:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.230411:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.230446:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae668a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9255 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.230527:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae668a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9255 expref: 247 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.230543:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93e00/0x607405d401ae668a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1db:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9255 expref: 247 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.230564:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34039e8100) 00010000:00010000:3.0:1763343035.230568:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343035.230572:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93e00, rc 0) 00000100:00100000:3.0:1763343035.230710:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56866:x1848997993535104:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 448us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.230718:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9249 00000100:00100000:0.0:1763343035.234814:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.235142:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993535360 00000100:00100000:2.0:1763343035.235157:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993535360 00000100:00100000:2.0:1763343035.235219:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3146 00000100:00100000:2.0:1763343035.235229:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56866:x1848997993535360:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:2.0:1763343035.235673:0:6526:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1db:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763343035.235767:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1413, 64 off119416 00000040:00080000:2.0:1763343035.235795:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1412, 64 off119416 00000040:00080000:2.0:1763343035.235805:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1413, 64 off119480 00000040:00080000:2.0:1763343035.235815:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1414, 64 off119480 00010000:00010000:2.0:1763343035.235891:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17e00/0x607405d401ae6691 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343035.235912:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17e00/0x607405d401ae6691 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343035.235933:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17e00/0x607405d401ae6691 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343035.235942:0:6526:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17e00/0x607405d401ae6691 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343035.235948:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17e00/0x607405d401ae6691 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343035.235953:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17e00/0x607405d401ae6691 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343035.235985:0:6526:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343035.236230:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56866:x1848997993535360:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1000us (1427us total) trans 8589939911 rc 0/0 00000100:00100000:2.0:1763343035.236239:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3146 00010000:00010000:3.0:1763343035.238000:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343035.238027:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17e00/0x607405d401ae6691 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343035.238041:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3404a17e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343035.238046:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17e00/0x607405d401ae6691 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343035.238056:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17e00/0x607405d401ae6691 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343035.238080:0:13198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1db:0x0].0x0 (ffff9a34039e8100) 00010000:00010000:3.0:1763343035.238084:0:13198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343035.238090:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17e00/0x607405d401ae6691 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343035.238096:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17e00/0x607405d401ae6691 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343035.238113:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343035.238115:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343035.238117:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343035.248269:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.250783:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993535488 00000100:00100000:3.0:1763343035.250803:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993535488 00000100:00100000:3.0:1763343035.250887:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9250 00000100:00100000:3.0:1763343035.250898:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56868:x1848997993535488:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.250943:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.250975:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6698 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac925c expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.251069:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae669f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251086:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae669f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251100:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae669f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251113:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251120:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251126:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251176:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae669f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251184:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae669f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251191:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae669f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251197:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae669f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251203:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.251209:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae669f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251218:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae669f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251230:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8c00) 00010000:00010000:3.0:1763343035.251234:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.251240:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae669f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251247:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae669f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251263:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251269:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251275:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251279:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.251282:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251287:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251294:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab500) 00010000:00010000:3.0:1763343035.251296:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.251299:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251304:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.251336:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6698 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac925c expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.251348:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8c00) 00010000:00010000:3.0:1763343035.251350:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.251354:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6698 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac925c expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.251368:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343035.251451:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56868:x1848997993535488:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 554us (3197us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343035.251460:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9250 00000100:00100000:0.0:1763343035.255736:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.255831:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993535616 00000100:00100000:3.0:1763343035.255846:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993535616 00000100:00100000:3.0:1763343035.255929:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9251 00000100:00100000:3.0:1763343035.255941:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56868:x1848997993535616:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.255969:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.256002:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae66ad lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9263 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.257223:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae66b4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.257245:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae66b4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.257260:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae66b4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258166:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae66bb lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258178:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae66bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258189:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae66bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258241:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae66b4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258249:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae66b4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258256:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae66b4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258549:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.258556:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae66b4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258565:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae66b4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258578:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:3.0:1763343035.258581:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.258586:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae66b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258593:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae66b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258610:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae66bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258616:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae66bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258658:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae66bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258663:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.258666:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae66bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258671:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae66bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258677:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab500) 00010000:00010000:3.0:1763343035.258679:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.258681:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae66bb lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258686:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae66bb lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.258729:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae66ad lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9263 expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.258740:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:3.0:1763343035.258742:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.258745:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae66ad lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9263 expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.258760:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:0.0:1763343035.258942:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56868:x1848997993535616:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2999us (3335us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343035.258955:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9251 00000100:00100000:1.0:1763343035.265194:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.265326:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993535744 00000100:00100000:0.0:1763343035.265340:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993535744 00000100:00100000:0.0:1763343035.265423:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9252 00000100:00100000:0.0:1763343035.265435:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56868:x1848997993535744:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.265462:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.265496:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae66c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac926a expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.265586:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae66c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.265603:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae66c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.265617:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae66c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343035.265708:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343035.265715:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343035.265759:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae66c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac926a expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.265781:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae66c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac926a expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.265791:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343035.265795:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343035.265800:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665c400, rc 0) 00000100:00100000:2.0:1763343035.268766:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.269189:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993536000 00000100:00100000:3.0:1763343035.269203:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993536000 00000100:00100000:3.0:1763343035.269267:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9253 00000100:00100000:3.0:1763343035.269277:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56869:x1848997993536000:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.269306:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.269332:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae66d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9271 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.269430:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66d7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269449:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66d7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269462:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66d7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269474:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae66de lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269482:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae66de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269488:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae66de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269538:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66d7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269546:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66d7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269552:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269563:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66d7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269570:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.269575:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66d7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269583:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66d7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269597:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:3.0:1763343035.269601:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.269608:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66d7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269615:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae66d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269656:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae66de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269663:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae66de lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269670:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae66de lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269675:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.269678:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae66de lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269684:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae66de lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269697:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab500) 00010000:00010000:3.0:1763343035.269700:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.269703:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae66de lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269708:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae66de lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.269739:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae66d0 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9271 expref: 251 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.269750:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:3.0:1763343035.269752:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343035.269756:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae66d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9271 expref: 251 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.269766:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343035.269842:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56869:x1848997993536000:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 565us (1093us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343035.269850:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9253 00000100:00100000:0.0:1763343035.270844:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56868:x1848997993535744:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 5402us (5657us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.270855:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9252 00000100:00100000:2.0:1763343035.277411:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.277593:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993536128 00000100:00100000:1.0:1763343035.277607:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993536128 00000100:00100000:1.0:1763343035.277713:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9254 00000100:00100000:1.0:1763343035.277726:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56869:x1848997993536128:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.277755:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.277785:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae66e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9278 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.277872:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae66ec lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.277889:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae66ec lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.277902:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae66ec lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.277913:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae66f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.277933:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae66f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.277940:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae66f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.278009:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae66ec lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.278025:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae66ec lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.278031:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae66ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.278037:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.278042:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae66ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.278050:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae66ec lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.278065:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:1.0:1763343035.278068:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.278074:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae66ec lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.278079:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae66ec lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.278095:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae66f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.278231:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae66f3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.278239:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae66f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.278244:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.278247:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae66f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.278258:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae66f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.278266:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab500) 00010000:00010000:1.0:1763343035.278269:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.278272:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae66f3 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.278278:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae66f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.278313:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae66e5 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9278 expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.278324:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:1.0:1763343035.278327:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.278331:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae66e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9278 expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.278340:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343035.279119:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56869:x1848997993536128:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1389us (1717us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343035.279133:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9254 00000100:00100000:1.0:1763343035.297524:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.297665:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993536384 00000100:00100000:0.0:1763343035.297680:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993536384 00000100:00100000:0.0:1763343035.297768:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9255 00000100:00100000:0.0:1763343035.297780:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56868:x1848997993536384:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.297811:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.297816:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343035.297854:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665c400/0x607405d401ae66c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac926a expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.297879:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343035.297893:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343035.297913:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae66fa lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac927f expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.298206:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6701 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.298222:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6701 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.298234:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6701 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.298248:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6708 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.298255:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6708 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.298262:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6708 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.302391:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae670f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.302418:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae670f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.302432:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae670f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343035.302445:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dc:0x0]: returning size 0 00010000:00010000:0.0:1763343035.302477:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6701 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.302484:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6701 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.302491:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6701 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.302497:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343035.302502:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6701 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.302510:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6701 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.302525:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4200) 00010000:00010000:0.0:1763343035.302528:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343035.302534:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6701 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.302545:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665cc00/0x607405d401ae6701 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343035.302562:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002af194f1 reply state 000000004c10447a transno 8589939912 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6708 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.302576:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6708 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.302582:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab500) 00010000:00010000:0.0:1763343035.302584:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343035.302588:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343035.302663:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665dc00/0x607405d401ae66fa lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac927f expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.302686:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae670f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac927f expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.302693:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34037c4b00) 00010000:00010000:0.0:1763343035.302695:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343035.302698:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d800, rc 0) 00000100:00100000:0.0:1763343035.302815:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56868:x1848997993536384:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 5035us (5304us total) trans 8589939912 rc 0/0 00000100:00100000:0.0:1763343035.302825:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9255 00000100:00100000:1.0:1763343035.306154:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.306329:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993536640 00000100:00100000:0.0:1763343035.306343:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993536640 00000100:00100000:2.0:1763343035.307413:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9256 00000100:00100000:2.0:1763343035.307435:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56868:x1848997993536640:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.307469:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.307499:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17c00/0x607405d401ae671d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9286 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.307667:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6724 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.307686:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae670f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac927f expref: 252 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.307696:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6724 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.307737:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae670f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac927f expref: 252 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.307751:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae670f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac927f expref: 252 pid: 28422 timeout: 1328 lvb_type: 0 00000100:00100000:2.0:1763343035.307767:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010259584:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343035.307872:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726540 going to sleep for 11 seconds 00000100:00100000:2.0:1763343035.310986:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010259584:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343035.311030:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6724 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:1.0:1763343035.313425:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.313854:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993536768 00000100:00100000:0.0:1763343035.313867:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993536768 00010000:00010000:0.0:1763343035.313933:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae670f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac927f expref: 253 pid: 28422 timeout: 1328 lvb_type: 0 00000100:00100000:0.0:1763343035.313990:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3048 00000100:00100000:0.0:1763343035.314002:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:2430:x1848997993536768:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343035.314025:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343035.314034:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae670f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac927f expref: 253 pid: 28422 timeout: 1328 lvb_type: 0 00010000:00010000:0.0:1763343035.314048:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae670f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac927f expref: 253 pid: 28422 timeout: 1328 lvb_type: 0 00010000:00010000:0.0:1763343035.314078:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d800/0x607405d401ae670f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac927f expref: 253 pid: 28422 timeout: 1328 lvb_type: 0 00010000:00010000:0.0:1763343035.314097:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34037c4b00) 00010000:00010000:0.0:1763343035.314104:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6724 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.314116:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6724 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.314125:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6724 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.314167:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343035.314236:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:2430:x1848997993536768:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 235us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.314244:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3048 00000100:00100000:3.0:1763343035.315775:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:2.0:1763343035.315895:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6724 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.315908:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6724 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343035.315950:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dc:0x0]: returning size 0 00000004:00080000:2.0:1763343035.316168:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x29f:0x0], index 0: 0 00000004:00080000:2.0:1763343035.316173:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2a1:0x0], index 1: 0 00000004:00080000:2.0:1763343035.316177:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2a2:0x0], index 1: 0 00000004:00080000:2.0:1763343035.316182:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2a0:0x0], index 0: 0 00010000:00010000:2.0:1763343035.316328:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6724 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.316337:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6724 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.316344:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6724 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.316350:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3404a16600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.316355:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6724 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.316363:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6724 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.316381:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34037c4b00) 00010000:00010000:2.0:1763343035.316384:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343035.316389:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6724 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.316396:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a16600/0x607405d401ae6724 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.316461:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17c00/0x607405d401ae671d lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9286 expref: 252 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.316474:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34037c4b00) 00010000:00010000:2.0:1763343035.316476:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343035.316480:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17c00/0x607405d401ae671d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9286 expref: 252 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.316497:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3404a17c00, rc 0) 00000100:00100000:2.0:1763343035.316568:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56868:x1848997993536640:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 9140us (10428us total) trans 8589939913 rc 301/301 00000100:00100000:2.0:1763343035.316577:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9256 00000100:00100000:2.0:1763343035.316611:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993537024 00000100:00100000:2.0:1763343035.316666:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993537024 00000100:00100000:2.0:1763343035.316715:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9257 00000100:00100000:2.0:1763343035.316725:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56870:x1848997993537024:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.316746:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.316768:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17e00/0x607405d401ae6732 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac928d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.316876:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6739 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.316889:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6739 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.316899:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6739 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.316911:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6740 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.316929:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6740 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.316936:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6740 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317039:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ca00/0x607405d401ae6747 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317049:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ca00/0x607405d401ae6747 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317057:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ca00/0x607405d401ae6747 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317121:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6739 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317127:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6739 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317133:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6739 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317139:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6739 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317143:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.317147:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6739 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317152:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6739 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317160:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7b00) 00010000:00010000:2.0:1763343035.317162:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.317165:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6739 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317170:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6739 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317181:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6740 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317187:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6740 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317193:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6740 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317198:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.317201:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6740 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317206:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6740 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317213:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab500) 00010000:00010000:2.0:1763343035.317216:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.317219:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6740 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317224:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6740 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.317255:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404a17e00/0x607405d401ae6732 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac928d expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.317271:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ca00/0x607405d401ae6747 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac928d expref: 253 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.317279:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a3538bf7200) 00010000:00010000:2.0:1763343035.317281:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343035.317284:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352ca00, rc 0) 00000100:00100000:2.0:1763343035.317313:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56870:x1848997993537024:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 590us (1550us total) trans 8589939914 rc 0/0 00000100:00100000:2.0:1763343035.317320:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9257 00000100:00100000:1.0:1763343035.320310:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.320395:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993537280 00000100:00100000:0.0:1763343035.320409:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993537280 00000100:00100000:0.0:1763343035.320474:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3147 00000100:00100000:0.0:1763343035.320485:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56868:x1848997993537280:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343035.320866:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56868:x1848997993537280:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 381us (571us total) trans 8589939915 rc 0/0 00000100:00100000:0.0:1763343035.320874:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3147 00000100:00100000:1.0:1763343035.324539:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.324728:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.324996:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993537536 00000100:00100000:3.0:1763343035.325010:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993537536 00000100:00100000:1.0:1763343035.325406:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.325596:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3148 00000100:00100000:3.0:1763343035.325610:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56868:x1848997993537536:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343035.325963:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56868:x1848997993537536:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 354us (1436us total) trans 8589939916 rc 0/0 00000100:00100000:3.0:1763343035.325977:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3148 00000100:00100000:0.0:1763343035.328844:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993537664 00000100:00100000:0.0:1763343035.328869:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993537664 00000100:00100000:0.0:1763343035.329073:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993537792 00000100:00100000:0.0:1763343035.329077:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993537792 00000100:00100000:0.0:1763343035.329109:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6497 00000100:00100000:0.0:1763343035.329118:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2432:x1848997993537664:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.329141:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.329168:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae6755 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9294 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343035.329199:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343035.329225:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.329228:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.329239:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae6755 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9294 expref: 30 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343035.329258:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae6755 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9294 expref: 30 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343035.329284:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665dc00, rc 0) 00000100:00100000:0.0:1763343035.329358:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2432:x1848997993537664:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 241us (4630us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.329369:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6497 00000100:00100000:0.0:1763343035.329392:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6498 00000100:00100000:0.0:1763343035.329398:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2432:x1848997993537792:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.329406:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.329417:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae675c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac929b expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343035.329432:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343035.329444:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.329445:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.329449:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae675c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac929b expref: 15 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343035.329461:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae675c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac929b expref: 15 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343035.329470:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665cc00, rc 0) 00000100:00100000:0.0:1763343035.329489:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2432:x1848997993537792:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 91us (4085us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.329496:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6498 00000100:00100000:1.0:1763343035.331595:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.332550:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993538048 00000100:00100000:3.0:1763343035.332566:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993538048 00000100:00100000:3.0:1763343035.333254:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9258 00000100:00100000:3.0:1763343035.333281:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:55941:x1848997993538048:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343035.333311:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.333314:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343035.333351:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ca00/0x607405d401ae6747 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac928d expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.333373:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a3538bf7200) 00010000:00010000:3.0:1763343035.333385:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343035.333405:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6763 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac92a2 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.333543:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae676a lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.333559:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae676a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1dc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.333571:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae676a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1dc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343035.333587:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dc:0x0]: returning size 0 00010000:00010000:3.0:1763343035.333747:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6763 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1dc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92a2 expref: 257 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.333763:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae676a lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1dc:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92a2 expref: 256 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.333771:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:3.0:1763343035.333774:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1763343035.333776:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93600, rc 0) 00000100:00100000:3.0:1763343035.333869:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:55941:x1848997993538048:12345-192.168.204.21@tcp:101:bash.0 Request processed in 605us (2288us total) trans 8589939917 rc 0/0 00000100:00100000:3.0:1763343035.333877:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9258 00000100:00100000:3.0:1763343035.337676:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.337778:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993538176 00000100:00100000:1.0:1763343035.337793:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993538176 00000100:00100000:1.0:1763343035.337872:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9259 00000100:00100000:1.0:1763343035.337884:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56870:x1848997993538176:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.337911:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.337949:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6778 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac92a9 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.338026:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6778 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92a9 expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.338044:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6778 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92a9 expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.338067:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:1.0:1763343035.338071:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343035.338076:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:1.0:1763343035.339898:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56870:x1848997993538176:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2001us (2262us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.339913:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9259 00000100:00100000:1.0:1763343035.342290:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.342408:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993538304 00000100:00100000:3.0:1763343035.342422:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993538304 00000100:00100000:3.0:1763343035.342968:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9260 00000100:00100000:3.0:1763343035.342981:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:55941:x1848997993538304:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343035.343012:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.343040:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae677f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac92b0 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.343084:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6786 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.343102:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6786 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.343115:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6786 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.343277:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae677f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92b0 expref: 259 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.343299:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6786 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92b0 expref: 258 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.343310:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:3.0:1763343035.343314:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343035.343319:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92a00, rc 0) 00000100:00100000:3.0:1763343035.343403:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:55941:x1848997993538304:12345-192.168.204.21@tcp:101:bash.0 Request processed in 424us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.343411:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9260 00000100:00100000:0.0:1763343035.343836:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.344067:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993538560 00000100:00100000:2.0:1763343035.344076:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993538560 00000100:00100000:2.0:1763343035.344131:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3149 00000100:00100000:2.0:1763343035.344140:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56870:x1848997993538560:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343035.345342:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56870:x1848997993538560:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1195us (1499us total) trans 8589939918 rc 0/0 00000100:00100000:2.0:1763343035.345355:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3149 00000100:00100000:0.0:1763343035.349970:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.350186:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993538816 00000100:00100000:3.0:1763343035.350201:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993538816 00000100:00100000:2.0:1763343035.350416:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.350678:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993539072 00000100:00100000:3.0:1763343035.350682:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993539072 00000100:00100000:3.0:1763343035.350713:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9261 00000100:00100000:3.0:1763343035.350725:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56870:x1848997993538816:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.350757:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.350789:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae678d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac92b7 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.350889:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6794 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.350907:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6794 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.350932:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6794 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.350945:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae679b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.350953:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae679b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.350961:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae679b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351109:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae67a2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351123:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae67a2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351131:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae67a2 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351138:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae67a2 lrc: 3/0,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351144:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.351149:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae67a2 lrc: 3/0,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351157:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae67a2 lrc: 4/0,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351170:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:3.0:1763343035.351177:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae67a2 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351184:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae67a2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343035.351203:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dc:0x0]: returning size 0 00010000:00010000:3.0:1763343035.351318:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6794 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351327:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6794 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351333:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6794 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351340:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6794 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351345:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.351349:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6794 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351355:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6794 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351364:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8c00) 00010000:00010000:3.0:1763343035.351367:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.351370:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6794 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351376:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6794 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351386:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae679b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351392:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae679b lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351398:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae679b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351403:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.351406:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae679b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351416:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae679b lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351423:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab500) 00010000:00010000:3.0:1763343035.351426:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.351429:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae679b lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351435:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae679b lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351474:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae678d lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92b7 expref: 262 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.351485:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8c00) 00010000:00010000:3.0:1763343035.351488:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343035.351492:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae678d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92b7 expref: 262 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.351505:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343035.351584:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56870:x1848997993538816:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 861us (1629us total) trans 8589939919 rc 301/301 00000100:00100000:3.0:1763343035.351593:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9261 00000100:00100000:3.0:1763343035.351656:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9262 00000100:00100000:3.0:1763343035.351665:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:55941:x1848997993539072:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:3.0:1763343035.351697:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343035.351709:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae676a lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1dc:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92a2 expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.351725:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:3.0:1763343035.351728:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343035.351864:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae67b0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351877:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae67b0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351886:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae67b0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000001:00080000:3.0:1763343035.351950:0:10041:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939920 00000004:00010000:3.0:1763343035.351972:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002c1678e7 reply state 0000000048676644 transno 8589939921 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae67b0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351985:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae67b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.351992:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:3.0:1763343035.351995:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343035.351997:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343035.352053:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993539072:12345-192.168.204.21@tcp:36:bash.0 Request processed in 388us (1638us total) trans 8589939921 rc 0/0 00000100:00100000:3.0:1763343035.352061:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9262 00000020:00080000:3.0:1763343035.352066:0:10041:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343035.358597:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.358898:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.359220:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993539328 00000100:00100000:0.0:1763343035.359235:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993539328 00000100:00100000:0.0:1763343035.359403:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993539456 00000100:00100000:0.0:1763343035.359407:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993539456 00000100:00100000:0.0:1763343035.359444:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9263 00000100:00100000:0.0:1763343035.359456:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:55941:x1848997993539328:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343035.359485:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.359490:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343035.359528:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6778 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92a9 expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.359552:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:0.0:1763343035.359560:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343035.359578:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae67b7 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac92be expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.359671:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae67be lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.359687:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae67be lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.359698:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae67be lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:0.0:1763343035.359985:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1414, 88 off119568 00000004:00080000:0.0:1763343035.359994:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1229027372658ns, next at 1229609967587ns, rc = 0 00000040:00080000:0.0:1763343035.360020:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1415, 88 off119568 00000004:00080000:0.0:1763343035.360024:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1229027403379ns, next at 1229610036645ns, rc = 0 00000040:00080000:0.0:1763343035.360036:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1416, 88 off119656 00000004:00080000:0.0:1763343035.360039:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1229027418731ns, next at 1229610036645ns, rc = 0 00000040:00080000:0.0:1763343035.360048:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1415, 88 off119656 00000004:00080000:0.0:1763343035.360051:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1229027430227ns, next at 1229609967587ns, rc = 0 00000100:00100000:2.0:1763343035.360567:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9264 00000100:00100000:2.0:1763343035.360582:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56870:x1848997993539456:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.360601:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.360613:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae67c5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac92c5 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.360732:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae67cc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.360744:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae67be lrc: 2/0,1 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.360753:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae67cc lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.360773:0:28422:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae67be lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.360785:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae67cc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000001:00080000:2.0:1763343035.367751:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939922 is committed 00000004:00080000:2.0:1763343035.367775:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 933 committed 00000004:00080000:2.0:1763343035.367821:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 932 committed 00000100:00100000:0.0:1763343035.368207:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010259712:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343035.368300:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343035.368357:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763343035.368364:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340465ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010260096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343035.368385:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343035.368657:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6675 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.368672:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6675 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.368680:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6675 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.368687:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.368693:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6675 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.368702:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6675 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.368721:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab500) 00010000:00010000:3.0:1763343035.368724:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.368730:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6675 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.368735:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6675 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343035.368758:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6708 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.368763:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6708 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.368768:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6708 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.368773:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.368775:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6708 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.368781:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6708 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.368789:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab500) 00010000:00010000:3.0:1763343035.368792:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.368795:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6708 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.368800:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d200/0x607405d401ae6708 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.368820:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae67b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1dc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.368826:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae67b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1dc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.368832:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae67b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1dc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.368837:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.368839:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae67b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1dc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.368844:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae67b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1dc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.368853:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:3.0:1763343035.368855:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.368858:0:3643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae67cc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.368869:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae67b0 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1dc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.368874:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae67b0 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1dc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343035.368898:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010259968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343035.368951:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763343035.369023:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 931 committed 00000100:00100000:3.0:1763343035.369146:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343035.369153:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010259840:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343035.369176:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343035.369214:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010259712 00000100:00100000:3.0:1763343035.369223:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010259712 00000100:00100000:3.0:1763343035.370457:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010260096 00000100:00100000:3.0:1763343035.370468:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010260096 00000004:00080000:2.0:1763343035.370502:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 932 committed 00010000:00010000:2.0:1763343035.370667:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae67be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92be expref: 245 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.370683:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:2.0:1763343035.370686:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343035.370690:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae67cc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.370700:0:6523:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae67cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.370706:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae67cc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.370746:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665da00/0x607405d401ae67b7 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92be expref: 245 pid: 6523 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343035.370766:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae67be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92be expref: 244 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.370802:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340665d000, rc 0) 00000100:00100000:2.0:1763343035.370884:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:55941:x1848997993539328:12345-192.168.204.21@tcp:101:bash.0 Request processed in 11429us (12302us total) trans 8589939922 rc 0/0 00000100:00100000:2.0:1763343035.370895:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9263 00000100:00100000:1.0:1763343035.372785:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010259968 00000100:00100000:1.0:1763343035.372805:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010259968 00000100:00100000:1.0:1763343035.372878:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010259840 00000100:00100000:1.0:1763343035.372881:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010259840 00000100:00100000:1.0:1763343035.372907:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6499 00000100:00100000:1.0:1763343035.372916:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3660:x1848998010259712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343035.372964:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:669 count 1 00010000:00010000:1.0:1763343035.372996:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae67d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.373020:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae662f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9240 expref: 14 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.373028:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343035.373030:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343035.373034:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae67d3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.373073:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae662f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9240 expref: 14 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.373088:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae662f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9240 expref: 14 pid: 28994 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343035.373104:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010260736:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343035.373203:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe540 going to sleep for 11 seconds 00000100:00100000:1.0:1763343035.373241:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010260480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343035.373297:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343035.373337:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343035.373343:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010260352:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343035.373362:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343035.373387:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010260480 00000100:00100000:1.0:1763343035.373391:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010260480 00000100:00100000:1.0:1763343035.373416:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010260352 00000100:00100000:1.0:1763343035.373418:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010260352 00000100:00100000:1.0:1763343035.373436:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6500 00000100:00100000:1.0:1763343035.373443:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3660:x1848998010260096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343035.374668:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6501 00000100:00100000:0.0:1763343035.374693:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3658:x1848998010259968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343035.374949:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010259968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 268us (5997us total) trans 21474838882 rc 0/0 00000100:00100000:0.0:1763343035.374958:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6501 00000100:00100000:0.0:1763343035.374988:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6502 00000100:00100000:0.0:1763343035.374995:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3658:x1848998010259840:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343035.375012:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:670 count 1 00010000:00010000:0.0:1763343035.375035:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae67da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.375057:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae6587 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91fa expref: 14 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343035.375065:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.375068:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.375072:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae67da lrc: 4/0,1 mode: --/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.375112:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae6587 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91fa expref: 14 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343035.375125:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae6587 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91fa expref: 14 pid: 28995 timeout: 1329 lvb_type: 1 00000100:00100000:0.0:1763343035.375142:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010260864:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343035.375211:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3508539480 going to sleep for 11 seconds 00000100:00100000:0.0:1763343035.375297:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6503 00000100:00100000:0.0:1763343035.375306:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3658:x1848998010260480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343035.376696:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6504 00000100:00100000:3.0:1763343035.376713:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3658:x1848998010260352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343035.376746:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:672 count 1 00000100:00100000:2.0:1763343035.376765:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343035.376773:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae67e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.376792:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae658e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9201 expref: 29 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343035.376799:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.376800:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae67cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.376801:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.376805:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae67e1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.376813:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae67cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.376844:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae658e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9201 expref: 29 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343035.376855:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae658e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9201 expref: 29 pid: 28995 timeout: 1329 lvb_type: 1 00000004:00200000:2.0:1763343035.376871:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dc:0x0]: returning size 2 00000100:00100000:3.0:1763343035.376874:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010260992:192.168.204.21@tcp:104: 00000004:00200000:2.0:1763343035.376877:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343035.376902:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae67cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343035.376954:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a351277f300 going to sleep for 11 seconds 00010000:00010000:2.0:1763343035.376954:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae67c5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92c5 expref: 244 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343035.376976:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993539584 00010000:00010000:2.0:1763343035.376976:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae67cc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92c5 expref: 243 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343035.376985:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993539584 00010000:00010000:2.0:1763343035.376986:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:2.0:1763343035.376989:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763343035.376994:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c200, rc 0) 00000100:00100000:3.0:1763343035.377020:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6505 00000100:00100000:3.0:1763343035.377026:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:55941:x1848997993539584:12345-192.168.204.21@tcp:101:bash.0 00000100:00100000:2.0:1763343035.377029:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56870:x1848997993539456:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 16452us (18132us total) trans 0 rc 0/0 00010000:00010000:3.0:1763343035.377036:0:10294:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763343035.377037:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9264 00010000:00010000:3.0:1763343035.377053:0:10294:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae67e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac92cc expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343035.377074:0:10294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343035.377089:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.377091:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.377101:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae67e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92cc expref: 16 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.377118:0:10294:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae67e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92cc expref: 16 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.377129:0:10294:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403529600, rc 0) 00000100:00100000:3.0:1763343035.377151:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:55941:x1848997993539584:12345-192.168.204.21@tcp:101:bash.0 Request processed in 124us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.377157:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6505 00000100:00100000:0.0:1763343035.377806:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:3658:x1848998010260480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2496us (4504us total) trans 17179871584 rc 0/0 00000100:00100000:0.0:1763343035.377815:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6503 00000100:00100000:0.0:1763343035.377859:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010260608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343035.377893:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343035.377935:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343035.377942:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010260224:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343035.377962:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343035.377990:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010260608 00000100:00100000:0.0:1763343035.377996:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010260608 00000100:00100000:0.0:1763343035.378031:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010260224 00000100:00100000:0.0:1763343035.378034:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010260224 00000100:00100000:0.0:1763343035.378047:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6506 00000100:00100000:0.0:1763343035.378054:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3659:x1848998010260608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343035.378154:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2a2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343035.378158:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2a2:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343035.378161:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2a2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343035.378163:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2a2:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343035.378166:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2a2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343035.378195:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3659:x1848998010260608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 141us (302us total) trans 17179871585 rc 0/0 00000100:00100000:0.0:1763343035.378202:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6506 00000100:00100000:0.0:1763343035.378215:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6507 00000100:00100000:0.0:1763343035.378221:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3659:x1848998010260224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343035.378234:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:671 count 1 00010000:00010000:0.0:1763343035.378249:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae67ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.378265:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9232 expref: 29 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.378273:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343035.378275:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343035.378278:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae67ef lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.378304:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6621 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9232 expref: 29 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.378316:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6621 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9232 expref: 29 pid: 27833 timeout: 1329 lvb_type: 0 00000100:00100000:0.0:1763343035.378327:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1848998010261120:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343035.378372:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3508539300 going to sleep for 11 seconds 00000004:00080000:0.0:1763343035.378413:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052ac000/2, rc 0, transno 17179871585 00000100:00100000:0.0:1763343035.378420:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010260608:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343035.378509:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052af800/2, rc 0, transno 17179871584 00000100:00100000:0.0:1763343035.378515:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010260480:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343035.378533:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3403ad6680/2, rc 0, transno 21474838882 00000100:00100000:0.0:1763343035.378538:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010259968:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763343035.378800:0:27833:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2a0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343035.378804:0:27833:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2a0:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343035.378806:0:27833:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2a0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343035.378808:0:27833:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2a0:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343035.378810:0:27833:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2a0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343035.378862:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3660:x1848998010260096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5417us (10474us total) trans 21474838883 rc 0/0 00000100:00100000:1.0:1763343035.378869:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6500 00000004:00080000:0.0:1763343035.383793:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340465ea00/2, rc 0, transno 21474838883 00000100:00100000:0.0:1763343035.383814:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340465ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010260096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343035.384148:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010260736:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343035.384187:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae67d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343035.384343:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.384380:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.384392:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993539840 00000100:00100000:2.0:1763343035.384401:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993539840 00000100:00100000:1.0:1763343035.384404:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.384426:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993539712 00000100:00100000:1.0:1763343035.384429:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993539712 00010000:00010000:2.0:1763343035.384448:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae6587 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91fa expref: 17 pid: 28995 timeout: 1329 lvb_type: 1 00010000:00010000:1.0:1763343035.384448:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae662f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9240 expref: 17 pid: 28994 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343035.384482:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993539968 00000100:00100000:1.0:1763343035.384485:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993539968 00010000:00010000:1.0:1763343035.384499:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae658e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9201 expref: 30 pid: 28995 timeout: 1329 lvb_type: 1 00000100:00100000:2.0:1763343035.384553:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3049 00000100:00100000:2.0:1763343035.384565:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2432:x1848997993539712:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343035.384582:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343035.384588:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae662f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9240 expref: 17 pid: 28994 timeout: 1329 lvb_type: 0 00010000:00010000:2.0:1763343035.384601:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae662f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9240 expref: 17 pid: 28994 timeout: 1329 lvb_type: 0 00010000:00010000:2.0:1763343035.384655:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae662f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9240 expref: 17 pid: 28994 timeout: 1329 lvb_type: 0 00010000:00010000:2.0:1763343035.384674:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.384677:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.384683:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae67d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.384694:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae67d3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.384719:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343035.384781:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993539712:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 218us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343035.384790:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3049 00000100:00100000:2.0:1763343035.384811:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3050 00000100:00100000:2.0:1763343035.384818:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2432:x1848997993539840:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343035.384826:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343035.384831:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae6587 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91fa expref: 15 pid: 28995 timeout: 1329 lvb_type: 1 00010000:00010000:2.0:1763343035.384841:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae6587 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91fa expref: 15 pid: 28995 timeout: 1329 lvb_type: 1 00010000:00010000:2.0:1763343035.384854:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.384856:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.384859:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae67da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.384867:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae67da lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.384879:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343035.384897:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2432:x1848997993539840:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 80us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343035.384903:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3050 00010000:00010000:2.0:1763343035.384941:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae67d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343035.384945:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010260992:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343035.384950:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae67d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.384961:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae67d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.384963:0:28648:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae67e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.384976:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae67d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.385002:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343035.385020:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343035.385027:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae67d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.385036:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343035.385041:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae67d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.385051:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae67d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.385064:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae67d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.385071:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae67d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.385090:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343035.385092:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343035.385093:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343035.385827:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3051 00000100:00100000:3.0:1763343035.385839:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3502d61850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2432:x1848997993539968:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343035.385856:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343035.385863:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae658e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9201 expref: 30 pid: 28995 timeout: 1329 lvb_type: 1 00010000:00010000:0.0:1763343035.385866:0:28995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665c200/0x607405d401ae6587 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac91fa expref: 14 pid: 28995 timeout: 1329 lvb_type: 1 00000100:00100000:0.0:1763343035.385880:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010260864:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343035.385881:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae658e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9201 expref: 30 pid: 28995 timeout: 1329 lvb_type: 1 00010000:00010000:0.0:1763343035.385899:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae67da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.385901:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665ce00/0x607405d401ae658e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9201 expref: 30 pid: 28995 timeout: 1329 lvb_type: 1 00010000:00010000:0.0:1763343035.385908:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae67da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.385913:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.385915:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.385915:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae67da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.385930:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae67e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.385935:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae67da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.385939:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae67e1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.385943:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae67da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.385957:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343035.385958:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343035.385990:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3502d61850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2432:x1848997993539968:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 154us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.385997:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3051 00010000:00010000:3.0:1763343035.386055:0:28648:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae67e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.386062:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae67e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.386071:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae67e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.386088:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae67e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.386103:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763343035.386176:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3658:x1848998010259840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11180us (16997us total) trans 21474838885 rc 0/0 00000100:00100000:0.0:1763343035.386184:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6502 00000004:00080000:0.0:1763343035.386226:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3403ad4e00/2, rc 0, transno 21474838885 00000100:00100000:0.0:1763343035.386233:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010259840:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343035.386235:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3658:x1848998010260352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9528us (12872us total) trans 17179871586 rc 0/0 00000100:00100000:3.0:1763343035.386242:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6504 00000004:00080000:0.0:1763343035.386249:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052ad880/2, rc 0, transno 17179871586 00000100:00100000:0.0:1763343035.386253:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010260352:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763343035.386468:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343035.386474:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae67da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.386482:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665d800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343035.386485:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae67da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.386493:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae67da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.386503:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae67da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.386509:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665d800/0x607405d401ae67da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.386524:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343035.386527:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae67e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.386538:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343035.386541:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae67e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.386547:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae67e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.386554:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae67e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.386559:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae67e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.386570:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343035.386572:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343035.386573:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343035.386584:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343035.389182:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.389717:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3660:x1848998010259712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16795us (21411us total) trans 21474838884 rc 0/0 00000100:00100000:2.0:1763343035.389731:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6499 00000100:00100000:2.0:1763343035.391299:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993540096 00000100:00100000:2.0:1763343035.391317:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993540096 00000100:00100000:2.0:1763343035.391373:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6508 00000100:00100000:2.0:1763343035.391385:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:55941:x1848997993540096:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343035.391410:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.391441:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae67f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac92d3 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343035.391473:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343035.391674:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.391677:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.391691:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae67f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92d3 expref: 30 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.391714:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae67f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92d3 expref: 30 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.391731:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352dc00, rc 0) 00000100:00100000:2.0:1763343035.391810:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:55941:x1848997993540096:12345-192.168.204.21@tcp:101:bash.0 Request processed in 427us (2642us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343035.391818:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6508 00000004:00080000:2.0:1763343035.391910:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3403ad5880/2, rc 0, transno 21474838884 00000100:00100000:2.0:1763343035.391930:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010259712:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343035.392097:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.392220:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1848998010261120:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343035.392248:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae67ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343035.392323:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.393231:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993540352 00000100:00100000:2.0:1763343035.393241:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993540352 00000100:00100000:2.0:1763343035.393298:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3150 00000100:00100000:2.0:1763343035.393307:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+243:56870:x1848997993540352:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343035.393581:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56870:x1848997993540352:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 274us (2014us total) trans 8589939923 rc 0/0 00000100:00100000:2.0:1763343035.393589:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3150 00000100:00100000:1.0:1763343035.394099:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993540480 00000100:00100000:1.0:1763343035.394106:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993540480 00010000:00010000:1.0:1763343035.394140:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6621 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9232 expref: 30 pid: 27833 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343035.394179:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3052 00000100:00100000:1.0:1763343035.394187:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2430:x1848997993540480:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343035.394201:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343035.394207:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6621 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9232 expref: 30 pid: 27833 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.394220:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6621 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9232 expref: 30 pid: 27833 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.394246:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6621 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9232 expref: 30 pid: 27833 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.394262:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343035.394264:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343035.394270:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae67ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.394281:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae67ef lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.394318:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343035.394365:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2430:x1848997993540480:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 177us (2041us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.394372:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3052 00010000:00010000:2.0:1763343035.394806:0:8410:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae67ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.394818:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae67ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.394829:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae67ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.394838:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae67ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.394864:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343035.395218:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343035.395227:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae67ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.395237:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340665c400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343035.395241:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae67ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.395250:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae67ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.395266:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae67ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.395274:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665c400/0x607405d401ae67ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.395298:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343035.395300:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343035.395302:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343035.396762:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3659:x1848998010260224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18522us (18780us total) trans 17179871587 rc 0/0 00000100:00100000:2.0:1763343035.396784:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6507 00000004:00080000:0.0:1763343035.397024:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052adc00/2, rc 0, transno 17179871587 00000100:00100000:0.0:1763343035.397033:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010260224:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343035.398801:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.398844:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.399148:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993540608 00000100:00100000:0.0:1763343035.399162:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993540608 00002000:00010000:0.0:1763343035.399221:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/671 (0->18446744073709551615) 00002000:00100000:0.0:1763343035.399227:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c70e00 with x1848997993540608 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343035.399242:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537c70e00. 00000100:00100000:0.0:1763343035.399277:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993540736 00000100:00100000:0.0:1763343035.399281:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993540736 00002000:00010000:0.0:1763343035.399297:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/673 (0->18446744073709551615) 00002000:00100000:0.0:1763343035.399300:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c71180 with x1848997993540736 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343035.399307:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537c71180. 00000100:00100000:0.0:1763343035.399339:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1590 00000100:00100000:0.0:1763343035.399350:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993540608:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:2.0:1763343035.399358:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1591 00000100:00100000:2.0:1763343035.399367:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2429:x1848997993540736:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343035.399578:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2a1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343035.399578:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x29f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343035.399583:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2a1:0x0] updating lvb mtime from disk: 0 -> 1763343035 00002000:00010000:0.0:1763343035.399583:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x29f:0x0] updating lvb mtime from disk: 0 -> 1763343035 00002000:00010000:2.0:1763343035.399586:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2a1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343035.399586:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x29f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343035.399589:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2a1:0x0] updating lvb ctime from disk: 0 -> 1763343035 00002000:00010000:0.0:1763343035.399589:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x29f:0x0] updating lvb ctime from disk: 0 -> 1763343035 00002000:00010000:2.0:1763343035.399592:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2a1:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763343035.399592:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x29f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343035.399681:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2429:x1848997993540736:12345-192.168.204.21@tcp:10:bash.0 Request processed in 314us (834us total) trans 17179871588 rc 0/0 00000100:00100000:2.0:1763343035.399689:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1591 00002000:00010000:2.0:1763343035.399694:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/673 (0->18446744073709551615) 00002000:00100000:2.0:1763343035.399697:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c71180 with x1848997993540736 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343035.399701:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537c71180. 00000100:00100000:0.0:1763343035.402640:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993540608:12345-192.168.204.21@tcp:10:bash.0 Request processed in 3252us (3814us total) trans 21474838886 rc 0/0 00000100:00100000:0.0:1763343035.402659:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1590 00002000:00010000:0.0:1763343035.402668:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/671 (0->18446744073709551615) 00002000:00100000:0.0:1763343035.402672:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c70e00 with x1848997993540608 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343035.402686:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537c70e00. 00000100:00100000:2.0:1763343035.402805:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.403651:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993540992 00000100:00100000:3.0:1763343035.403668:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993540992 00000100:00100000:3.0:1763343035.403741:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9265 00000100:00100000:3.0:1763343035.403752:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56870:x1848997993540992:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.403784:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.403812:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae67fd lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac92da expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.403928:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae6804 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.403946:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae6804 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.403960:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae6804 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.403976:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae680b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.403983:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae680b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.403989:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae680b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404145:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6812 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404155:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6812 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404162:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6812 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343035.404174:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dc:0x0]: returning size 2 00010000:00010000:3.0:1763343035.404353:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae6804 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404362:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae6804 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404370:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae6804 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404376:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.404382:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae6804 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404390:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae6804 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404406:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8800) 00010000:00010000:3.0:1763343035.404409:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.404415:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae6804 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404421:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae6804 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404441:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae680b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404447:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae680b lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404452:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae680b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404456:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403528e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.404459:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae680b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404464:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae680b lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404471:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8300) 00010000:00010000:3.0:1763343035.404473:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.404475:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae680b lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404480:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae680b lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.404534:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae67fd lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92da expref: 247 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.404550:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6812 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92da expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.404557:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:3.0:1763343035.404561:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343035.404563:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403529800, rc 0) 00000100:00100000:3.0:1763343035.404670:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56870:x1848997993540992:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 917us (1863us total) trans 8589939924 rc 0/0 00000100:00100000:3.0:1763343035.404678:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9265 00000100:00100000:2.0:1763343035.410741:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.410805:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993541248 00000100:00100000:3.0:1763343035.410820:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993541248 00000100:00100000:2.0:1763343035.410859:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.412657:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993541376 00000100:00100000:0.0:1763343035.412675:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993541376 00000100:00100000:0.0:1763343035.412732:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3151 00000100:00100000:0.0:1763343035.412742:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:55941:x1848997993541248:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343035.413162:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:55941:x1848997993541248:12345-192.168.204.21@tcp:35:bash.0 Request processed in 419us (2438us total) trans 8589939925 rc 0/0 00000100:00100000:0.0:1763343035.413170:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3151 00000100:00100000:0.0:1763343035.413191:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3152 00000100:00100000:0.0:1763343035.413198:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56870:x1848997993541376:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:0.0:1763343035.413278:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56870:x1848997993541376:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 80us (2418us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.413284:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3152 00000100:00100000:0.0:1763343035.419099:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.419199:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993541632 00000100:00100000:3.0:1763343035.419215:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993541632 00000100:00100000:3.0:1763343035.419288:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9266 00000100:00100000:3.0:1763343035.419299:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56870:x1848997993541632:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.419328:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.419358:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6820 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac92e1 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.419505:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6827 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.419524:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6827 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.419536:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6827 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343035.419551:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dc:0x0]: returning size 5 00010000:00010000:3.0:1763343035.419742:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6820 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92e1 expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.419766:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6827 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92e1 expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.419782:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:3.0:1763343035.419786:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343035.419790:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343035.419864:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56870:x1848997993541632:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 567us (782us total) trans 8589939926 rc 0/0 00000100:00100000:3.0:1763343035.419873:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9266 00000100:00100000:2.0:1763343035.425802:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.426223:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993541888 00000100:00100000:0.0:1763343035.426240:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993541888 00000100:00100000:0.0:1763343035.426321:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9267 00000100:00100000:0.0:1763343035.426333:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56871:x1848997993541888:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:0.0:1763343035.426416:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1763343035.426456:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340665d000/0x607405d401ae67be lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92be expref: 249 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343035.426641:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.426706:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993542144 00010000:00010000:0.0:1763343035.426708:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6812 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92da expref: 248 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343035.426711:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993542144 00010000:00010000:0.0:1763343035.426726:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae67cc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92c5 expref: 248 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.426740:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6786 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1dc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92b0 expref: 247 pid: 10041 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343035.426755:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3153 00000100:00100000:2.0:1763343035.426764:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56870:x1848997993542144:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:2.0:1763343035.426816:0:14879:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1dc:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6827 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92e1 expref: 247 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.426841:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:0.0:1763343035.426847:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343035.426857:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c000/0x607405d401ae6835 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343035.426872:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c000/0x607405d401ae6835 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343035.426882:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c000/0x607405d401ae6835 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00000004:00020000:2.0:1763343035.427074:0:14879:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0000-mdtlov: can not set all stale mirrors for [0x200000405:0x1dc:0x0]: rc = -1 00010000:00010000:2.0:1763343035.427102:0:14879:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c000/0x607405d401ae6835 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343035.427109:0:14879:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c000/0x607405d401ae6835 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343035.427115:0:14879:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c000/0x607405d401ae6835 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343035.427121:0:14879:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.427125:0:14879:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c000/0x607405d401ae6835 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343035.427134:0:14879:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c000/0x607405d401ae6835 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343035.427142:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:2.0:1763343035.427144:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763343035.427148:0:14879:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c000/0x607405d401ae6835 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343035.427153:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c000/0x607405d401ae6835 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343035.427163:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a34039e8500) 00010000:00010000:2.0:1763343035.427165:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343035.427169:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6827 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92e1 expref: 246 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343035.427348:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56870:x1848997993542144:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 584us (729us total) trans 8589939927 rc -1/-1 00000100:00100000:2.0:1763343035.427355:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3153 00010000:00010000:1.0:1763343035.427742:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae683c lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.427752:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae683c lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.427761:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae683c lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.427821:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6843 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.427829:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6843 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.427836:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6843 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.427933:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae684a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.427941:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae684a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.428850:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae684a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00080000:1.0:1763343035.429156:0:6523:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1dc:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1763343035.429251:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae684a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429259:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae684a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429265:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae684a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429275:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.429280:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae684a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429288:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae684a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429300:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a3403aab200) 00010000:00010000:1.0:1763343035.429303:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343035.429308:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae684a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429314:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae684a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429341:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae683c lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429347:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae683c lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429352:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae683c lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429357:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae683c lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429362:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.429365:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae683c lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429371:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae683c lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429384:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aabc00) 00010000:00010000:1.0:1763343035.429387:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.429391:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae683c lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429397:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae683c lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:1.0:1763343035.429411:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000405d2e3e reply state 00000000df975cec transno 8589939928 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6843 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429424:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6843 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.429429:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab000) 00010000:00010000:1.0:1763343035.429432:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343035.429435:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343035.429539:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56871:x1848997993541888:12345-192.168.204.21@tcp:36:rm.0 Request processed in 3203us (3747us total) trans 8589939928 rc 0/0 00000100:00100000:1.0:1763343035.429548:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9267 00000100:00100000:1.0:1763343035.435046:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.438374:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993542272 00000100:00100000:2.0:1763343035.438398:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993542272 00000100:00100000:2.0:1763343035.438495:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9268 00000100:00100000:2.0:1763343035.438507:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56870:x1848997993542272:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.438537:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.438567:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c000/0x607405d401ae6851 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac92e8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.438667:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c000/0x607405d401ae6851 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92e8 expref: 248 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.438687:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c000/0x607405d401ae6851 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1dc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92e8 expref: 248 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.438711:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a3538bf7200) 00010000:00010000:2.0:1763343035.438715:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343035.438719:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c000, rc 0) 00000100:00100000:2.0:1763343035.438818:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56870:x1848997993542272:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 312us (3786us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343035.438830:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9268 00000100:00100000:2.0:1763343035.444211:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.445640:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993542528 00000100:00100000:0.0:1763343035.445659:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993542528 00000100:00100000:0.0:1763343035.446900:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3154 00000100:00100000:0.0:1763343035.446934:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56870:x1848997993542528:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:0.0:1763343035.447271:0:14879:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1dc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343035.447365:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1416, 64 off119720 00000040:00080000:0.0:1763343035.447391:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1417, 64 off119720 00000040:00080000:0.0:1763343035.447401:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1418, 64 off119784 00000040:00080000:0.0:1763343035.447410:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1417, 64 off119784 00000100:00100000:1.0:1763343035.448193:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.448359:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993542656 00000100:00100000:3.0:1763343035.448371:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993542656 00000100:00100000:3.0:1763343035.448435:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9269 00000100:00100000:3.0:1763343035.448444:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56872:x1848997993542656:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.448466:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.448487:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae685f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac92ef expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.448561:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6866 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448578:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6866 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448590:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6866 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448602:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae686d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448610:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae686d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448648:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae686d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448686:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6866 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448694:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6866 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448701:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6866 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448708:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.448713:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6866 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448722:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6866 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448736:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8800) 00010000:00010000:3.0:1763343035.448741:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.448746:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6866 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448752:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6866 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448764:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae686d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448770:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae686d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448776:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae686d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448782:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.448785:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae686d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448791:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae686d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448798:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab000) 00010000:00010000:3.0:1763343035.448800:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.448803:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae686d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448808:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae686d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.448837:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae685f lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92ef expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.448849:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8800) 00010000:00010000:3.0:1763343035.448852:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.448855:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae685f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92ef expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.448869:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93600, rc 0) 00000100:00100000:3.0:1763343035.448961:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56872:x1848997993542656:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 516us (773us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343035.448970:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9269 00010000:00010000:0.0:1763343035.449606:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6858 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343035.449640:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6858 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343035.449652:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6858 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343035.449662:0:14879:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6858 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343035.449668:0:14879:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6858 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343035.449673:0:14879:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6858 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343035.449697:0:14879:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343035.449961:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56870:x1848997993542528:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 3044us (5763us total) trans 8589939929 rc 0/0 00000100:00100000:0.0:1763343035.449980:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3154 00010000:00010000:2.0:1763343035.450054:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343035.450062:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6858 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343035.450069:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343035.450073:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6858 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343035.450079:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6858 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343035.450090:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dc:0x0].0x0 (ffff9a3538bf7200) 00010000:00010000:2.0:1763343035.450094:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343035.450098:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6858 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343035.450105:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6858 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1dc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343035.450117:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343035.450119:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343035.450121:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343035.452819:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.453450:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993542784 00000100:00100000:2.0:1763343035.453466:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993542784 00000100:00100000:2.0:1763343035.453587:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9270 00000100:00100000:2.0:1763343035.453600:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56872:x1848997993542784:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.453754:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.453788:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6874 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac92f6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.453874:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae687b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.453891:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae687b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.453903:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae687b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.453913:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6882 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.453934:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6882 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.453941:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6882 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.453998:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae687b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.454005:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae687b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.454011:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae687b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.454018:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae687b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.454024:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.454029:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae687b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.454043:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae687b lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.454056:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7700) 00010000:00010000:2.0:1763343035.454059:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.454065:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae687b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.454073:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae687b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.454089:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6882 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.454095:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6882 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.454101:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6882 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.454106:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.454109:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6882 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.454116:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6882 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.454122:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab000) 00010000:00010000:2.0:1763343035.454125:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.454127:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6882 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.454134:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6882 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.454164:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6874 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92f6 expref: 250 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.454175:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7700) 00010000:00010000:2.0:1763343035.454178:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.454181:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6874 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92f6 expref: 250 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.454195:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352da00, rc 0) 00000100:00100000:2.0:1763343035.454331:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56872:x1848997993542784:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 732us (1527us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343035.454339:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9270 00000100:00100000:1.0:1763343035.459287:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.463112:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993542912 00000100:00100000:2.0:1763343035.463133:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993542912 00000100:00100000:2.0:1763343035.463232:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9271 00000100:00100000:2.0:1763343035.463244:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56872:x1848997993542912:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.463277:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.463311:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6889 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac92fd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.463396:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6890 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.463413:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6890 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.463427:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6890 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343035.463500:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343035.463507:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343035.463555:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6889 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92fd expref: 251 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.463582:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6890 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92fd expref: 250 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.463593:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7500) 00010000:00010000:2.0:1763343035.463597:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343035.463600:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d200, rc 0) 00000100:00100000:2.0:1763343035.463714:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56872:x1848997993542912:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 472us (4451us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343035.463723:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9271 00000100:00100000:1.0:1763343035.468194:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.468305:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993543040 00000100:00100000:3.0:1763343035.468320:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993543040 00000100:00100000:3.0:1763343035.468480:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9272 00000100:00100000:3.0:1763343035.468493:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56872:x1848997993543040:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.468522:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.468553:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6897 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9304 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.468810:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae689e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.468828:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae689e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.468841:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae689e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.468853:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae68a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.468860:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae68a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.468867:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae68a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.468928:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae689e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.468937:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae689e lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.468944:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae689e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.468951:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.468958:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae689e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.468967:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae689e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.468982:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7500) 00010000:00010000:3.0:1763343035.468986:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.468992:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae689e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.468999:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae689e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.469012:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae68a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.469017:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae68a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.469022:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae68a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.469027:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.469030:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae68a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.469036:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae68a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.469043:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab000) 00010000:00010000:3.0:1763343035.469046:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.469049:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae68a5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.469060:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae68a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.469089:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6897 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9304 expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.469101:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7500) 00010000:00010000:3.0:1763343035.469103:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.469107:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6897 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9304 expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.469118:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93600, rc 0) 00000100:00100000:3.0:1763343035.470024:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56872:x1848997993543040:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1523us (1837us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343035.470036:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9272 00000100:00100000:0.0:1763343035.477201:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.477341:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993543296 00000100:00100000:2.0:1763343035.477354:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993543296 00000100:00100000:2.0:1763343035.477432:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9273 00000100:00100000:2.0:1763343035.477444:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56872:x1848997993543296:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.477472:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.477476:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343035.477511:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6890 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92fd expref: 250 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.477533:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7500) 00010000:00010000:2.0:1763343035.477544:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343035.477564:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae68ac lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac930b expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.478877:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68b3 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.478902:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68b3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.478927:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68b3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.478940:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae68ba lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.478949:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae68ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.478956:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae68ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.479470:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae68c1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.479482:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae68c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.479489:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae68c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343035.479501:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dd:0x0]: returning size 0 00010000:00010000:2.0:1763343035.479532:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68b3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.479540:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68b3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.479551:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68b3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.479557:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.479562:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68b3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.479571:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68b3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.479583:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7700) 00010000:00010000:2.0:1763343035.479587:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.479593:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68b3 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.479599:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68b3 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:2.0:1763343035.479615:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c76fe38b reply state 000000009b61a5a4 transno 8589939930 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae68ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.479671:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae68ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.479678:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab000) 00010000:00010000:2.0:1763343035.479681:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343035.479684:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343035.479726:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae68ac lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac930b expref: 252 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.479749:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae68c1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac930b expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.479762:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a3538bf7900) 00010000:00010000:2.0:1763343035.479765:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343035.479769:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352cc00, rc 0) 00000100:00100000:2.0:1763343035.479876:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56872:x1848997993543296:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2433us (2688us total) trans 8589939930 rc 0/0 00000100:00100000:2.0:1763343035.479887:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9273 00000100:00100000:1.0:1763343035.498723:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.498863:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993543552 00000100:00100000:2.0:1763343035.498876:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993543552 00000100:00100000:2.0:1763343035.498972:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9274 00000100:00100000:2.0:1763343035.498983:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56872:x1848997993543552:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.499016:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.499044:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae68cf lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9312 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.499189:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68d6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.499206:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae68c1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac930b expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.499216:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68d6 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.499254:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae68c1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac930b expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.499339:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae68c1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac930b expref: 253 pid: 28422 timeout: 1329 lvb_type: 0 00000100:00100000:2.0:1763343035.499359:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010261248:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343035.499458:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726d80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343035.506325:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.506412:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.506678:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993543936 00000100:00100000:0.0:1763343035.506691:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993543936 00010000:00010000:0.0:1763343035.506740:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae68c1 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac930b expref: 254 pid: 28422 timeout: 1329 lvb_type: 0 00000100:00100000:0.0:1763343035.506779:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3053 00000100:00100000:0.0:1763343035.506789:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:2430:x1848997993543936:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343035.506808:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343035.506815:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae68c1 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac930b expref: 254 pid: 28422 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.506830:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae68c1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac930b expref: 254 pid: 28422 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.506858:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a3538bf7900) 00010000:00010000:0.0:1763343035.506863:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68d6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.506873:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68d6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.506881:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68d6 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.506903:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343035.506982:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:2430:x1848997993543936:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 193us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.506991:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3053 00010000:00010000:0.0:1763343035.507054:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae68c1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac930b expref: 253 pid: 28422 timeout: 1329 lvb_type: 0 00000100:00100000:0.0:1763343035.507072:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010261248:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343035.507099:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68d6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.507108:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68d6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.507114:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68d6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343035.507142:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dd:0x0]: returning size 0 00000004:00080000:0.0:1763343035.507383:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2a3:0x0], index 1: 0 00000004:00080000:0.0:1763343035.507391:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2a1:0x0], index 0: 0 00000004:00080000:0.0:1763343035.507396:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2a2:0x0], index 0: 0 00000004:00080000:0.0:1763343035.507401:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2a4:0x0], index 1: 0 00010000:00010000:0.0:1763343035.507544:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68d6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.507553:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68d6 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.507561:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68d6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.507567:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343035.507572:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68d6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.507581:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68d6 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.507590:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a3538bf7900) 00010000:00010000:0.0:1763343035.507596:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343035.507600:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68d6 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.507605:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae68d6 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.507708:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae68cf lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9312 expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.507718:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a3538bf7900) 00010000:00010000:0.0:1763343035.507721:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343035.507724:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae68cf lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9312 expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.507742:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c600, rc 0) 00000100:00100000:0.0:1763343035.507784:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56872:x1848997993543552:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8802us (9077us total) trans 8589939931 rc 301/301 00000100:00100000:0.0:1763343035.507791:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9274 00000100:00100000:0.0:1763343035.507814:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993543808 00000100:00100000:0.0:1763343035.507820:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993543808 00000100:00100000:0.0:1763343035.507848:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9275 00000100:00100000:0.0:1763343035.507855:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56874:x1848997993543808:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.507873:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.507895:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae68e4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9319 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.507985:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae68eb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.507996:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae68eb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.508005:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae68eb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.508065:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae68e4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9319 expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.508083:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae68eb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9319 expref: 254 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.508091:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:0.0:1763343035.508094:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343035.508096:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480e00, rc 0) 00000100:00100000:0.0:1763343035.508117:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56874:x1848997993543808:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 263us (1807us total) trans 8589939932 rc 0/0 00000100:00100000:0.0:1763343035.508124:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9275 00000100:00100000:1.0:1763343035.519561:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.519614:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.519676:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.520063:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993544320 00000100:00100000:0.0:1763343035.520077:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993544320 00000100:00100000:0.0:1763343035.520159:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3155 00000100:00100000:0.0:1763343035.520172:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56872:x1848997993544320:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343035.520563:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56872:x1848997993544320:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 392us (946us total) trans 8589939933 rc 0/0 00000100:00100000:0.0:1763343035.520577:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3155 00000100:00100000:3.0:1763343035.520909:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993544064 00000100:00100000:3.0:1763343035.520925:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993544064 00000100:00100000:3.0:1763343035.520961:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993544448 00000100:00100000:3.0:1763343035.520964:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993544448 00000100:00100000:3.0:1763343035.520995:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6509 00000100:00100000:3.0:1763343035.521004:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993544064:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.521020:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.521048:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae68f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9320 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343035.521076:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343035.521099:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.521102:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.521112:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae68f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9320 expref: 16 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343035.521132:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae68f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9320 expref: 16 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343035.521146:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93600, rc 0) 00000100:00100000:3.0:1763343035.521176:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993544064:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 172us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.521182:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6509 00000100:00100000:3.0:1763343035.521197:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6510 00000100:00100000:3.0:1763343035.521203:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2430:x1848997993544448:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.521212:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.521224:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6900 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9327 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343035.521239:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343035.521248:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.521250:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.521254:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6900 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9327 expref: 31 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343035.521265:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6900 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9327 expref: 31 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343035.521278:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343035.521295:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993544448:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 92us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.521300:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6510 00000100:00100000:2.0:1763343035.526365:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.527338:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993544704 00000100:00100000:1.0:1763343035.527354:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993544704 00000100:00100000:1.0:1763343035.527426:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3156 00000100:00100000:1.0:1763343035.527436:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56872:x1848997993544704:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343035.527747:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56872:x1848997993544704:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 310us (1397us total) trans 8589939934 rc 0/0 00000100:00100000:1.0:1763343035.527756:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3156 00000100:00100000:3.0:1763343035.528004:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.528211:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993544960 00000100:00100000:0.0:1763343035.528217:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993544960 00000100:00100000:0.0:1763343035.528255:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3157 00000100:00100000:0.0:1763343035.528263:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56874:x1848997993544960:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343035.528367:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56874:x1848997993544960:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 104us (364us total) trans 8589939935 rc 0/0 00000100:00100000:0.0:1763343035.528373:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3157 00000100:00100000:3.0:1763343035.533148:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.533755:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993545216 00000100:00100000:0.0:1763343035.533771:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993545216 00000100:00100000:0.0:1763343035.533926:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9276 00000100:00100000:0.0:1763343035.533938:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:55941:x1848997993545216:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343035.533970:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.534001:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6907 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac932e expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.534196:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae690e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534214:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae690e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534229:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae690e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534242:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae6915 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534250:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae6915 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534257:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae6915 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534590:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae691c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534600:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae691c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534608:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae691c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343035.534670:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dd:0x0]: returning size 0 00010000:00010000:0.0:1763343035.534787:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae690e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534795:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae690e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534801:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae690e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534807:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae690e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534813:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343035.534818:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae690e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534827:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae690e lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534841:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2a00) 00010000:00010000:0.0:1763343035.534844:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343035.534851:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae690e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534858:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae690e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534873:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae6915 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534879:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae6915 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534883:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae6915 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534889:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343035.534891:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae6915 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534896:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae6915 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534903:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab000) 00010000:00010000:0.0:1763343035.534905:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343035.534908:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae6915 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534923:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae6915 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.534976:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6907 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac932e expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.535002:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae691c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac932e expref: 259 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.535011:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:0.0:1763343035.535014:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343035.535016:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137800, rc 0) 00000100:00100000:0.0:1763343035.535897:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:55941:x1848997993545216:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1954us (2758us total) trans 8589939936 rc 0/0 00000100:00100000:0.0:1763343035.535908:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9276 00000100:00100000:2.0:1763343035.544690:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.545121:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.545352:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.545447:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993545472 00000100:00100000:1.0:1763343035.545463:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993545472 00000100:00100000:1.0:1763343035.545538:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993545600 00000100:00100000:1.0:1763343035.545542:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993545600 00000100:00100000:1.0:1763343035.545579:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9277 00000100:00100000:1.0:1763343035.545591:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56874:x1848997993545472:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.545652:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.545684:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae692a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9335 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.545835:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6931 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.545853:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6931 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.545869:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6931 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343035.545883:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dd:0x0]: returning size 0 00010000:00010000:1.0:1763343035.546051:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae692a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9335 expref: 263 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.546074:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6931 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9335 expref: 262 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.546085:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:1.0:1763343035.546088:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763343035.546093:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:1.0:1763343035.546172:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56874:x1848997993545472:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 583us (1496us total) trans 8589939937 rc 0/0 00000100:00100000:1.0:1763343035.546181:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9277 00000100:00100000:1.0:1763343035.546210:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9278 00000100:00100000:1.0:1763343035.546218:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:55941:x1848997993545600:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343035.546226:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.546235:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae693f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac933c expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.546255:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6946 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.546279:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6946 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.546287:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6946 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343035.546383:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae693f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac933c expref: 263 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.546396:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6946 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac933c expref: 262 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.546403:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:1.0:1763343035.546406:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343035.546409:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343035.546431:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993545600:12345-192.168.204.21@tcp:101:bash.0 Request processed in 214us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.546437:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9278 00000100:00100000:3.0:1763343035.546794:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993545728 00000100:00100000:3.0:1763343035.546802:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993545728 00000100:00100000:3.0:1763343035.546853:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 409 00000100:00100000:3.0:1763343035.546863:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:2432:x1848997993545728:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343035.546873:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343035.546889:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae691c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac932e expref: 262 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.546900:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:3.0:1763343035.546904:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343035.546942:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:2432:x1848997993545728:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 81us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.546948:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 409 00000100:00100000:1.0:1763343035.552773:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.552830:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.553371:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993545856 00000100:00100000:0.0:1763343035.553386:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993545856 00000100:00100000:0.0:1763343035.553465:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3158 00000100:00100000:0.0:1763343035.553477:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56874:x1848997993545856:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:0.0:1763343035.554121:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56874:x1848997993545856:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 643us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343035.554608:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993546112 00000100:00100000:2.0:1763343035.554647:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993546112 00000100:00100000:2.0:1763343035.554707:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9279 00000100:00100000:2.0:1763343035.554717:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993546112:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:2.0:1763343035.554764:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343035.554799:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae68eb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9319 expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.554820:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:2.0:1763343035.554827:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343035.555060:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae694d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.555077:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae694d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.555089:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae694d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000001:00080000:2.0:1763343035.555145:0:6523:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939938 00000004:00010000:2.0:1763343035.555168:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fcae4216 reply state 00000000145b95b2 transno 8589939939 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae694d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.555183:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae694d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.555190:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:2.0:1763343035.555194:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343035.555197:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343035.555287:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993546112:12345-192.168.204.21@tcp:36:bash.0 Request processed in 571us (2456us total) trans 8589939939 rc 0/0 00000100:00100000:2.0:1763343035.555294:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9279 00000020:00080000:2.0:1763343035.555300:0:6523:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343035.555923:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3158 00000100:00100000:1.0:1763343035.567363:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.567722:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993546368 00000100:00100000:2.0:1763343035.567737:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993546368 00000100:00100000:2.0:1763343035.567814:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3159 00000100:00100000:2.0:1763343035.567826:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fb8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:55941:x1848997993546368:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:2.0:1763343035.568140:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fb8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993546368:12345-192.168.204.21@tcp:35:bash.0 Request processed in 316us (792us total) trans 8589939940 rc 0/0 00000100:00100000:2.0:1763343035.568149:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3159 00000100:00100000:1.0:1763343035.571417:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.572339:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993546880 00000100:00100000:0.0:1763343035.572353:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993546880 00000100:00100000:3.0:1763343035.573153:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.573864:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993546752 00000100:00100000:2.0:1763343035.573875:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993546752 00000100:00100000:2.0:1763343035.573950:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9280 00000100:00100000:2.0:1763343035.573962:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993546880:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343035.573994:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.573998:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343035.574037:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6931 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9335 expref: 265 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.574065:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:2.0:1763343035.574072:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343035.574090:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae6954 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac934a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.574163:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae695b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.574180:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae695b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.574190:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae695b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:1.0:1763343035.574374:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9281 00000100:00100000:1.0:1763343035.574386:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56875:x1848997993546752:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.574395:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.574410:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6962 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9343 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.574649:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6969 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.574659:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6969 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.574667:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6969 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.574679:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6970 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.574686:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6970 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.574692:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6970 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.574811:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6977 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.574819:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6977 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.574826:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6977 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343035.574837:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dd:0x0]: returning size 0 00010000:00010000:1.0:1763343035.574949:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6977 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.574958:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6977 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.574964:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6977 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.574970:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.574974:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6977 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.574982:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6977 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.574992:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:1.0:1763343035.574995:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1763343035.574999:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6977 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575005:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6977 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575026:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6969 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575031:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6969 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575036:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6969 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575041:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6969 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575046:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.575049:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6969 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575054:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6969 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575061:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aabc00) 00010000:00010000:1.0:1763343035.575063:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.575066:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6969 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575071:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6969 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575082:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6970 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575088:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6970 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575093:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6970 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575101:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.575103:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6970 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575109:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6970 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575115:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab000) 00010000:00010000:1.0:1763343035.575118:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.575120:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6970 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575126:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6970 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343035.575163:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6962 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9343 expref: 267 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.575172:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aabc00) 00010000:00010000:1.0:1763343035.575174:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343035.575177:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6962 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9343 expref: 267 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.575192:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00000040:00080000:2.0:1763343035.575846:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1419, 88 off119872 00000004:00080000:2.0:1763343035.575855:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1229243233911ns, next at 1229610036645ns, rc = 0 00000040:00080000:2.0:1763343035.575928:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1418, 88 off119872 00000004:00080000:2.0:1763343035.575934:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1229243312938ns, next at 1229609967587ns, rc = 0 00000040:00080000:2.0:1763343035.575968:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1419, 88 off119960 00000004:00080000:2.0:1763343035.575972:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1229243351653ns, next at 1229609967587ns, rc = 0 00000040:00080000:2.0:1763343035.575989:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1420, 88 off119960 00000004:00080000:2.0:1763343035.575993:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1229243372053ns, next at 1229610036645ns, rc = 0 00000100:00100000:1.0:1763343035.576810:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56875:x1848997993546752:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2415us (3650us total) trans 8589939941 rc 301/301 00000100:00100000:1.0:1763343035.576823:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9281 00000100:00100000:1.0:1763343035.580108:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.580351:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993547008 00000100:00100000:3.0:1763343035.580366:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993547008 00000100:00100000:3.0:1763343035.581194:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9282 00000100:00100000:3.0:1763343035.581211:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56875:x1848997993547008:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.581244:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.581274:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6985 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9351 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.581407:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae698c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.581423:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae695b lrc: 2/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.581433:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae698c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.581455:0:10041:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae695b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.581467:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae698c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000001:00080000:0.0:1763343035.583605:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939942 is committed 00000004:00080000:0.0:1763343035.583655:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 934 committed 00000004:00080000:0.0:1763343035.583667:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 935 committed 00000004:00080000:0.0:1763343035.583676:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 934 committed 00000004:00080000:0.0:1763343035.583678:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 933 committed 00010000:00010000:2.0:1763343035.584081:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae695b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac934a expref: 249 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.584099:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:2.0:1763343035.584103:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343035.584108:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae698c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.584118:0:6523:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae698c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.584126:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae698c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.584173:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae6954 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac934a expref: 249 pid: 6523 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343035.584196:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae695b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac934a expref: 248 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.584232:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d200, rc 0) 00000100:00100000:2.0:1763343035.584318:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:55941:x1848997993546880:12345-192.168.204.21@tcp:101:bash.0 Request processed in 10357us (13063us total) trans 8589939942 rc 0/0 00000100:00100000:2.0:1763343035.584329:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9280 00010000:00010000:1.0:1763343035.584772:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6843 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.584783:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6843 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.584791:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6843 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.584797:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.584802:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6843 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.584811:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6843 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.584825:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab000) 00010000:00010000:1.0:1763343035.584828:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.584832:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6843 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.584838:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6843 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.584855:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae68ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.584861:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae68ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.584867:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae68ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.584871:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.584873:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae68ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.584879:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae68ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.584885:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab000) 00010000:00010000:1.0:1763343035.584887:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.584889:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae68ba lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.584895:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae68ba lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.584910:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae694d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.584922:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae694d lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.584928:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae694d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.584933:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.584935:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae694d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.584939:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae694d lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.584945:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:1.0:1763343035.584947:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.584950:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae694d lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.584954:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae694d lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.585164:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae698c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.585173:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae698c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343035.585221:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dd:0x0]: returning size 2 00000004:00200000:3.0:1763343035.585227:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343035.585250:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae698c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343035.585283:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6985 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9351 expref: 245 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.585296:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae698c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9351 expref: 244 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.585308:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:3.0:1763343035.585311:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763343035.585313:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343035.585359:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56875:x1848997993547008:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4154us (5268us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.585365:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9282 00000100:00100000:1.0:1763343035.586012:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010261888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343035.586047:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010261632:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343035.586079:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343035.586085:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010261760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343035.586161:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010261504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343035.586179:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.586210:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010261888 00000100:00100000:2.0:1763343035.586219:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010261888 00000100:00100000:2.0:1763343035.586266:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010261760 00000100:00100000:2.0:1763343035.586269:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010261760 00000100:00100000:2.0:1763343035.586289:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6511 00000100:00100000:2.0:1763343035.586297:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3659:x1848998010261888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343035.586477:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010262144:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763343035.586480:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2a4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343035.586483:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2a4:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343035.586486:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2a4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343035.586488:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2a4:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343035.586491:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2a4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343035.586524:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3659:x1848998010261888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 227us (444us total) trans 17179871589 rc 0/0 00000100:00100000:2.0:1763343035.586531:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6511 00000100:00100000:2.0:1763343035.586547:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6512 00000100:00100000:2.0:1763343035.586553:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3658:x1848998010261760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343035.586604:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.586618:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3658:x1848998010261760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (438us total) trans 17179871590 rc 0/0 00000100:00100000:2.0:1763343035.586645:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6512 00000100:00100000:2.0:1763343035.586654:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010262144 00000100:00100000:2.0:1763343035.586657:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010262144 00000004:00080000:0.0:1763343035.586671:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a353876d500/2, rc 0, transno 17179871590 00000100:00100000:0.0:1763343035.586677:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010261760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343035.586678:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6513 00000100:00100000:2.0:1763343035.586683:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010262144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343035.586695:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343035.586713:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010261376:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343035.586735:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343035.586753:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763343035.586759:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010262272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343035.586776:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.586779:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3658:x1848998010262144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (176us total) trans 21474838887 rc 0/0 00000100:00100000:2.0:1763343035.586785:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6513 00000100:00100000:2.0:1763343035.586795:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010261504 00000100:00100000:2.0:1763343035.586798:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010261504 00000100:00100000:0.0:1763343035.586800:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010261376 00000100:00100000:0.0:1763343035.586803:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010261376 00000100:00100000:2.0:1763343035.586814:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010262272 00000100:00100000:2.0:1763343035.586817:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010262272 00000100:00100000:0.0:1763343035.586824:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6514 00000100:00100000:2.0:1763343035.586830:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6515 00000100:00100000:0.0:1763343035.586831:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3660:x1848998010261504:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343035.586834:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3660:x1848998010261376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343035.586846:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:671 count 1 00002000:00080000:0.0:1763343035.586846:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:673 count 1 00010000:00010000:2.0:1763343035.586867:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae6993 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.586868:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae699a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.586889:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae67e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92cc expref: 15 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.586890:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae67f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92d3 expref: 30 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.586899:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343035.586899:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343035.586901:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343035.586901:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343035.586906:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae6993 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.586906:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae699a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.586948:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae67e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92cc expref: 15 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.586948:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae67f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92d3 expref: 30 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.586965:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae67e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92cc expref: 15 pid: 10294 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.586965:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae67f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92d3 expref: 30 pid: 28994 timeout: 1329 lvb_type: 0 00000100:00100000:2.0:1763343035.586978:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010262400:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343035.586978:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010262528:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343035.587044:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35085390c0 going to sleep for 11 seconds 00000004:00080000:0.0:1763343035.587069:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340664b800/2, rc 0, transno 21474838887 00000100:00100000:0.0:1763343035.587075:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340664b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010262144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343035.587094:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6516 00000100:00100000:0.0:1763343035.587100:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3660:x1848998010262272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343035.587183:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2a2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343035.587186:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2a2:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343035.587188:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2a2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343035.587190:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2a2:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343035.587193:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2a2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343035.590722:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.590889:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726b40 going to sleep for 11 seconds 00000100:00100000:2.0:1763343035.590950:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010261632 00000100:00100000:2.0:1763343035.590965:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010261632 00000100:00100000:2.0:1763343035.591023:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6517 00000100:00100000:2.0:1763343035.591032:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3657:x1848998010261632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343035.591070:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:674 count 1 00010000:00010000:2.0:1763343035.591103:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae69a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.591125:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae6755 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9294 expref: 30 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343035.591134:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.591136:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.591141:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae69a1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.591181:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae6755 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9294 expref: 30 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343035.591200:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae6755 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9294 expref: 30 pid: 28648 timeout: 1329 lvb_type: 1 00000100:00100000:2.0:1763343035.591217:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010262656:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343035.591271:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726300 going to sleep for 11 seconds 00000004:00080000:1.0:1763343035.591869:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a353876e300/2, rc 0, transno 17179871589 00000100:00100000:1.0:1763343035.591880:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010261888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343035.592953:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3660:x1848998010262272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5844us (6167us total) trans 21474838888 rc 0/0 00000100:00100000:0.0:1763343035.592978:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6516 00000004:00080000:1.0:1763343035.593599:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406649c00/2, rc 0, transno 21474838888 00000100:00100000:1.0:1763343035.593609:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010262272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343035.594858:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010262016:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343035.594950:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343035.595465:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010262016 00000100:00100000:0.0:1763343035.595476:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010262016 00000100:00100000:0.0:1763343035.595570:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6518 00000100:00100000:0.0:1763343035.595582:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3657:x1848998010262016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343035.595664:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:672 count 1 00010000:00010000:0.0:1763343035.595701:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405137200/0x607405d401ae69a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.595731:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae675c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac929b expref: 15 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343035.595741:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.595743:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.595747:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405137200/0x607405d401ae69a8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.595791:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae675c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac929b expref: 15 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343035.595805:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae675c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac929b expref: 15 pid: 28648 timeout: 1329 lvb_type: 1 00000100:00100000:0.0:1763343035.595819:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010262784:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343035.595903:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3508539840 going to sleep for 11 seconds 00000100:00100000:2.0:1763343035.598351:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.598422:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993547136 00000100:00100000:1.0:1763343035.598431:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993547136 00000100:00100000:2.0:1763343035.598444:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010262400:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343035.598477:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae6993 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.598478:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae67f6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92d3 expref: 31 pid: 28994 timeout: 1329 lvb_type: 0 00000100:00100000:2.0:1763343035.598536:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010262656:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343035.598552:0:28648:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae69a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343035.598580:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.598601:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.598642:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.598705:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993547264 00000100:00100000:2.0:1763343035.598709:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993547264 00010000:00010000:2.0:1763343035.598728:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae67e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92cc expref: 16 pid: 10294 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343035.598731:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993547392 00000100:00100000:1.0:1763343035.598735:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993547392 00010000:00010000:1.0:1763343035.598748:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae6755 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9294 expref: 32 pid: 28648 timeout: 1329 lvb_type: 1 00000100:00100000:2.0:1763343035.598753:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3054 00000100:00100000:2.0:1763343035.598763:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2431:x1848997993547136:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763343035.598763:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3055 00000100:00100000:1.0:1763343035.598768:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993547264:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343035.598781:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343035.598781:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343035.598786:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae67f6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92d3 expref: 32 pid: 28994 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.598787:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae67e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92cc expref: 16 pid: 10294 timeout: 1329 lvb_type: 0 00010000:00010000:2.0:1763343035.598798:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae67f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92d3 expref: 32 pid: 28994 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.598800:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae67e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92cc expref: 16 pid: 10294 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.598825:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3403529600/0x607405d401ae67e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92cc expref: 16 pid: 10294 timeout: 1329 lvb_type: 0 00010000:00010000:2.0:1763343035.598829:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.598831:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.598837:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae699a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.598839:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343035.598841:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343035.598844:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae6993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.598848:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae699a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.598851:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae6993 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.598869:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343035.598872:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343035.599237:0:28996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae67f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac92d3 expref: 32 pid: 28994 timeout: 1329 lvb_type: 0 00000100:00100000:0.0:1763343035.599251:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010262528:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343035.599268:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae699a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.599278:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae699a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.599290:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae699a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.599301:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae699a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.599309:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae699a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.599329:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343035.599861:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993547264:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1089us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.599872:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3055 00000100:00100000:1.0:1763343035.599905:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3056 00000100:00100000:1.0:1763343035.599943:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2429:x1848997993547392:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343035.599960:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343035.599965:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae6755 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9294 expref: 31 pid: 28648 timeout: 1329 lvb_type: 1 00010000:00010000:1.0:1763343035.599977:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae6755 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9294 expref: 31 pid: 28648 timeout: 1329 lvb_type: 1 00010000:00010000:1.0:1763343035.599996:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340665dc00/0x607405d401ae6755 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9294 expref: 31 pid: 28648 timeout: 1329 lvb_type: 1 00010000:00010000:1.0:1763343035.600012:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343035.600014:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343035.600018:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae69a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.600025:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae69a1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.600047:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343035.601446:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2431:x1848997993547136:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 2669us (3093us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343035.601462:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3054 00000100:00100000:2.0:1763343035.601556:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993547520 00000100:00100000:2.0:1763343035.601566:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993547520 00000100:00100000:2.0:1763343035.601614:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6519 00000100:00100000:2.0:1763343035.601644:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:55941:x1848997993547520:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343035.601665:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.601690:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae69af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9358 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343035.601719:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343035.601742:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.601744:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.601755:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae69af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9358 expref: 31 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.601772:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae69af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9358 expref: 31 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.601786:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c400, rc 0) 00000100:00100000:2.0:1763343035.601824:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:55941:x1848997993547520:12345-192.168.204.21@tcp:101:bash.0 Request processed in 183us (3181us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343035.601831:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6519 00010000:00010000:2.0:1763343035.601863:0:8410:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae6993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.601874:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae6993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.601886:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae6993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.601894:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae6993 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.601930:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763343035.602225:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3660:x1848998010261376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15388us (15487us total) trans 21474838889 rc 0/0 00000100:00100000:2.0:1763343035.602233:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6515 00010000:00010000:2.0:1763343035.602441:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343035.602450:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae699a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.602459:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405136200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343035.602464:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae699a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.602474:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae699a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.602492:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae699a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.602499:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae699a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.602517:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343035.602521:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae6993 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.602528:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343035.602530:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae6993 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.602538:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae6993 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.602553:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae6993 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.602560:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae6993 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.602575:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343035.602576:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343035.602578:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343035.602586:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343035.602741:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3660:x1848998010261504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15908us (16041us total) trans 17179871591 rc 0/0 00000100:00100000:0.0:1763343035.602749:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6514 00010000:00010000:0.0:1763343035.602790:0:28648:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae69a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.602799:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae69a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.602808:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae69a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.602815:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae69a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.602833:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343035.603054:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3657:x1848998010261632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12022us (12343us total) trans 17179871592 rc 0/0 00000100:00100000:0.0:1763343035.603062:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6517 00010000:00010000:0.0:1763343035.603081:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343035.603087:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae69a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.603094:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343035.603097:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae69a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.603105:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae69a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.603117:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae69a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.603124:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae69a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.603136:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343035.603138:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343035.603140:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343035.603192:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a353876ea00/2, rc 0, transno 17179871591 00000100:00100000:0.0:1763343035.603200:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010261504:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1763343035.603219:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c2c6a00/2, rc 0, transno 21474838889 00000100:00100000:0.0:1763343035.603224:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010261376:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343035.603956:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2429:x1848997993547392:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 4034us (5345us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.603980:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3056 00000004:00080000:3.0:1763343035.604356:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a353876c700/2, rc 0, transno 17179871592 00000100:00100000:2.0:1763343035.604361:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.604363:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010261632:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343035.606378:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993547648 00000100:00100000:0.0:1763343035.606399:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993547648 00000100:00100000:0.0:1763343035.606487:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6520 00000100:00100000:0.0:1763343035.606499:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2429:x1848997993547648:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.606528:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.606554:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405136600/0x607405d401ae69b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac935f expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343035.606855:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010262912:192.168.204.21@tcp:106: 00000100:00100000:1.0:1763343035.607042:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010262784:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343035.607070:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3405137200/0x607405d401ae69a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343035.607105:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3508539e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763343035.607127:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.607211:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993547776 00000100:00100000:1.0:1763343035.607216:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993547776 00010000:00010000:1.0:1763343035.607243:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae675c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac929b expref: 15 pid: 28648 timeout: 1329 lvb_type: 1 00000100:00100000:1.0:1763343035.607288:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3057 00000100:00100000:1.0:1763343035.607297:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3502d61c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993547776:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343035.607311:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343035.607317:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae675c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac929b expref: 15 pid: 28648 timeout: 1329 lvb_type: 1 00010000:00010000:1.0:1763343035.607331:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae675c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac929b expref: 15 pid: 28648 timeout: 1329 lvb_type: 1 00010000:00010000:1.0:1763343035.607358:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340665cc00/0x607405d401ae675c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac929b expref: 15 pid: 28648 timeout: 1329 lvb_type: 1 00010000:00010000:1.0:1763343035.607374:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343035.607376:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343035.607382:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405137200/0x607405d401ae69a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.607393:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405137200/0x607405d401ae69a8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.607428:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343035.607467:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3502d61c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993547776:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 169us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.607475:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3057 00010000:00010000:2.0:1763343035.607524:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3405137200/0x607405d401ae69a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.607532:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405137200/0x607405d401ae69a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.607543:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405137200/0x607405d401ae69a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.607551:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405137200/0x607405d401ae69a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.607581:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343035.607670:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.607692:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993547904 00000100:00100000:3.0:1763343035.607696:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993547904 00000100:00100000:3.0:1763343035.607722:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6521 00000100:00100000:3.0:1763343035.607729:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:55941:x1848997993547904:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343035.607741:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.607759:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae69bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9366 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343035.607781:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343035.607795:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.607796:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.607804:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae69bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9366 expref: 15 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.607821:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae69bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9366 expref: 15 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.607832:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:3.0:1763343035.607857:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:55941:x1848997993547904:12345-192.168.204.21@tcp:101:bash.0 Request processed in 130us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.607864:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6521 00000100:00100000:2.0:1763343035.607893:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3657:x1848998010262016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12313us (12943us total) trans 21474838890 rc 0/0 00000100:00100000:2.0:1763343035.607903:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6518 00000004:00080000:3.0:1763343035.607910:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c2c6d80/2, rc 0, transno 21474838890 00000100:00100000:3.0:1763343035.607928:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010262016:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763343035.608107:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343035.608115:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3405137200/0x607405d401ae69a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.608124:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343035.608128:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405137200/0x607405d401ae69a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.608143:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405137200/0x607405d401ae69a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.608159:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3405137200/0x607405d401ae69a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.608166:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405137200/0x607405d401ae69a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.608184:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343035.608185:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343035.608187:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343035.610780:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.610813:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.610998:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993548032 00000100:00100000:0.0:1763343035.610998:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993548160 00000100:00100000:3.0:1763343035.611010:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993548032 00000100:00100000:0.0:1763343035.611010:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993548160 00002000:00010000:3.0:1763343035.611059:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/675 (0->18446744073709551615) 00002000:00010000:0.0:1763343035.611059:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/673 (0->18446744073709551615) 00002000:00100000:3.0:1763343035.611065:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34097a7800 with x1848997993548032 ext(0->18446744073709551615) 00002000:00100000:0.0:1763343035.611065:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34097a4380 with x1848997993548160 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343035.611079:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34097a7800. 00002000:00010000:0.0:1763343035.611079:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34097a4380. 00000100:00100000:0.0:1763343035.611119:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1592 00000100:00100000:0.0:1763343035.611131:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993548160:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:1.0:1763343035.611167:0:28648:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x2a3:0x0] updating lvb mtime: 0 -> 1763343035 00002000:00010000:1.0:1763343035.611171:0:28648:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x2a3:0x0] updating lvb atime: 0 -> 1763343035 00002000:00010000:1.0:1763343035.611174:0:28648:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x2a3:0x0] updating lvb ctime: 0 -> 1763343035 00000100:00100000:1.0:1763343035.611192:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010262912:192.168.204.21@tcp:106: 00010000:00010000:1.0:1763343035.611231:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3405136600/0x607405d401ae69b6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac935f expref: 32 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343035.611254:0:28648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405136600/0x607405d401ae69b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac935f expref: 32 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343035.611269:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405136600, rc 0) 00000100:00100000:1.0:1763343035.611332:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2429:x1848997993547648:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4835us (6971us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343035.611339:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6520 00002000:00010000:0.0:1763343035.611358:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2a1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343035.611361:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2a1:0x0] updating lvb mtime from disk: 0 -> 1763343035 00002000:00010000:0.0:1763343035.611364:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2a1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343035.611366:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2a1:0x0] updating lvb ctime from disk: 0 -> 1763343035 00002000:00010000:0.0:1763343035.611369:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2a1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343035.611405:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993548160:12345-192.168.204.21@tcp:10:bash.0 Request processed in 275us (590us total) trans 21474838891 rc 0/0 00000100:00100000:3.0:1763343035.611407:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1593 00000100:00100000:0.0:1763343035.611412:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1592 00000100:00100000:3.0:1763343035.611415:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2430:x1848997993548032:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343035.611415:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/673 (0->18446744073709551615) 00002000:00100000:0.0:1763343035.611418:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34097a4380 with x1848997993548160 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343035.611423:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34097a4380. 00002000:00010000:3.0:1763343035.611515:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2a3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343035.611519:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2a3:0x0] updating lvb mtime from disk: 1763343035 -> 1763343035 00002000:00010000:3.0:1763343035.611521:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2a3:0x0] updating lvb atime from disk: 1763343035 -> 0 00002000:00010000:3.0:1763343035.611523:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2a3:0x0] updating lvb ctime from disk: 1763343035 -> 1763343035 00002000:00010000:3.0:1763343035.611526:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2a3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343035.611593:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993548032:12345-192.168.204.21@tcp:10:bash.0 Request processed in 177us (826us total) trans 17179871593 rc 0/0 00000100:00100000:3.0:1763343035.611600:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1593 00002000:00010000:3.0:1763343035.611604:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/675 (0->18446744073709551615) 00002000:00100000:3.0:1763343035.611606:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34097a7800 with x1848997993548032 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343035.611611:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34097a7800. 00000100:00100000:0.0:1763343035.612168:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010263040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1763343035.612238:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343035.612425:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010263040 00000100:00100000:1.0:1763343035.612434:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010263040 00000100:00100000:1.0:1763343035.612666:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:1.0:1763343035.612677:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1848998010263040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1763343035.612727:0:6528:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446187008 avail 1299947520 00000100:00100000:1.0:1763343035.612787:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1848998010263040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.612794:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:1.0:1763343035.612819:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343035.612830:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1848998010263168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1763343035.612862:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343035.612892:0:13006:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010263168 00000100:00100000:1.0:1763343035.612897:0:13006:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010263168 00000100:00100000:1.0:1763343035.612943:0:13006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:1.0:1763343035.612950:0:13006:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3658:x1848998010263168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1763343035.612975:0:13006:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445650432 avail 1299410944 00000100:00100000:1.0:1763343035.613012:0:13006:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3658:x1848998010263168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.613017:0:13006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:1.0:1763343035.613067:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1848998010263168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1763343035.613106:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010263040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1763343035.613579:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1848998010263680:0@lo:400:kworker.0 00000100:00100000:0.0:1763343035.613646:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343035.613677:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1848998010264192:0@lo:400:kworker.0 00000100:00100000:0.0:1763343035.613708:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343035.613739:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1763343035.613746:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07eb4ce3-eb55-46ce-8a00-00f8f23465ad:3657:1848998010263296:0@lo:400:kworker.0 00000100:00100000:0.0:1763343035.613776:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343035.613806:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1848998010263808:0@lo:400:kworker.0 00000100:00100000:0.0:1763343035.613828:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343035.613843:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1848998010264320:0@lo:400:kworker.0 00000100:00100000:0.0:1763343035.613863:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343035.613891:0:32346:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010263296 00000100:00100000:0.0:1763343035.613897:0:32346:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010263296 00000100:00100000:0.0:1763343035.613945:0:32346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1763343035.613952:0:32346:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb4ce3-eb55-46ce-8a00-00f8f23465ad+23:3657:x1848998010263296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763343035.613995:0:32346:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb4ce3-eb55-46ce-8a00-00f8f23465ad+23:3657:x1848998010263296:12345-0@lo:400:kworker.0 Request processed in 43us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.614001:0:32346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1763343035.614043:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07eb4ce3-eb55-46ce-8a00-00f8f23465ad:3657:1848998010263296:0@lo:400:kworker.0 00000100:00100000:0.0:1763343035.614066:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010264192 00000100:00100000:0.0:1763343035.614069:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010264192 00000100:00080000:0.0:1763343035.614093:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1763343035.614406:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010263680 00000100:00100000:2.0:1763343035.614412:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010263680 00000100:00100000:2.0:1763343035.614447:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:2.0:1763343035.614454:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3657:x1848998010263680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343035.614500:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3657:x1848998010263680:12345-0@lo:400:kworker.0 Request processed in 46us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343035.614506:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:2.0:1763343035.614532:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010263808 00000100:00100000:2.0:1763343035.614535:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010263808 00000100:00100000:2.0:1763343035.614570:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010264320 00000100:00100000:2.0:1763343035.614573:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010264320 00000100:00100000:2.0:1763343035.614595:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:2.0:1763343035.614602:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1848998010264192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343035.614652:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1848998010264192:12345-0@lo:400:kworker.0 Request processed in 50us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343035.614658:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:2.0:1763343035.614671:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468 00000100:00100000:2.0:1763343035.614677:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1848998010263808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343035.614707:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1848998010263808:12345-0@lo:400:kworker.0 Request processed in 30us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343035.614713:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468 00000100:00100000:2.0:1763343035.614725:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:2.0:1763343035.614730:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1848998010264320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343035.614757:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1848998010264320:12345-0@lo:400:kworker.0 Request processed in 26us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343035.614762:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00080000:0.0:1763343035.615185:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1763343035.615218:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1848998010263808:0@lo:400:kworker.0 00000100:00100000:0.0:1763343035.615231:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1848998010264320:0@lo:400:kworker.0 00000100:00100000:0.0:1763343035.615244:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1848998010263680:0@lo:400:kworker.0 00000100:00100000:0.0:1763343035.615256:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1848998010264192:0@lo:400:kworker.0 00000100:00100000:2.0:1763343035.615436:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.615768:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1848998010263552:0@lo:400:kworker.0 00000100:00100000:1.0:1763343035.615819:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343035.615850:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1848998010264064:0@lo:400:kworker.0 00000100:00100000:1.0:1763343035.615869:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343035.615885:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1763343035.615891:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1848998010263424:0@lo:400:kworker.0 00000100:00100000:1.0:1763343035.615907:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343035.615930:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1848998010263936:0@lo:400:kworker.0 00000100:00100000:1.0:1763343035.615949:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343035.615973:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010264064 00000100:00100000:1.0:1763343035.615979:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010264064 00000100:00100000:1.0:1763343035.616017:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010263424 00000100:00100000:1.0:1763343035.616020:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010263424 00000100:00100000:1.0:1763343035.616034:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010263936 00000100:00100000:1.0:1763343035.616036:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010263936 00000100:00100000:1.0:1763343035.616060:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:1.0:1763343035.616067:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1848998010264064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343035.616121:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1848998010264064:12345-0@lo:400:kworker.0 Request processed in 54us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.616128:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:2.0:1763343035.616141:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1848998010264064:0@lo:400:kworker.0 00000100:00100000:1.0:1763343035.616145:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:1.0:1763343035.616150:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1848998010263424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343035.616188:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1848998010263424:12345-0@lo:400:kworker.0 Request processed in 37us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.616194:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:3.0:1763343035.616196:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993548416 00000100:00100000:3.0:1763343035.616201:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993548416 00000100:00100000:1.0:1763343035.616204:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:1.0:1763343035.616209:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1848998010263936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763343035.616233:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3160 00000100:00100000:1.0:1763343035.616235:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1848998010263936:12345-0@lo:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.616240:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56875:x1848997993548416:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343035.616240:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00080000:1.0:1763343035.616255:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1763343035.616258:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1763343035.616270:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010263552 00000100:00100000:1.0:1763343035.616274:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010263552 00000100:00100000:1.0:1763343035.616298:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:1.0:1763343035.616304:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3660:x1848998010263552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343035.616333:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3660:x1848998010263552:12345-0@lo:400:kworker.0 Request processed in 30us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.616338:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:2.0:1763343035.616451:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1848998010263424:0@lo:400:kworker.0 00000100:00100000:2.0:1763343035.616461:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1848998010263936:0@lo:400:kworker.0 00000100:00100000:2.0:1763343035.616468:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1848998010263552:0@lo:400:kworker.0 00000100:00100000:3.0:1763343035.617246:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56875:x1848997993548416:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1001us (1868us total) trans 8589939943 rc 0/0 00000100:00100000:3.0:1763343035.617256:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3160 00000100:00100000:2.0:1763343035.617985:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.619911:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993548672 00000100:00100000:0.0:1763343035.619939:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993548672 00000100:00100000:0.0:1763343035.620027:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3161 00000100:00100000:0.0:1763343035.620040:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:55941:x1848997993548672:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343035.620478:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:55941:x1848997993548672:12345-192.168.204.21@tcp:35:bash.0 Request processed in 438us (2495us total) trans 8589939944 rc 0/0 00000100:00100000:0.0:1763343035.620487:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3161 00000100:00100000:0.0:1763343035.621908:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.622544:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993548928 00000100:00100000:2.0:1763343035.622558:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993548928 00000100:00100000:2.0:1763343035.623206:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9283 00000100:00100000:2.0:1763343035.623220:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56875:x1848997993548928:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.623251:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.623293:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae69c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac936d expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.623393:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae69cb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.623410:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae69cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.623423:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae69cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.623438:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae69d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.623446:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae69d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.623453:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae69d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624009:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae69d9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624021:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae69d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624029:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae69d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343035.624040:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dd:0x0]: returning size 5 00010000:00010000:2.0:1763343035.624131:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae69cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624138:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae69cb lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624145:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae69cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624151:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.624155:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae69cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624162:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae69cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624175:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3503a3af00) 00010000:00010000:2.0:1763343035.624179:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.624183:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae69cb lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624189:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae69cb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624203:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae69d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624208:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae69d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624213:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae69d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624218:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.624221:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae69d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624226:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae69d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624231:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3ad00) 00010000:00010000:2.0:1763343035.624233:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.624235:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae69d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624240:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae69d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343035.624365:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae69c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac936d expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.624388:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae69d9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac936d expref: 248 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.624396:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:2.0:1763343035.624399:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343035.624402:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c800, rc 0) 00000100:00100000:2.0:1763343035.624931:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56875:x1848997993548928:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1711us (3034us total) trans 8589939945 rc 0/0 00000100:00100000:2.0:1763343035.624940:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9283 00000100:00100000:3.0:1763343035.629311:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.631542:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993549184 00000100:00100000:2.0:1763343035.631566:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993549184 00000100:00100000:2.0:1763343035.631665:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3162 00000100:00100000:2.0:1763343035.631676:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56875:x1848997993549184:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343035.632073:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56875:x1848997993549184:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 398us (2776us total) trans 8589939946 rc 0/0 00000100:00100000:2.0:1763343035.632082:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3162 00000100:00100000:3.0:1763343035.639299:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.639560:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993549440 00000100:00100000:2.0:1763343035.639574:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993549440 00000100:00100000:3.0:1763343035.640405:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.640566:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993549696 00000100:00100000:1.0:1763343035.640574:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993549696 00000100:00100000:1.0:1763343035.640653:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9284 00000100:00100000:1.0:1763343035.640665:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56875:x1848997993549440:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.640696:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.640725:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae69e7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9374 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.640876:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.640895:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae698c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9351 expref: 251 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.640904:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae69d9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac936d expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.640921:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 5/0,1 mode: --/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343035.640928:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9285 00000100:00100000:0.0:1763343035.640939:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56876:x1848997993549696:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:1.0:1763343035.640965:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae69d9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac936d expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.640965:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1763343035.640985:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae69d9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac936d expref: 251 pid: 28422 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343035.641151:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c71880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010264448:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343035.641199:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae695b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac934a expref: 251 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.641216:0:6525:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae69d9 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac936d expref: 250 pid: 28422 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.641231:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6946 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac933c expref: 250 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.641251:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:0.0:1763343035.641255:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.641264:0:6525:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.641272:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 5/0,1 mode: CW/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.641291:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343035.641314:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae69f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.641322:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae69f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.641330:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae69f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.641341:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae69fc lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.641348:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae69fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.641353:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae69fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.641445:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.641452:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.641458:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.641468:0:6525:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 5/0,1 mode: CW/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343035.641475:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.641820:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae698c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9351 expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343035.641834:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1763343035.644177:0:6523:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@00000000491e2359 x1848998010264448) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae69d9 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac936d expref: 248 pid: 28422 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.644206:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae69d9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac936d expref: 248 pid: 28422 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343035.644224:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c71880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010264448:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343035.644252:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:1.0:1763343035.644259:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.644270:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.644282:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.644291:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.644301:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343035.644333:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dd:0x0]: returning size 5 00010000:00010000:1.0:1763343035.644505:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae69e7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9374 expref: 249 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.644530:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9374 expref: 248 pid: 6523 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.644539:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9374 expref: 248 pid: 6523 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.644547:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:1.0:1763343035.644823:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56875:x1848997993549440:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4159us (5540us total) trans 8589939947 rc 0/0 00000100:00100000:1.0:1763343035.644834:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9284 00000100:00100000:2.0:1763343035.648871:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.648937:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.649033:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993549952 00000100:00100000:3.0:1763343035.649048:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993549952 00000100:00100000:3.0:1763343035.649123:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3163 00000100:00100000:3.0:1763343035.649136:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56875:x1848997993549952:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:0.0:1763343035.649256:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993549824 00000100:00100000:0.0:1763343035.649261:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993549824 00010000:00010000:0.0:1763343035.649291:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9374 expref: 249 pid: 6523 timeout: 1329 lvb_type: 0 00000100:00100000:0.0:1763343035.649327:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3058 00000100:00100000:0.0:1763343035.649334:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:2432:x1848997993549824:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343035.649347:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343035.649355:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9374 expref: 249 pid: 6523 timeout: 1329 lvb_type: 0 00000100:00100000:3.0:1763343035.649366:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56875:x1848997993549952:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 234us (429us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343035.649368:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9374 expref: 249 pid: 6523 timeout: 1329 lvb_type: 0 00000100:00100000:3.0:1763343035.649374:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3163 00010000:00010000:0.0:1763343035.649397:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae69ee lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1dd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9374 expref: 248 pid: 6523 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.649416:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:0.0:1763343035.649423:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.649438:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.649445:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.649474:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343035.649543:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:2432:x1848997993549824:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 209us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.649550:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3058 00010000:00010000:0.0:1763343035.649575:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.649584:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00080000:0.0:1763343035.649944:0:6525:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1dd:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763343035.650048:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.650057:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.650064:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.650070:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343035.650076:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.650083:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.650097:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:0.0:1763343035.650100:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343035.650105:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.650111:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a03 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.650137:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae69f5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.650143:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae69f5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.650149:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae69f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.650155:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae69f5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.650160:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343035.650163:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae69f5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.650168:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae69f5 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.650176:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2a00) 00010000:00010000:0.0:1763343035.650179:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343035.650181:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae69f5 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.652177:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae69f5 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:0.0:1763343035.652212:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000c822d50 reply state 000000005f119618 transno 8589939948 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae69fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.652231:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae69fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.652239:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c2300) 00010000:00010000:0.0:1763343035.652243:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343035.652248:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343035.652360:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56876:x1848997993549696:12345-192.168.204.21@tcp:36:rm.0 Request processed in 11417us (11953us total) trans 8589939948 rc 0/0 00000100:00100000:0.0:1763343035.652370:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9285 00000100:00100000:2.0:1763343035.653803:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.655124:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993550208 00000100:00100000:0.0:1763343035.655143:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993550208 00000100:00100000:0.0:1763343035.655218:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9286 00000100:00100000:0.0:1763343035.655230:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56875:x1848997993550208:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.655259:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.655293:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a11 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac937b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.655449:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae6a18 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.655465:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae6a18 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.655477:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae6a18 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343035.655501:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1dd:0x0]: returning size 5 00010000:00010000:0.0:1763343035.655670:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a11 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac937b expref: 251 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.655690:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae6a18 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac937b expref: 250 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.655699:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2900) 00010000:00010000:0.0:1763343035.655703:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343035.655706:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405136200, rc 0) 00000100:00100000:0.0:1763343035.655786:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56875:x1848997993550208:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 558us (1993us total) trans 8589939949 rc 0/0 00000100:00100000:0.0:1763343035.655794:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9286 00000100:00100000:2.0:1763343035.665927:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.666024:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993550464 00000100:00100000:3.0:1763343035.666039:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993550464 00000100:00100000:3.0:1763343035.666120:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3164 00000100:00100000:3.0:1763343035.666132:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56875:x1848997993550464:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:3.0:1763343035.666242:0:6526:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1dd:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae6a18 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac937b expref: 250 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.666326:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6a26 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343035.666345:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6a26 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343035.666356:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6a26 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 00000004:00020000:3.0:1763343035.666561:0:6526:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0000-mdtlov: can not set all stale mirrors for [0x200000405:0x1dd:0x0]: rc = -1 00010000:00010000:3.0:1763343035.666598:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6a26 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343035.666607:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6a26 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343035.666614:0:6526:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6a26 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343035.666654:0:6526:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.666659:0:6526:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6a26 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343035.666667:0:6526:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6a26 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343035.666679:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2900) 00010000:00010000:3.0:1763343035.666682:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1763343035.666688:0:6526:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6a26 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343035.666695:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae6a26 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1dd:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 00010000:00010000:3.0:1763343035.666706:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a34037c2900) 00010000:00010000:3.0:1763343035.666708:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343035.666712:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae6a18 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac937b expref: 250 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343035.666901:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56875:x1848997993550464:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 770us (1001us total) trans 8589939950 rc -1/-1 00000100:00100000:3.0:1763343035.666911:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3164 00000100:00100000:2.0:1763343035.675160:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.676896:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993550592 00000100:00100000:3.0:1763343035.676925:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993550592 00000100:00100000:2.0:1763343035.677219:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.678398:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993550720 00000100:00100000:0.0:1763343035.678414:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993550720 00000100:00100000:0.0:1763343035.678491:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9287 00000100:00100000:0.0:1763343035.678506:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56877:x1848997993550592:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:2.0:1763343035.678528:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9288 00010000:00010000:0.0:1763343035.678538:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763343035.678544:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56875:x1848997993550720:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.678562:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.678575:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a2d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9382 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.678581:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ca00/0x607405d401ae6a34 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9389 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.678677:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ca00/0x607405d401ae6a34 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9389 expref: 253 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.678698:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ca00/0x607405d401ae6a34 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1dd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9389 expref: 253 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.678698:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a3b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678719:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678732:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.678736:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a3503a3af00) 00010000:00010000:2.0:1763343035.678743:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343035.678748:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352ca00, rc 0) 00010000:00010000:0.0:1763343035.678748:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a42 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678760:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678767:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678819:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a3b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678828:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a3b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343035.678838:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56875:x1848997993550720:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 297us (1623us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343035.678839:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678854:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a3b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343035.678856:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9288 00010000:00010000:0.0:1763343035.678865:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343035.678872:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a3b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678881:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a3b lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678895:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2a00) 00010000:00010000:0.0:1763343035.678898:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343035.678902:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a3b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678910:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a3b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678939:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678947:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678954:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678960:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343035.678964:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678970:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678979:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c2300) 00010000:00010000:0.0:1763343035.678982:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343035.678986:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a42 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.678992:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a42 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.679020:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a2d lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9382 expref: 252 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.679032:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2a00) 00010000:00010000:0.0:1763343035.679035:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343035.679040:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a2d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9382 expref: 252 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.679055:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137c00, rc 0) 00000100:00100000:0.0:1763343035.679098:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56877:x1848997993550592:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 595us (3956us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343035.679106:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9287 00000100:00100000:2.0:1763343035.687563:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.687978:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993550976 00000100:00100000:0.0:1763343035.687993:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993550976 00000100:00100000:0.0:1763343035.688071:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3165 00000100:00100000:0.0:1763343035.688083:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56875:x1848997993550976:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:0.0:1763343035.688431:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1dd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343035.688516:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1421, 64 off120024 00000040:00080000:0.0:1763343035.688539:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1420, 64 off120024 00000040:00080000:0.0:1763343035.688546:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1421, 64 off120088 00000040:00080000:0.0:1763343035.688553:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1422, 64 off120088 00010000:00010000:0.0:1763343035.688653:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a49 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343035.688675:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a49 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343035.688689:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a49 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343035.688700:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a49 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343035.688707:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a49 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343035.688715:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a49 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343035.688742:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343035.688985:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56875:x1848997993550976:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 902us (1435us total) trans 8589939951 rc 0/0 00000100:00100000:0.0:1763343035.688999:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3165 00010000:00010000:2.0:1763343035.691698:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343035.691722:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a49 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343035.691735:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137c00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343035.691741:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a49 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343035.691752:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a49 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343035.691779:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1dd:0x0].0x0 (ffff9a3503a3af00) 00010000:00010000:2.0:1763343035.691783:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343035.691790:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a49 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343035.691796:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6a49 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1dd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343035.691819:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343035.691821:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343035.691823:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343035.695333:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.695580:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993551104 00000100:00100000:1.0:1763343035.695596:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993551104 00000100:00100000:1.0:1763343035.696791:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9289 00000100:00100000:1.0:1763343035.696809:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56877:x1848997993551104:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.696839:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.696872:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6a50 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9390 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.696972:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a57 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.696994:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a57 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697008:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a57 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697021:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a5e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697030:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697037:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697089:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a57 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697097:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a57 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697103:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a57 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697110:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a57 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697116:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.697121:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a57 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697130:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a57 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697148:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab000) 00010000:00010000:1.0:1763343035.697151:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.697157:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a57 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697163:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a57 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697178:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697183:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a5e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697189:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697194:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.697197:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697201:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697208:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c2300) 00010000:00010000:1.0:1763343035.697211:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.697214:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a5e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697219:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a5e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.697250:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6a50 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9390 expref: 253 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.697262:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab000) 00010000:00010000:1.0:1763343035.697264:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.697268:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6a50 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9390 expref: 253 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.697282:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:1.0:1763343035.697375:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56877:x1848997993551104:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 569us (2058us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343035.697383:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9289 00000100:00100000:1.0:1763343035.702611:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.702731:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993551232 00000100:00100000:0.0:1763343035.702745:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993551232 00000100:00100000:0.0:1763343035.702820:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9290 00000100:00100000:0.0:1763343035.702833:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56877:x1848997993551232:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.702870:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.702901:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a65 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9397 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.702990:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a6c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.703007:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.703021:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343035.703082:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343035.703088:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343035.703134:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6a65 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9397 expref: 254 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.703154:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9397 expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.703164:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2a00) 00010000:00010000:0.0:1763343035.703168:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343035.703172:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137200, rc 0) 00000100:00100000:0.0:1763343035.703259:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56877:x1848997993551232:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 428us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.703277:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9290 00000100:00100000:2.0:1763343035.713962:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.714067:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993551360 00000100:00100000:1.0:1763343035.714082:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993551360 00000100:00100000:1.0:1763343035.714161:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9291 00000100:00100000:1.0:1763343035.714173:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56877:x1848997993551360:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.714199:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.714226:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6a73 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac939e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.714451:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a7a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714469:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a7a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714487:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a7a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714499:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a81 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714508:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714514:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714566:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a7a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714573:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a7a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714580:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714586:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a7a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714593:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.714598:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a7a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714606:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a7a lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714663:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2a00) 00010000:00010000:1.0:1763343035.714667:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.714672:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a7a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714680:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6a7a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714695:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714703:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a81 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714708:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a81 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714714:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.714717:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a81 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714723:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a81 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714730:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c2300) 00010000:00010000:1.0:1763343035.714733:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.714735:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a81 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714742:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6a81 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.714772:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6a73 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac939e expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.714784:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2a00) 00010000:00010000:1.0:1763343035.714787:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.714791:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6a73 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac939e expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.714800:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:1.0:1763343035.715393:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56877:x1848997993551360:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1219us (1442us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343035.715405:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9291 00000100:00100000:2.0:1763343035.719904:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.720037:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993551616 00000100:00100000:1.0:1763343035.720052:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993551616 00000100:00100000:1.0:1763343035.720440:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9292 00000100:00100000:1.0:1763343035.720452:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56877:x1848997993551616:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.720482:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.720486:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343035.720524:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6a6c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9397 expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.720547:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2a00) 00010000:00010000:1.0:1763343035.720560:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343035.720582:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae6a88 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac93a5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.720763:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6a8f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.720781:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6a8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.720794:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6a8f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.720805:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6a96 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.720812:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6a96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.720818:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6a96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.721338:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6a9d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.721348:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6a9d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.721356:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6a9d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343035.721367:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1df:0x0]: returning size 0 00010000:00010000:1.0:1763343035.721402:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6a8f lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.721410:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6a8f lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.721417:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6a8f lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.721425:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6a8f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.721432:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.721436:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6a8f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.721444:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6a8f lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.721454:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab000) 00010000:00010000:1.0:1763343035.721458:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.721462:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6a8f lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.721474:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6a8f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:1.0:1763343035.721489:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006062b354 reply state 0000000039a58000 transno 8589939952 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6a96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.721501:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6a96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.721507:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c2300) 00010000:00010000:1.0:1763343035.721509:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343035.721512:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343035.721546:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae6a88 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93a5 expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.721568:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6a9d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93a5 expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.721575:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3403aabc00) 00010000:00010000:1.0:1763343035.721578:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343035.721581:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343035.721723:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56877:x1848997993551616:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1273us (1838us total) trans 8589939952 rc 0/0 00000100:00100000:1.0:1763343035.721732:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9292 00000100:00100000:0.0:1763343035.730838:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.731845:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993551872 00000100:00100000:1.0:1763343035.731862:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993551872 00000100:00100000:1.0:1763343035.731957:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9293 00000100:00100000:1.0:1763343035.731970:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56877:x1848997993551872:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.732007:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.732041:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6aab lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac93ac expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.732194:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6ab2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.732214:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6a9d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93a5 expref: 256 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.732226:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6ab2 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.732285:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6a9d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93a5 expref: 256 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.732301:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6a9d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93a5 expref: 256 pid: 6523 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343035.732319:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010264704:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343035.733437:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe540 going to sleep for 11 seconds 00000100:00100000:1.0:1763343035.740591:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010264704:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343035.740693:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6ab2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343035.743866:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.744030:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993552000 00000100:00100000:1.0:1763343035.744044:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993552000 00010000:00010000:1.0:1763343035.744101:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6a9d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93a5 expref: 257 pid: 6523 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343035.744156:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3059 00000100:00100000:1.0:1763343035.744168:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:2429:x1848997993552000:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343035.744192:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343035.744200:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6a9d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93a5 expref: 257 pid: 6523 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.744215:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6a9d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93a5 expref: 257 pid: 6523 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.744244:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6a9d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93a5 expref: 257 pid: 6523 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.744267:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3403aabc00) 00010000:00010000:1.0:1763343035.744274:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6ab2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.744286:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6ab2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.744294:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6ab2 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343035.744340:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343035.744419:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:2429:x1848997993552000:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 252us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.744427:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3059 00010000:00010000:2.0:1763343035.744993:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6ab2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.745004:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6ab2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343035.745037:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1df:0x0]: returning size 0 00000004:00080000:2.0:1763343035.745336:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2a3:0x0], index 0: 0 00000004:00080000:2.0:1763343035.745345:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2a5:0x0], index 1: 0 00000004:00080000:2.0:1763343035.745350:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2a6:0x0], index 1: 0 00000004:00080000:2.0:1763343035.745356:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2a4:0x0], index 0: 0 00010000:00010000:2.0:1763343035.745507:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6ab2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.745517:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6ab2 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.745525:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6ab2 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.745531:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.745538:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6ab2 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.745546:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6ab2 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.745561:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3403aabc00) 00010000:00010000:2.0:1763343035.745564:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343035.745569:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6ab2 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.745575:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6ab2 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.745706:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6aab lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1df:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93ac expref: 256 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.745717:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3403aabc00) 00010000:00010000:2.0:1763343035.745720:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343035.745724:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6aab lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1df:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93ac expref: 256 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.745742:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:2.0:1763343035.745808:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56877:x1848997993551872:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 13840us (14984us total) trans 8589939953 rc 301/301 00000100:00100000:2.0:1763343035.745817:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9293 00000100:00100000:0.0:1763343035.749438:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.749545:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993552256 00000100:00100000:3.0:1763343035.749560:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993552256 00000100:00100000:2.0:1763343035.749836:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3166 00000100:00100000:2.0:1763343035.749851:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56877:x1848997993552256:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343035.750255:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56877:x1848997993552256:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 407us (832us total) trans 8589939954 rc 0/0 00000100:00100000:2.0:1763343035.750270:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3166 00000100:00100000:0.0:1763343035.755508:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.755562:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.755717:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993552512 00000100:00100000:2.0:1763343035.755732:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993552512 00000100:00100000:2.0:1763343035.755798:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9294 00000100:00100000:2.0:1763343035.755810:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56878:x1848997993552512:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.755841:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.755871:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6ac0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac93b3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.755993:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6ac7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756012:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756026:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756038:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6ace lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756047:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6ace lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756053:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6ace lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756195:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6ad5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756204:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756216:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343035.756229:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1df:0x0]: returning size 0 00010000:00010000:2.0:1763343035.756351:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6ac7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756359:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6ac7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756366:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756373:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6ac7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756379:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.756384:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6ac7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756392:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6ac7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756405:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3503a3ad00) 00010000:00010000:2.0:1763343035.756409:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.756415:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6ac7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756421:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6ac7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756438:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6ace lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756447:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6ace lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756453:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6ace lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756458:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.756461:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6ace lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756466:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6ace lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756473:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c2300) 00010000:00010000:2.0:1763343035.756475:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.756478:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6ace lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756484:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6ace lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.756528:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6ac0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93b3 expref: 259 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.756548:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93b3 expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.756554:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:2.0:1763343035.756556:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343035.756559:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352cc00, rc 0) 00000100:00100000:2.0:1763343035.756697:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56878:x1848997993552512:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 888us (1215us total) trans 8589939955 rc 0/0 00000100:00100000:2.0:1763343035.756707:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9294 00000100:00100000:1.0:1763343035.756857:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993552768 00000100:00100000:1.0:1763343035.756865:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993552768 00000100:00100000:1.0:1763343035.756922:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3167 00000100:00100000:1.0:1763343035.756932:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56877:x1848997993552768:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343035.757084:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56877:x1848997993552768:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 153us (1521us total) trans 8589939956 rc 0/0 00000100:00100000:1.0:1763343035.757093:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3167 00000100:00100000:1.0:1763343035.762767:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.762814:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.762855:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.762957:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993553152 00000100:00100000:0.0:1763343035.762970:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993553152 00000100:00100000:0.0:1763343035.763047:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9295 00000100:00100000:0.0:1763343035.763058:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:55941:x1848997993553152:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343035.763089:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.763115:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6ae3 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac93c8 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.763159:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6aea lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.763175:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6aea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.763189:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6aea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.763338:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6ae3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93c8 expref: 261 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.763359:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6aea lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93c8 expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.763373:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:0.0:1763343035.763377:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343035.763381:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137800, rc 0) 00000100:00100000:0.0:1763343035.763456:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:55941:x1848997993553152:12345-192.168.204.21@tcp:101:bash.0 Request processed in 399us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.763465:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9295 00000100:00100000:3.0:1763343035.763731:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993552896 00000100:00100000:3.0:1763343035.763738:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993552896 00000100:00100000:3.0:1763343035.763783:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993553024 00000100:00100000:3.0:1763343035.763786:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993553024 00000100:00100000:3.0:1763343035.763809:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6522 00000100:00100000:3.0:1763343035.763816:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993552896:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.763827:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.763845:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6af1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac93ba expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343035.763869:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343035.763886:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.763889:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.763897:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6af1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93ba expref: 32 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343035.763928:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6af1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93ba expref: 32 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343035.763941:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343035.763975:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2430:x1848997993552896:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 158us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.763982:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6522 00000100:00100000:3.0:1763343035.763997:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6523 00000100:00100000:3.0:1763343035.764003:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993553024:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.764012:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.764024:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae6af8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac93c1 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343035.764040:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343035.764051:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.764053:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.764057:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae6af8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93c1 expref: 17 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343035.764067:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae6af8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93c1 expref: 17 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343035.764075:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343035.764096:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993553024:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 92us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.764106:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6523 00000100:00100000:0.0:1763343035.767856:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.768204:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.768728:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993553408 00000100:00100000:2.0:1763343035.768745:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993553408 00000100:00100000:2.0:1763343035.768819:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993553664 00000100:00100000:2.0:1763343035.768823:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993553664 00000100:00100000:2.0:1763343035.768855:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9296 00000100:00100000:2.0:1763343035.768866:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56878:x1848997993553408:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.768896:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.768936:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6aff lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac93cf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.769115:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6b06 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.769140:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6b06 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1df:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.769155:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6b06 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1df:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343035.769173:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1df:0x0]: returning size 0 00010000:00010000:2.0:1763343035.769359:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6aff lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1df:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93cf expref: 264 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.769384:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6b06 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1df:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93cf expref: 263 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.769395:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:2.0:1763343035.769399:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763343035.769405:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c200, rc 0) 00000100:00100000:2.0:1763343035.769485:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56878:x1848997993553408:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 620us (1643us total) trans 8589939957 rc 0/0 00000100:00100000:2.0:1763343035.769494:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9296 00000100:00100000:2.0:1763343035.769520:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9297 00000100:00100000:2.0:1763343035.769527:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993553664:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:2.0:1763343035.769553:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343035.769571:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6ad5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93b3 expref: 262 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.769582:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:2.0:1763343035.769585:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343035.769756:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6b14 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.769767:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6b14 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1df:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.769774:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6b14 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1df:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000001:00080000:2.0:1763343035.769827:0:6523:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939958 00000004:00010000:2.0:1763343035.769852:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000517e34b0 reply state 000000004ce5da35 transno 8589939959 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6b14 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1df:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.769866:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6b14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1df:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343035.769872:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:2.0:1763343035.769875:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343035.769878:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343035.769950:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993553664:12345-192.168.204.21@tcp:36:bash.0 Request processed in 421us (1744us total) trans 8589939959 rc 0/0 00000100:00100000:2.0:1763343035.769957:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9297 00000020:00080000:2.0:1763343035.769961:0:6523:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343035.774356:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.774463:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993553792 00000100:00100000:1.0:1763343035.774476:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993553792 00000100:00100000:1.0:1763343035.774548:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9298 00000100:00100000:1.0:1763343035.774560:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993553792:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343035.774587:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.774617:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6b1b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac93d6 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.774720:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6b1b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93d6 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.774737:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6b1b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93d6 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.774759:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:1.0:1763343035.774763:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343035.774768:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00000100:00100000:1.0:1763343035.774842:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993553792:12345-192.168.204.21@tcp:101:bash.0 Request processed in 284us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.774850:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9298 00000100:00100000:3.0:1763343035.776130:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.777100:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993553920 00000100:00100000:0.0:1763343035.777116:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993553920 00000100:00100000:0.0:1763343035.778175:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9299 00000100:00100000:0.0:1763343035.778197:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56878:x1848997993553920:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.778231:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.778260:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6b22 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac93dd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.778403:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6b29 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.778421:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6b29 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.778436:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6b29 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343035.778472:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1df:0x0]: returning size 0 00000004:00200000:0.0:1763343035.778478:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343035.778504:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6b29 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.778536:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6b22 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1df:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93dd expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.778558:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6b29 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93dd expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.778568:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:0.0:1763343035.778571:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343035.778576:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137c00, rc 0) 00000100:00100000:0.0:1763343035.778697:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56878:x1848997993553920:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 506us (2578us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.778705:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9299 00000100:00100000:2.0:1763343035.784450:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.787050:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.787140:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993554432 00000100:00100000:3.0:1763343035.787155:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993554432 00000100:00100000:3.0:1763343035.787238:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3168 00000100:00100000:3.0:1763343035.787250:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56878:x1848997993554432:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343035.788196:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993554176 00000100:00100000:0.0:1763343035.788207:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993554176 00000100:00100000:0.0:1763343035.788289:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9300 00000100:00100000:0.0:1763343035.788299:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:55941:x1848997993554176:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343035.788315:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.788319:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1763343035.788353:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6b1b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93d6 expref: 268 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.788379:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6b06 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1df:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93cf expref: 267 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.788392:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:0.0:1763343035.788399:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343035.788417:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae6b30 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac93e4 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.788467:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6b37 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.788482:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6b29 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93dd expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.788491:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6b37 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1df:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.788532:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6b29 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93dd expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.788546:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6b29 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93dd expref: 267 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:0.0:1763343035.788563:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010264832:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343035.788900:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56878:x1848997993554432:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1650us (1861us total) trans 8589939960 rc 0/0 00000100:00100000:2.0:1763343035.788918:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3168 00000100:00100000:0.0:1763343035.789165:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3508539300 going to sleep for 11 seconds 00000100:00100000:0.0:1763343035.795189:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010264832:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343035.795230:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6b37 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1df:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343035.796645:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.797444:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.797692:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993554688 00000100:00100000:1.0:1763343035.797704:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993554688 00000100:00100000:1.0:1763343035.797772:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9301 00000100:00100000:1.0:1763343035.797784:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56878:x1848997993554688:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.797811:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.797839:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6b3e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac93eb expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.797955:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6b45 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.797972:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6b45 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.797985:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6b45 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.797997:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6b4c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798004:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6b4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798011:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6b4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798150:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6b53 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798160:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6b53 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798167:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6b53 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343035.798180:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1df:0x0]: returning size 0 00010000:00010000:1.0:1763343035.798289:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6b53 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798298:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6b53 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798306:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6b53 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798312:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.798317:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6b53 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798325:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6b53 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798339:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:1.0:1763343035.798342:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1763343035.798349:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6b53 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798355:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6b53 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798374:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6b45 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798379:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6b45 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798385:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6b45 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798391:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.798393:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6b45 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798404:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6b45 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798411:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab000) 00010000:00010000:1.0:1763343035.798414:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.798418:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6b45 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798438:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6b45 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798447:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6b4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798453:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6b4c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798459:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6b4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798465:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.798467:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6b4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798473:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6b4c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798479:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c2300) 00010000:00010000:1.0:1763343035.798482:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.798485:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6b4c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798491:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6b4c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.798535:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6b3e lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93eb expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.798547:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab000) 00010000:00010000:1.0:1763343035.798551:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343035.798554:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6b3e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93eb expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.798569:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343035.798693:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56878:x1848997993554688:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 910us (2080us total) trans 8589939961 rc 301/301 00000100:00100000:1.0:1763343035.798702:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9301 00000100:00100000:0.0:1763343035.798828:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993554816 00000100:00100000:0.0:1763343035.798836:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993554816 00010000:00010000:0.0:1763343035.798866:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6b29 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93dd expref: 268 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:0.0:1763343035.798902:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3060 00000100:00100000:0.0:1763343035.798919:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:2430:x1848997993554816:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343035.798933:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343035.798940:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6b29 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93dd expref: 268 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.798953:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6b29 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93dd expref: 268 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.798968:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6b29 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93dd expref: 268 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.798980:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:0.0:1763343035.798983:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6b37 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1df:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.798992:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6b37 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.798999:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6b37 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.799028:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343035.799057:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:2430:x1848997993554816:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 146us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.799064:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3060 00010000:00010000:0.0:1763343035.799090:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6b37 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.799098:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6b37 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000040:00080000:0.0:1763343035.799340:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1422, 88 off120176 00000004:00080000:0.0:1763343035.799349:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1229466727856ns, next at 1229609967587ns, rc = 0 00000040:00080000:0.0:1763343035.799417:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1423, 88 off120176 00000004:00080000:0.0:1763343035.799422:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1229466801411ns, next at 1229610036645ns, rc = 0 00000040:00080000:0.0:1763343035.799466:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1424, 88 off120264 00000004:00080000:0.0:1763343035.799471:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1229466850021ns, next at 1229610036645ns, rc = 0 00000040:00080000:0.0:1763343035.799487:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1423, 88 off120264 00000004:00080000:0.0:1763343035.799491:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1229466870596ns, next at 1229609967587ns, rc = 0 00000100:00100000:3.0:1763343035.804577:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:0.0:1763343035.804889:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343035.804992:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993555072 00000100:00100000:2.0:1763343035.805007:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993555072 00000100:00100000:2.0:1763343035.805084:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3169 00000100:00100000:2.0:1763343035.805096:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56878:x1848997993555072:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343035.808735:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56878:x1848997993555072:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 3625us (4157us total) trans 8589939963 rc 0/0 00000100:00100000:2.0:1763343035.808752:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3169 00000001:00080000:0.0:1763343035.813562:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939962 is committed 00000004:00080000:0.0:1763343035.813582:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 937 committed 00000004:00080000:0.0:1763343035.813601:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 936 committed 00000004:00080000:0.0:1763343035.813614:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 935 committed 00000004:00080000:0.0:1763343035.813616:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 936 committed 00000100:00100000:2.0:1763343035.813787:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.813829:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993555200 00000100:00100000:2.0:1763343035.813838:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993555200 00000100:00100000:0.0:1763343035.813868:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010264960:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343035.813905:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3170 00000100:00100000:2.0:1763343035.813929:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fbac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56878:x1848997993555200:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:0.0:1763343035.813941:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343035.813978:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343035.813984:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010265088:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343035.814002:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343035.814031:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010265216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343035.814050:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343035.814066:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343035.814071:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010265344:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763343035.814155:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae69fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.814169:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae69fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.814178:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae69fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.814184:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.814190:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae69fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.814198:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae69fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343035.814205:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fbac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56878:x1848997993555200:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 277us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343035.814216:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3170 00010000:00010000:3.0:1763343035.814220:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c2300) 00010000:00010000:3.0:1763343035.814226:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.814233:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae69fc lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.814239:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae69fc lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.814260:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6a96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.814266:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6a96 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.814272:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6a96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.814278:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.814281:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6a96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.814286:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6a96 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.814294:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c2300) 00010000:00010000:3.0:1763343035.814297:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.814300:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6a96 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.814306:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6a96 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.814329:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6b14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1df:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.814335:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6b14 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1df:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.814342:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6b14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1df:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.814351:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.814353:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6b14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1df:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.814359:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6b14 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1df:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.814367:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:3.0:1763343035.814369:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.814477:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6b14 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1df:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343035.814485:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6b14 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1df:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:1.0:1763343035.814722:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010264960 00000100:00100000:1.0:1763343035.814728:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010264960 00000100:00100000:1.0:1763343035.814760:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010265088 00000100:00100000:1.0:1763343035.814763:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010265088 00000100:00100000:1.0:1763343035.814788:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010265216 00000100:00100000:1.0:1763343035.814791:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010265216 00000100:00100000:1.0:1763343035.814809:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6524 00000100:00100000:1.0:1763343035.814816:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:3659:x1848998010264960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763343035.814837:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:675 count 1 00010000:00010000:1.0:1763343035.814866:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae6b61 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.814887:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae69af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9358 expref: 31 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.814895:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343035.814899:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343035.814903:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae6b61 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.814944:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae69af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9358 expref: 31 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.814961:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae69af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9358 expref: 31 pid: 28993 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343035.814977:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406551180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1848998010265984:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343035.814978:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6525 00000100:00100000:2.0:1763343035.814990:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+51:3659:x1848998010265088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343035.815005:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:676 count 1 00010000:00010000:2.0:1763343035.815021:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae6b68 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.815035:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6900 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9327 expref: 31 pid: 28994 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1763343035.815039:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe900 going to sleep for 11 seconds 00010000:00010000:2.0:1763343035.815043:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.815047:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.815050:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae6b68 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343035.815065:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010265856:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1763343035.815072:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6900 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9327 expref: 31 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343035.815083:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6900 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9327 expref: 31 pid: 28994 timeout: 1329 lvb_type: 1 00000100:00100000:2.0:1763343035.815095:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010266112:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343035.815102:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343035.815130:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726240 going to sleep for 11 seconds 00000100:00100000:2.0:1763343035.815151:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010265856 00000100:00100000:2.0:1763343035.815155:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010265856 00000100:00100000:2.0:1763343035.815188:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6526 00000100:00100000:3.0:1763343035.815199:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6527 00000100:00100000:2.0:1763343035.815199:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3657:x1848998010265216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343035.815216:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3658:x1848998010265856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343035.815354:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2a4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343035.815358:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2a4:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343035.815360:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2a4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343035.815367:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2a4:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343035.815370:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2a4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343035.815502:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343035.815510:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010265728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343035.815535:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343035.815609:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6b37 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1df:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93e4 expref: 246 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.815640:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:1.0:1763343035.815643:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343035.815660:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae6b30 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93e4 expref: 246 pid: 6525 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343035.815676:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6b37 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1df:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93e4 expref: 245 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.815705:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:1.0:1763343035.815708:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343035.815710:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137200, rc 0) 00000100:00100000:1.0:1763343035.815735:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:55941:x1848997993554176:12345-192.168.204.21@tcp:101:bash.0 Request processed in 27438us (31303us total) trans 8589939962 rc 0/0 00000100:00100000:1.0:1763343035.815742:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9300 00000100:00100000:1.0:1763343035.815787:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010265472:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343035.815811:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343035.815833:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343035.815839:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010265600:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343035.815860:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343035.815887:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010265728 00000100:00100000:1.0:1763343035.815891:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010265728 00000100:00100000:1.0:1763343035.815923:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010265472 00000100:00100000:1.0:1763343035.815926:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010265472 00000100:00100000:1.0:1763343035.815937:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010265600 00000100:00100000:1.0:1763343035.815939:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010265600 00000100:00100000:1.0:1763343035.815949:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6528 00000100:00100000:1.0:1763343035.815954:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3658:x1848998010265728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343035.816047:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3658:x1848998010265728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (510us total) trans 21474838893 rc 0/0 00000100:00100000:1.0:1763343035.816053:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6528 00000100:00100000:1.0:1763343035.816067:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6529 00000100:00100000:1.0:1763343035.816073:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3659:x1848998010265472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343035.816086:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:673 count 1 00010000:00010000:1.0:1763343035.816100:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae6b6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.816114:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae69bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9366 expref: 16 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.816121:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343035.816123:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343035.816126:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae6b6f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.816148:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae69bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9366 expref: 16 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.816158:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae69bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9366 expref: 16 pid: 28996 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343035.816169:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406551f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010266240:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343035.816202:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abed80 going to sleep for 11 seconds 00000004:00080000:1.0:1763343035.816238:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406552680/2, rc 0, transno 21474838893 00000100:00100000:1.0:1763343035.816244:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010265728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343035.816360:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343035.817665:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3658:x1848998010265856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2446us (2557us total) trans 21474838892 rc 0/0 00000100:00100000:3.0:1763343035.817679:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6527 00000100:00100000:3.0:1763343035.817711:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010265344 00000100:00100000:3.0:1763343035.817719:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010265344 00000100:00100000:3.0:1763343035.817751:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6530 00000100:00100000:3.0:1763343035.817758:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3659:x1848998010265600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343035.817790:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:674 count 1 00010000:00010000:3.0:1763343035.817814:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6b76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.817835:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae68f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9320 expref: 16 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343035.817844:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.817845:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.817848:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6b76 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.817885:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae68f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9320 expref: 16 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343035.817898:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae68f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9320 expref: 16 pid: 28994 timeout: 1329 lvb_type: 1 00000100:00100000:3.0:1763343035.817927:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010266368:192.168.204.21@tcp:104: 00000004:00080000:0.0:1763343035.818109:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406550e00/2, rc 0, transno 21474838892 00000100:00100000:0.0:1763343035.818117:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010265856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343035.818894:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509bdff00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343035.818940:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6531 00000100:00100000:3.0:1763343035.818955:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e9cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3657:x1848998010265344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343035.819064:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3657:x1848998010265216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3868us (5011us total) trans 17179871594 rc 0/0 00000100:00100000:2.0:1763343035.819076:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6526 00000004:00080000:0.0:1763343035.820143:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b2680/2, rc 0, transno 17179871594 00000100:00100000:0.0:1763343035.820156:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010265216:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343035.821901:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2a6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343035.821923:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2a6:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343035.821926:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2a6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343035.821928:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2a6:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343035.821930:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2a6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343035.822034:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e9cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3657:x1848998010265344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3079us (5669us total) trans 17179871595 rc 0/0 00000100:00100000:3.0:1763343035.822048:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6531 00000004:00080000:0.0:1763343035.822603:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b1880/2, rc 0, transno 17179871595 00000100:00100000:0.0:1763343035.822614:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010265344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343035.830752:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.830797:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993555456 00000100:00100000:3.0:1763343035.830810:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993555456 00000100:00100000:3.0:1763343035.830876:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9302 00000100:00100000:3.0:1763343035.830887:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56879:x1848997993555456:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.830931:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.830973:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6b7d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac93f2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.831075:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6b84 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.831091:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6b84 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00000100:00100000:0.0:1763343035.831100:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406551180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1848998010265984:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343035.831104:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6b84 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.831116:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6b8b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.831122:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6b8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.831127:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6b8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.831129:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae6b61 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343035.831763:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010266112:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343035.831782:0:8408:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae6b68 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343035.832022:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.832053:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.832090:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993555584 00000100:00100000:1.0:1763343035.832091:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.832098:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993555584 00010000:00010000:0.0:1763343035.832130:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae69af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9358 expref: 32 pid: 28993 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343035.832138:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406551f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010266240:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343035.832154:0:28648:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae6b6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343035.832158:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993555712 00000100:00100000:0.0:1763343035.832162:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993555712 00010000:00010000:0.0:1763343035.832173:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6900 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9327 expref: 33 pid: 28994 timeout: 1329 lvb_type: 1 00000100:00100000:0.0:1763343035.832194:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3061 00000100:00100000:0.0:1763343035.832203:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+33:2431:x1848997993555584:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763343035.832204:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:0.0:1763343035.832217:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343035.832222:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae69af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9358 expref: 33 pid: 28993 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.832234:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae69af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9358 expref: 33 pid: 28993 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343035.832247:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:0.0:1763343035.832260:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae69af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9358 expref: 33 pid: 28993 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.832345:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.832347:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.832353:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae6b61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.832362:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae6b61 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.832400:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343035.832460:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2431:x1848997993555584:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 257us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.832467:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3061 00000100:00100000:0.0:1763343035.832484:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993555968 00000100:00100000:0.0:1763343035.832487:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993555968 00010000:00010000:0.0:1763343035.832500:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae69bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9366 expref: 17 pid: 28996 timeout: 1329 lvb_type: 0 00000100:00100000:0.0:1763343035.832563:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993556096 00000100:00100000:0.0:1763343035.832566:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993556096 00010000:00010000:0.0:1763343035.832579:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae68f9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9320 expref: 18 pid: 28994 timeout: 1329 lvb_type: 1 00000100:00100000:0.0:1763343035.832592:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3062 00000100:00100000:0.0:1763343035.832597:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2431:x1848997993555712:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343035.832605:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343035.832609:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6900 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9327 expref: 31 pid: 28994 timeout: 1329 lvb_type: 1 00010000:00010000:0.0:1763343035.832647:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6900 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9327 expref: 31 pid: 28994 timeout: 1329 lvb_type: 1 00000100:00100000:3.0:1763343035.832754:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3063 00000100:00100000:3.0:1763343035.832765:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993555968:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343035.832776:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343035.832782:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae69bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9366 expref: 18 pid: 28996 timeout: 1329 lvb_type: 0 00010000:00010000:3.0:1763343035.832792:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae69bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9366 expref: 18 pid: 28996 timeout: 1329 lvb_type: 0 00010000:00010000:3.0:1763343035.832808:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae69bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9366 expref: 18 pid: 28996 timeout: 1329 lvb_type: 0 00010000:00010000:3.0:1763343035.832818:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.832820:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.832890:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae6b6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.832900:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae6b6f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.832930:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343035.832954:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993555968:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 192us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.832961:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3063 00000100:00100000:3.0:1763343035.832976:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3064 00000100:00100000:3.0:1763343035.832983:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3508044450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993556096:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343035.832991:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343035.832996:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae68f9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9320 expref: 16 pid: 28994 timeout: 1329 lvb_type: 1 00010000:00010000:3.0:1763343035.833011:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae68f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9320 expref: 16 pid: 28994 timeout: 1329 lvb_type: 1 00010000:00010000:3.0:1763343035.833024:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.833026:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.833029:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6b76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.833038:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6b76 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.833049:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343035.833066:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3508044450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993556096:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 84us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.833073:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3064 00010000:00010000:3.0:1763343035.833095:0:28648:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae6b6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.833104:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae6b6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.833115:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae6b6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.833124:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae6b6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.833150:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343035.833440:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3659:x1848998010265472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17365us (17625us total) trans 21474838894 rc 0/0 00000100:00100000:3.0:1763343035.833450:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6529 00000100:00100000:3.0:1763343035.833467:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993555840 00000100:00100000:3.0:1763343035.833473:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993555840 00000100:00100000:3.0:1763343035.833501:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6532 00000100:00100000:3.0:1763343035.833508:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:55941:x1848997993555840:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343035.833523:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.833543:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae6b99 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac93f9 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343035.833565:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343035.833580:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.833582:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343035.833589:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae6b99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93f9 expref: 17 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.833602:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae6b99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93f9 expref: 17 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.833614:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403528e00, rc 0) 00000100:00100000:3.0:1763343035.833670:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993555840:12345-192.168.204.21@tcp:101:bash.0 Request processed in 162us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343035.833677:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6532 00000004:00080000:3.0:1763343035.833728:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406553480/2, rc 0, transno 21474838894 00000100:00100000:3.0:1763343035.833736:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010265472:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1763343035.833778:0:27835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae68f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9320 expref: 16 pid: 28994 timeout: 1329 lvb_type: 1 00000100:00100000:3.0:1763343035.833789:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010266368:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343035.833809:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6b76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.833818:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6b76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.833825:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6b76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.833833:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6b76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.833840:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6b76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.833858:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343035.834003:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3659:x1848998010265600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16244us (18141us total) trans 21474838895 rc 0/0 00000100:00100000:3.0:1763343035.834010:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6530 00010000:00010000:3.0:1763343035.834030:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343035.834038:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae6b6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.834051:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343035.834056:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae6b6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.834066:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae6b6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.834080:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae6b6f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.834087:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae6b6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.834104:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343035.834107:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6b76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.834114:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343035.834117:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6b76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.834125:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6b76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.834134:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6b76 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.834145:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6b76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.834156:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343035.834157:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343035.834159:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343035.834177:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406552300/2, rc 0, transno 21474838895 00000100:00100000:3.0:1763343035.834182:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010265600:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763343035.834285:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae6b92 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834301:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae6b92 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834311:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae6b92 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343035.834329:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1df:0x0]: returning size 2 00010000:00010000:2.0:1763343035.834426:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6b84 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834433:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6b84 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834439:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6b84 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834445:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6b84 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834450:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.834454:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6b84 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834460:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6b84 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834472:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8a00) 00010000:00010000:2.0:1763343035.834476:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.834479:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6b84 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834485:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6b84 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834496:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6b8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834502:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6b8b lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834507:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6b8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834512:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.834515:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6b8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834520:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6b8b lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834528:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8c00) 00010000:00010000:2.0:1763343035.834530:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.834534:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6b8b lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834539:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6b8b lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.834597:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6b7d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93f2 expref: 248 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.834614:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae6b92 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93f2 expref: 247 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.834659:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:2.0:1763343035.834662:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343035.834664:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403528c00, rc 0) 00000100:00100000:2.0:1763343035.834713:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56879:x1848997993555456:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3827us (3976us total) trans 8589939964 rc 0/0 00000100:00100000:2.0:1763343035.834720:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9302 00010000:00010000:1.0:1763343035.835332:0:8410:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae6b61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.835346:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae6b61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.835356:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae6b61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.835365:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae6b61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.835390:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343035.835652:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3659:x1848998010264960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20835us (21709us total) trans 17179871596 rc 0/0 00000100:00100000:1.0:1763343035.835661:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6524 00010000:00010000:1.0:1763343035.835748:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343035.835755:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae6b61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.835763:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343035.835768:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae6b61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.835782:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae6b61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.835800:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae6b61 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.835806:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae6b61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.835824:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343035.835826:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343035.835827:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343035.835900:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6900 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9327 expref: 31 pid: 28994 timeout: 1329 lvb_type: 1 00010000:00010000:0.0:1763343035.835927:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.835929:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343035.835935:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae6b68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.835945:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae6b68 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.835985:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343035.836024:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2431:x1848997993555712:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 3425us (3974us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.836034:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3062 00010000:00010000:2.0:1763343035.836094:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343035.836779:0:8408:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae6b68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.836800:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae6b68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.836813:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae6b68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.836821:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae6b68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.836851:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343035.837134:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3659:x1848998010265088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22143us (23126us total) trans 17179871597 rc 0/0 00000100:00100000:1.0:1763343035.837149:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6525 00010000:00010000:0.0:1763343035.838947:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343035.838967:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae6b68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.838981:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343035.838986:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae6b68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.839004:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae6b68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.839032:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae6b68 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.839039:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae6b68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.839068:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343035.839070:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343035.839072:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763343035.839345:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b1180/2, rc 0, transno 17179871597 00000100:00100000:2.0:1763343035.839357:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010265088:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1763343035.839369:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b3480/2, rc 0, transno 17179871596 00000100:00100000:2.0:1763343035.839373:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010264960:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343035.841710:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.841769:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.841888:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993556224 00000100:00100000:0.0:1763343035.841888:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993556480 00000100:00100000:2.0:1763343035.841906:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993556224 00000100:00100000:0.0:1763343035.841907:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993556480 00000100:00100000:0.0:1763343035.842014:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3171 00000100:00100000:2.0:1763343035.842024:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6533 00000100:00100000:0.0:1763343035.842030:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56879:x1848997993556480:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343035.842044:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:55941:x1848997993556224:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343035.842064:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.842096:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352de00/0x607405d401ae6ba7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9400 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343035.842128:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343035.842152:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.842155:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343035.842168:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352de00/0x607405d401ae6ba7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9400 expref: 31 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.842186:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352de00/0x607405d401ae6ba7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9400 expref: 31 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.842201:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352de00, rc 0) 00000100:00100000:0.0:1763343035.842278:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56879:x1848997993556480:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 253us (507us total) trans 8589939965 rc 0/0 00000100:00100000:0.0:1763343035.842288:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3171 00000100:00100000:2.0:1763343035.842576:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:55941:x1848997993556224:12345-192.168.204.21@tcp:101:bash.0 Request processed in 535us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343035.842585:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6533 00000100:00100000:1.0:1763343035.846297:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.846345:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.847397:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993556608 00000100:00100000:0.0:1763343035.847399:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993556736 00000100:00100000:2.0:1763343035.847414:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993556608 00000100:00100000:0.0:1763343035.847417:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993556736 00002000:00010000:2.0:1763343035.847478:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/675 (0->18446744073709551615) 00002000:00010000:0.0:1763343035.847479:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/677 (0->18446744073709551615) 00002000:00100000:0.0:1763343035.847486:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406551c00 with x1848997993556736 ext(0->18446744073709551615) 00002000:00100000:2.0:1763343035.847496:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406550000 with x1848997993556608 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343035.847500:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3406551c00. 00002000:00010000:2.0:1763343035.847509:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406550000. 00000100:00100000:0.0:1763343035.847541:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1594 00000100:00100000:0.0:1763343035.847611:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2429:x1848997993556736:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343035.847809:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2a5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343035.847813:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2a5:0x0] updating lvb mtime from disk: 0 -> 1763343035 00002000:00010000:0.0:1763343035.847815:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2a5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343035.847818:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2a5:0x0] updating lvb ctime from disk: 0 -> 1763343035 00002000:00010000:0.0:1763343035.847821:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2a5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343035.847881:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1595 00000100:00100000:0.0:1763343035.847892:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2429:x1848997993556736:12345-192.168.204.21@tcp:10:bash.0 Request processed in 339us (1542us total) trans 17179871598 rc 0/0 00000100:00100000:2.0:1763343035.847900:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993556608:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:0.0:1763343035.847932:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1594 00002000:00010000:0.0:1763343035.847937:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/677 (0->18446744073709551615) 00002000:00100000:0.0:1763343035.847941:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406551c00 with x1848997993556736 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343035.847947:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3406551c00. 00002000:00010000:2.0:1763343035.848101:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2a3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343035.848106:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2a3:0x0] updating lvb mtime from disk: 0 -> 1763343035 00002000:00010000:2.0:1763343035.848108:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343035.848111:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2a3:0x0] updating lvb ctime from disk: 0 -> 1763343035 00002000:00010000:2.0:1763343035.848114:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2a3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343035.848161:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993556608:12345-192.168.204.21@tcp:10:bash.0 Request processed in 269us (1879us total) trans 21474838896 rc 0/0 00000100:00100000:2.0:1763343035.848169:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1595 00002000:00010000:2.0:1763343035.848173:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/675 (0->18446744073709551615) 00002000:00100000:2.0:1763343035.848177:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406550000 with x1848997993556608 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343035.848182:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406550000. 00000100:00100000:0.0:1763343035.858795:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.858923:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993556992 00000100:00100000:1.0:1763343035.858936:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993556992 00000100:00100000:1.0:1763343035.859180:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3172 00000100:00100000:1.0:1763343035.859193:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:55941:x1848997993556992:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:1.0:1763343035.860090:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:55941:x1848997993556992:12345-192.168.204.21@tcp:35:bash.0 Request processed in 896us (1305us total) trans 8589939966 rc 0/0 00000100:00100000:1.0:1763343035.860102:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3172 00000100:00100000:2.0:1763343035.871282:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.872236:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.872322:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993557504 00000100:00100000:2.0:1763343035.872336:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993557504 00000100:00100000:2.0:1763343035.872409:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993557248 00000100:00100000:2.0:1763343035.872412:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993557248 00000100:00100000:2.0:1763343035.872443:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9303 00000100:00100000:2.0:1763343035.872452:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56881:x1848997993557504:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:2.0:1763343035.872529:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343035.872569:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6b37 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1df:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93e4 expref: 250 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.872597:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae6b92 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93f2 expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.872612:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6aea lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1df:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93c8 expref: 248 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.872676:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3a800) 00010000:00010000:2.0:1763343035.872691:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343035.872727:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6bae lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.872742:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6bae lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.872758:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6bae lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.872772:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6bb5 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.872780:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.872787:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.872882:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6bbc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.872889:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6bbc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.872895:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6bbc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000040:00080000:2.0:1763343035.873224:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1424, 64 off120328 00000040:00080000:2.0:1763343035.873250:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1425, 64 off120328 00000040:00080000:2.0:1763343035.873258:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1426, 64 off120392 00000040:00080000:2.0:1763343035.873265:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1425, 64 off120392 00010000:00010000:2.0:1763343035.873320:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6bc3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873329:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873336:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873343:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6bc3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873349:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6bc3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873359:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6bc3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873380:0:10041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343035.873400:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6bbc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873405:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6bbc lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873412:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6bbc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873417:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.873421:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6bbc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873428:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6bbc lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873435:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3aa00) 00010000:00010000:2.0:1763343035.873438:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343035.873441:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6bbc lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873447:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6bbc lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1df:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873581:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6bae lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873587:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6bae lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873596:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6bae lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873602:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6bae lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873606:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.873608:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6bae lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873614:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6bae lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873654:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:2.0:1763343035.873656:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.873660:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6bae lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873665:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6bae lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00010000:2.0:1763343035.873678:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000209d9e30 reply state 000000003ce36ed6 transno 8589939967 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873689:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6bb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.873694:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a900) 00010000:00010000:2.0:1763343035.873696:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343035.873700:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343035.873792:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56881:x1848997993557504:12345-192.168.204.21@tcp:36:rm.0 Request processed in 1337us (2528us total) trans 8589939967 rc 0/0 00000100:00100000:2.0:1763343035.873804:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9303 00000100:00100000:2.0:1763343035.873838:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9304 00000100:00100000:2.0:1763343035.873848:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56880:x1848997993557248:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.873864:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.873874:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6bca lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9407 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.873999:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6bca lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1df:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9407 expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.874010:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3aa00) 00010000:00010000:2.0:1763343035.874013:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343035.874016:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6bca lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1df:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9407 expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.874026:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c200, rc 0) 00000100:00100000:2.0:1763343035.874048:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56880:x1848997993557248:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 203us (1819us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343035.874055:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9304 00010000:00010000:2.0:1763343035.874086:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343035.874093:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6bc3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.874099:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343035.874103:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6bc3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.874109:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6bc3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.874118:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1df:0x0].0x0 (ffff9a3503a3aa00) 00010000:00010000:2.0:1763343035.874121:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343035.874124:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6bc3 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.874129:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6bc3 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1df:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.874142:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343035.874144:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343035.874146:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343035.880901:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.881113:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993557760 00000100:00100000:1.0:1763343035.881127:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993557760 00000100:00100000:1.0:1763343035.881206:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9305 00000100:00100000:1.0:1763343035.881218:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56880:x1848997993557760:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.881250:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.881282:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6bd1 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac940e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.881380:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6bd8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881398:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6bd8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881412:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6bd8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881428:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6bdf lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881437:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6bdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881443:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6bdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881498:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6bd8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881506:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6bd8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881512:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6bd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881518:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6bd8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881524:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.881529:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6bd8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881536:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6bd8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881549:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab000) 00010000:00010000:1.0:1763343035.881553:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.881557:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6bd8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881563:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6bd8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881578:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6bdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881584:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6bdf lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881590:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6bdf lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881594:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.881598:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6bdf lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881603:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6bdf lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881609:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a900) 00010000:00010000:1.0:1763343035.881612:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.881615:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6bdf lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881650:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6bdf lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.881683:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6bd1 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac940e expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.881694:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab000) 00010000:00010000:1.0:1763343035.881696:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343035.881700:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6bd1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac940e expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.881719:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343035.882555:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56880:x1848997993557760:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1334us (1664us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343035.882566:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9305 00000100:00100000:2.0:1763343035.885580:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.885753:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993557888 00000100:00100000:1.0:1763343035.885765:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993557888 00000100:00100000:3.0:1763343035.886398:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9306 00000100:00100000:3.0:1763343035.886414:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56880:x1848997993557888:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.886441:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.886468:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae6be6 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9415 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.886557:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae6bed lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886573:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae6bed lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886585:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae6bed lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886595:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6bf4 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886602:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886612:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886689:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae6bed lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886697:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae6bed lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886704:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae6bed lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886710:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403528c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.886715:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae6bed lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886723:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae6bed lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886735:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8800) 00010000:00010000:3.0:1763343035.886739:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.886744:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae6bed lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886750:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae6bed lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886763:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886768:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6bf4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886773:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886779:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.886782:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886787:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6bf4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886793:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a900) 00010000:00010000:3.0:1763343035.886795:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.886798:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6bf4 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886802:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae6bf4 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.886828:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae6be6 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9415 expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.886837:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8800) 00010000:00010000:3.0:1763343035.886840:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.886843:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae6be6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9415 expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.886856:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403529e00, rc 0) 00000100:00100000:3.0:1763343035.888034:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56880:x1848997993557888:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1614us (2458us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343035.888049:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9306 00000100:00100000:0.0:1763343035.892587:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.892687:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993558016 00000100:00100000:3.0:1763343035.892701:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993558016 00000100:00100000:3.0:1763343035.892780:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9307 00000100:00100000:3.0:1763343035.892794:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56882:x1848997993558016:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.892823:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.892854:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6bfb lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac941c expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.892962:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6c02 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.892980:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6c02 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.892994:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6c02 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893006:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6c09 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893013:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6c09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893028:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6c09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893078:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6c02 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893086:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6c02 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893092:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6c02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893098:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.893104:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6c02 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893111:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6c02 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893124:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8e00) 00010000:00010000:3.0:1763343035.893128:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.893133:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6c02 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893139:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae6c02 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893152:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6c09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893157:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6c09 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893163:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6c09 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893168:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.893170:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6c09 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893176:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6c09 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893182:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a900) 00010000:00010000:3.0:1763343035.893184:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.893188:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6c09 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893197:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6c09 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.893233:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6bfb lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac941c expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.893246:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8e00) 00010000:00010000:3.0:1763343035.893248:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.893252:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae6bfb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac941c expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.893280:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403529600, rc 0) 00000100:00100000:3.0:1763343035.893369:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56882:x1848997993558016:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 578us (798us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343035.893378:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9307 00000100:00100000:2.0:1763343035.895876:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.895998:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993558144 00000100:00100000:3.0:1763343035.896011:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993558144 00000100:00100000:3.0:1763343035.896085:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9308 00000100:00100000:3.0:1763343035.896096:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56882:x1848997993558144:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343035.896123:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343035.896155:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6c10 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9423 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.896247:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6c17 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896276:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6c17 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896295:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6c17 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896308:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6c1e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896316:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6c1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896322:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6c1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896372:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6c17 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896379:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6c17 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896387:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6c17 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896393:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.896398:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6c17 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896406:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6c17 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896419:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8300) 00010000:00010000:3.0:1763343035.896422:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.896426:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6c17 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896432:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae6c17 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896448:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6c1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896453:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6c1e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896458:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6c1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896463:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.896466:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6c1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896471:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6c1e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896476:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a900) 00010000:00010000:3.0:1763343035.896478:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.896481:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6c1e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896485:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae6c1e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343035.896511:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6c10 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9423 expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.896521:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8300) 00010000:00010000:3.0:1763343035.896522:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343035.896525:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6c10 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9423 expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.896544:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343035.896601:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56882:x1848997993558144:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 507us (738us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343035.896608:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9308 00000100:00100000:3.0:1763343035.900608:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.900806:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.900916:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993558272 00000100:00100000:1.0:1763343035.900933:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993558272 00000100:00100000:1.0:1763343035.901018:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993558528 00000100:00100000:1.0:1763343035.901022:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993558528 00000100:00100000:1.0:1763343035.901070:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9309 00000100:00100000:1.0:1763343035.901083:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56882:x1848997993558272:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:0.0:1763343035.901112:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9310 00010000:00010000:1.0:1763343035.901113:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763343035.901128:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56883:x1848997993558528:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.901140:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.901148:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6c25 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac942a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.901154:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6c2c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9431 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.901231:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6c33 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.901244:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c3a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.901250:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6c33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.901266:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6c33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343035.901612:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343035.901618:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343035.902016:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c3a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.902029:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c3a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.902046:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c41 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.902054:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.902062:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.902109:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6c25 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac942a expref: 252 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.902121:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c3a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.902130:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c3a lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.902138:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c3a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.902143:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6c33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac942a expref: 251 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.902146:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343035.902154:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c3a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343035.902159:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab000) 00010000:00010000:1.0:1763343035.902165:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343035.902171:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00010000:00010000:0.0:1763343035.902203:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c3a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.902218:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab000) 00010000:00010000:0.0:1763343035.902220:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343035.902225:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c3a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.902232:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c3a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.902243:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.902249:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c41 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343035.902257:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56882:x1848997993558272:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1175us (1662us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343035.902258:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.902272:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137400 already unused, calling callback (ffffffffc19a2550) 00000100:00100000:1.0:1763343035.902274:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9309 00010000:00010000:0.0:1763343035.902277:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.902285:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c41 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.902294:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a900) 00010000:00010000:0.0:1763343035.902308:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343035.902311:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c41 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.902317:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c41 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.902346:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6c2c lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9431 expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.902358:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab000) 00010000:00010000:0.0:1763343035.902360:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343035.902364:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6c2c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9431 expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.902373:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405136600, rc 0) 00000100:00100000:0.0:1763343035.902399:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56883:x1848997993558528:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1276us (1593us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343035.902407:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9310 00000100:00100000:2.0:1763343035.908363:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.908604:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993558656 00000100:00100000:0.0:1763343035.908748:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993558656 00000100:00100000:0.0:1763343035.908832:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9311 00000100:00100000:0.0:1763343035.908845:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56882:x1848997993558656:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.908886:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.908924:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6c48 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9438 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.909011:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c4f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909030:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c4f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909044:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c4f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909056:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c56 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909063:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909070:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909120:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c4f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909128:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c4f lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909144:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c4f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909150:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343035.909155:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c4f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909163:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c4f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909177:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab000) 00010000:00010000:0.0:1763343035.909181:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343035.909186:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c4f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909192:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6c4f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909207:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909213:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c56 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909219:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909224:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343035.909227:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909233:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c56 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909244:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a900) 00010000:00010000:0.0:1763343035.909247:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343035.909250:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c56 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909256:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6c56 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343035.909287:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6c48 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9438 expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.909297:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab000) 00010000:00010000:0.0:1763343035.909300:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343035.909303:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6c48 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9438 expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.909312:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405136600, rc 0) 00000100:00100000:0.0:1763343035.909393:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56882:x1848997993558656:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 550us (1046us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343035.909401:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9311 00000100:00100000:2.0:1763343035.918486:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.918939:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993558912 00000100:00100000:1.0:1763343035.918954:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993558912 00000100:00100000:1.0:1763343035.919039:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9312 00000100:00100000:1.0:1763343035.919052:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56882:x1848997993558912:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343035.919078:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.919082:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343035.919119:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6c33 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac942a expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.919143:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab000) 00010000:00010000:1.0:1763343035.919155:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343035.919177:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6c5d lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac943f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.919314:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6c64 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.919330:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6c64 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.919342:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6c64 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.919356:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6c6b lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.919365:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6c6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.919371:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6c6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.919940:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6c72 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.919961:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6c72 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.919970:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6c72 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343035.919981:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e0:0x0]: returning size 0 00010000:00010000:1.0:1763343035.920014:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6c64 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.920022:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6c64 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.920029:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6c64 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.920035:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6c64 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.920042:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343035.920047:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6c64 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.920055:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6c64 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.920064:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab200) 00010000:00010000:1.0:1763343035.920068:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343035.920072:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6c64 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.920078:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6c64 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:1.0:1763343035.920090:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000669c583f reply state 00000000c1f1b7db transno 8589939968 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6c6b lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.920100:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6c6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.920106:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a900) 00010000:00010000:1.0:1763343035.920108:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343035.920111:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343035.920145:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6c5d lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac943f expref: 251 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.920163:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6c72 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac943f expref: 250 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.920169:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3403aabf00) 00010000:00010000:1.0:1763343035.920172:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343035.920174:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:1.0:1763343035.920259:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56882:x1848997993558912:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1207us (1786us total) trans 8589939968 rc 0/0 00000100:00100000:1.0:1763343035.920268:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9312 00000100:00100000:3.0:1763343035.923091:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.924722:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993559168 00000100:00100000:1.0:1763343035.924746:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993559168 00000100:00100000:3.0:1763343035.925174:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.925591:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993559424 00000100:00100000:1.0:1763343035.925599:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993559424 00000100:00100000:2.0:1763343035.926024:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9313 00000100:00100000:2.0:1763343035.926042:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56884:x1848997993559168:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.926075:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.926105:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6c80 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9446 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.926249:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6c87 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.926267:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6c87 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.926282:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6c87 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343035.926300:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e0:0x0]: returning size 0 00010000:00010000:2.0:1763343035.926447:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6c80 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9446 expref: 255 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.926468:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6c87 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9446 expref: 254 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.926477:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3403aabf00) 00010000:00010000:2.0:1763343035.926481:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343035.926485:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d600, rc 0) 00000100:00100000:2.0:1763343035.926580:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56884:x1848997993559168:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 543us (3505us total) trans 8589939969 rc 0/0 00000100:00100000:2.0:1763343035.926589:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9313 00000100:00100000:2.0:1763343035.926616:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9314 00000100:00100000:2.0:1763343035.926643:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56882:x1848997993559424:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.926651:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.926660:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae6c95 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac944d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.926711:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.926728:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6c72 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac943f expref: 254 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.926736:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6c87 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9446 expref: 254 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.926750:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.926792:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6c87 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9446 expref: 254 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.926807:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6c87 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9446 expref: 254 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:2.0:1763343035.926824:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c253b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010266496:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343035.938519:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6c72 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac943f expref: 254 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.938545:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6c72 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac943f expref: 254 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:2.0:1763343035.938567:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010266624:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343035.938818:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726180 going to sleep for 11 seconds 00000100:00100000:1.0:1763343035.938962:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.939059:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993559680 00000100:00100000:0.0:1763343035.939070:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993559680 00010000:00010000:0.0:1763343035.939115:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6c87 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9446 expref: 255 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:0.0:1763343035.939160:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3065 00000100:00100000:0.0:1763343035.939172:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:2429:x1848997993559680:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343035.939188:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343035.939196:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6c87 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9446 expref: 255 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.939210:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6c87 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9446 expref: 255 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.939238:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3403aabf00) 00010000:00010000:0.0:1763343035.939244:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.939256:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343035.939292:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:2429:x1848997993559680:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 121us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.939300:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3065 00000100:00100000:3.0:1763343035.940167:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.940432:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993559808 00000100:00100000:1.0:1763343035.940442:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993559808 00000100:00100000:1.0:1763343035.940480:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3173 00000100:00100000:1.0:1763343035.940488:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56884:x1848997993559808:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343035.940965:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56884:x1848997993559808:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 476us (801us total) trans 8589939970 rc 0/0 00000100:00100000:1.0:1763343035.940974:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3173 00010000:00010000:2.0:1763343035.941895:0:6525:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@0000000015655bd2 x1848998010266496) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6c87 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9446 expref: 255 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:2.0:1763343035.941949:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6c87 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9446 expref: 255 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:2.0:1763343035.941966:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c253b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010266496:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343035.941983:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010266624:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343035.942016:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3403aabf00) 00010000:00010000:2.0:1763343035.942022:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.942036:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343035.942549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.942652:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993559936 00000100:00100000:1.0:1763343035.942662:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993559936 00010000:00010000:1.0:1763343035.942696:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6c72 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac943f expref: 255 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343035.942742:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3066 00000100:00100000:1.0:1763343035.942752:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:2430:x1848997993559936:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343035.942769:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343035.942775:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6c72 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac943f expref: 255 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.942787:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6c72 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac943f expref: 255 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.942816:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6c72 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac943f expref: 255 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.942829:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3403aabf00) 00010000:00010000:1.0:1763343035.942833:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.942842:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.942850:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.942877:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343035.942942:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:2430:x1848997993559936:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 191us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.942949:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3066 00010000:00010000:2.0:1763343035.943075:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.943083:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343035.943112:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e0:0x0]: returning size 0 00000004:00080000:2.0:1763343035.943340:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2a7:0x0], index 1: 0 00000004:00080000:2.0:1763343035.943347:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2a5:0x0], index 0: 0 00000004:00080000:2.0:1763343035.943352:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2a6:0x0], index 0: 0 00000004:00080000:2.0:1763343035.943357:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2a8:0x0], index 1: 0 00010000:00010000:2.0:1763343035.943497:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.943506:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.943514:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.943521:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.943526:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.943535:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.943547:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3403aabf00) 00010000:00010000:2.0:1763343035.943550:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343035.943554:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.943561:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6c9c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.943661:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae6c95 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac944d expref: 254 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.943673:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3403aabf00) 00010000:00010000:2.0:1763343035.943676:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343035.943680:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae6c95 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac944d expref: 254 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.943697:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352ce00, rc 0) 00000100:00100000:2.0:1763343035.943746:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56882:x1848997993559424:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 17105us (18580us total) trans 8589939971 rc 301/301 00000100:00100000:2.0:1763343035.943755:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9314 00000100:00100000:3.0:1763343035.945391:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.945497:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993560192 00000100:00100000:2.0:1763343035.945508:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993560192 00000100:00100000:2.0:1763343035.945561:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9315 00000100:00100000:2.0:1763343035.945570:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56884:x1848997993560192:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.945595:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.945655:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6caa lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9454 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.945939:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6cb1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.945953:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.945968:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.945978:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6cb8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.945985:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.945991:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946120:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6cbf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946128:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6cbf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946134:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6cbf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946234:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6cb1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946241:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6cb1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946246:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6cb1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946253:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6cb1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946258:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.946263:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6cb1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946271:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6cb1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946282:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3503a3aa00) 00010000:00010000:2.0:1763343035.946285:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.946289:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6cb1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946294:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6cb1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946309:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946314:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6cb8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946319:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946322:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343035.946325:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946329:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6cb8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946339:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a900) 00010000:00010000:2.0:1763343035.946341:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343035.946344:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6cb8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946349:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae6cb8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.946386:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6caa lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9454 expref: 256 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.946405:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6cbf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9454 expref: 255 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.946411:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:2.0:1763343035.946414:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343035.946416:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c600, rc 0) 00000100:00100000:2.0:1763343035.947021:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56884:x1848997993560192:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1447us (1634us total) trans 8589939972 rc 0/0 00000100:00100000:2.0:1763343035.947030:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9315 00000100:00100000:3.0:1763343035.949712:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.950041:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993560448 00000100:00100000:1.0:1763343035.950056:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993560448 00000100:00100000:1.0:1763343035.950136:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3174 00000100:00100000:1.0:1763343035.950147:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56882:x1848997993560448:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343035.950543:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56882:x1848997993560448:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 395us (843us total) trans 8589939973 rc 0/0 00000100:00100000:1.0:1763343035.950551:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3174 00000100:00100000:0.0:1763343035.954524:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.954577:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.954696:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993560704 00000100:00100000:2.0:1763343035.954710:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993560704 00000100:00100000:2.0:1763343035.954770:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993560960 00000100:00100000:2.0:1763343035.954773:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993560960 00000100:00100000:2.0:1763343035.954795:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3175 00000100:00100000:2.0:1763343035.954806:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56882:x1848997993560704:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343035.955115:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56882:x1848997993560704:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 310us (604us total) trans 8589939974 rc 0/0 00000100:00100000:2.0:1763343035.955128:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3175 00000100:00100000:2.0:1763343035.955152:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3176 00000100:00100000:2.0:1763343035.955158:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353c653c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56884:x1848997993560960:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343035.955233:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353c653c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56884:x1848997993560960:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 75us (655us total) trans 8589939975 rc 0/0 00000100:00100000:2.0:1763343035.955240:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3176 00000100:00100000:3.0:1763343035.959344:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.959494:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.960225:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993561216 00000100:00100000:2.0:1763343035.960241:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993561216 00000100:00100000:0.0:1763343035.960318:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993561472 00000100:00100000:0.0:1763343035.960323:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993561472 00000100:00100000:0.0:1763343035.960398:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9316 00000100:00100000:0.0:1763343035.960410:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56884:x1848997993561472:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343035.960441:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.960473:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae6ccd lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9462 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.960574:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6cd4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.960591:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6cd4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.960608:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6cd4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.960636:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6cdb lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.960648:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6cdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.960654:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6cdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.960807:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ce2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.960816:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.960823:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343035.960836:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e0:0x0]: returning size 0 00000100:00100000:2.0:1763343035.962988:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9317 00000100:00100000:2.0:1763343035.963008:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:55941:x1848997993561216:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343035.963036:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.963040:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343035.963076:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6cbf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9454 expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.963099:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:2.0:1763343035.963106:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343035.963122:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae6cf0 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac945b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.963254:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.963277:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ce2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.963287:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.963311:0:6525:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343035.963323:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.963609:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6cd4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.963641:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6cd4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.963650:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6cd4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.963657:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6cd4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.963663:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405136600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343035.963675:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6cd4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.963683:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6cd4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.963694:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4100) 00010000:00010000:0.0:1763343035.963697:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343035.963702:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6cd4 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.963709:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6cd4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.963721:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6cdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.963726:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6cdb lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.963731:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6cdb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.963735:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343035.963738:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6cdb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.963743:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6cdb lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.963749:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a900) 00010000:00010000:0.0:1763343035.963752:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343035.963755:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6cdb lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.963763:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6cdb lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.963809:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae6ccd lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9462 expref: 262 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.963834:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ce2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9462 expref: 261 pid: 10041 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.963844:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ce2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9462 expref: 261 pid: 10041 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.963851:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137c00, rc 0) 00000100:00100000:0.0:1763343035.963967:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56884:x1848997993561472:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3559us (4472us total) trans 8589939976 rc 0/0 00000100:00100000:0.0:1763343035.963976:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9316 00000100:00100000:3.0:1763343035.967531:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.968452:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.968818:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993561728 00000100:00100000:0.0:1763343035.968832:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993561728 00010000:00010000:0.0:1763343035.968887:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ce2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9462 expref: 261 pid: 10041 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343035.969046:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993561600 00000100:00100000:1.0:1763343035.969052:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993561600 00000100:00100000:1.0:1763343035.969107:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3177 00000100:00100000:1.0:1763343035.969119:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56884:x1848997993561600:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:1.0:1763343035.969338:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56884:x1848997993561600:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 221us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.969346:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3177 00000100:00100000:0.0:1763343035.970954:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3067 00000100:00100000:0.0:1763343035.970985:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:2429:x1848997993561728:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343035.971011:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343035.971026:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ce2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9462 expref: 261 pid: 10041 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.971051:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9462 expref: 261 pid: 10041 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.971084:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ce2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9462 expref: 261 pid: 10041 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343035.971106:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:0.0:1763343035.971114:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.971125:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.971134:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.971176:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343035.971246:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:2429:x1848997993561728:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 275us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.971255:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3067 00010000:00010000:2.0:1763343035.971377:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.971387:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343035.971418:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e0:0x0]: returning size 0 00010000:00010000:2.0:1763343035.971616:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae6cf0 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac945b expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.971657:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac945b expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.971665:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:2.0:1763343035.971668:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763343035.971672:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c800, rc 0) 00000100:00100000:2.0:1763343035.971713:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:55941:x1848997993561216:12345-192.168.204.21@tcp:101:bash.0 Request processed in 8713us (12385us total) trans 8589939977 rc 0/0 00000100:00100000:2.0:1763343035.971722:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9317 00000100:00100000:3.0:1763343035.972795:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.973170:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993561984 00000100:00100000:2.0:1763343035.973181:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993561984 00000100:00100000:2.0:1763343035.973235:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9318 00000100:00100000:2.0:1763343035.973245:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56884:x1848997993561984:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343035.973272:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343035.973296:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6d05 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9469 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.973426:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6d0c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.973441:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac945b expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.973450:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6d0c lrc: 4/0,1 mode: --/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.973494:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac945b expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343035.973509:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac945b expref: 261 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:2.0:1763343035.973526:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010266752:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343035.973645:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726480 going to sleep for 11 seconds 00000100:00100000:2.0:1763343035.977290:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.977467:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993562112 00000100:00100000:0.0:1763343035.977483:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993562112 00000100:00100000:0.0:1763343035.977556:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9319 00000100:00100000:0.0:1763343035.977568:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993562112:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343035.977608:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.977671:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae6d13 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9470 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.977725:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6d1a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.977745:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6d1a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.977760:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6d1a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343035.977927:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae6d13 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9470 expref: 264 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.977947:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6d1a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9470 expref: 263 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.977958:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:0.0:1763343035.977962:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343035.977966:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137400, rc 0) 00000100:00100000:0.0:1763343035.978045:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:55941:x1848997993562112:12345-192.168.204.21@tcp:101:bash.0 Request processed in 479us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343035.978053:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9319 00000100:00100000:3.0:1763343035.978509:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010266752:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343035.978534:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6d0c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343035.979476:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343035.980318:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993562240 00000100:00100000:1.0:1763343035.980331:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993562240 00010000:00010000:1.0:1763343035.980378:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac945b expref: 263 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343035.980419:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3068 00000100:00100000:1.0:1763343035.980429:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:2429:x1848997993562240:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343035.980445:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343035.980452:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac945b expref: 263 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.980467:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac945b expref: 263 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.980491:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6cf7 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac945b expref: 263 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343035.980510:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:1.0:1763343035.980516:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6d0c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.980526:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6d0c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.980533:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6d0c lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343035.980568:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343035.980644:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:2429:x1848997993562240:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 215us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.980651:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3068 00010000:00010000:3.0:1763343035.981617:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6d0c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.981657:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6d0c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.981689:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6d0c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.981696:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6d0c lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.981704:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6d0c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.981711:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343035.981716:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6d0c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.981725:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6d0c lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.981738:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:3.0:1763343035.981741:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343035.981745:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6d0c lrc: 2/0,0 mode: --/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.981756:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae6d0c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343035.981806:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6d05 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9469 expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.981816:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:3.0:1763343035.981819:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343035.981822:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6d05 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9469 expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343035.981836:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c600, rc 0) 00000100:00100000:3.0:1763343035.981890:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56884:x1848997993561984:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8646us (9100us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343035.981900:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9318 00000100:00100000:3.0:1763343035.982935:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343035.983124:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993562496 00000100:00100000:2.0:1763343035.983137:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993562496 00000100:00100000:2.0:1763343035.983204:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9320 00000100:00100000:2.0:1763343035.983214:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:55941:x1848997993562496:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:2.0:1763343035.983536:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6d21 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.983558:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6d21 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.983571:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6d21 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:2.0:1763343035.983666:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939978 00000004:00010000:2.0:1763343035.983694:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006065fab7 reply state 0000000036f07614 transno 8589939979 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6d21 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.983708:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6d21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343035.983714:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:2.0:1763343035.983717:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343035.983721:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343035.983824:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:55941:x1848997993562496:12345-192.168.204.21@tcp:36:bash.0 Request processed in 611us (893us total) trans 8589939979 rc 0/0 00000100:00100000:2.0:1763343035.983832:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9320 00000020:00080000:2.0:1763343035.983838:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343035.988345:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343035.988870:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.988971:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993562752 00000100:00100000:0.0:1763343035.988986:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993562752 00000100:00100000:0.0:1763343035.989058:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3178 00000100:00100000:0.0:1763343035.989070:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56884:x1848997993562752:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343035.989397:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56884:x1848997993562752:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 329us (1065us total) trans 8589939980 rc 0/0 00000100:00100000:0.0:1763343035.989405:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3178 00000100:00100000:1.0:1763343035.989484:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993562880 00000100:00100000:1.0:1763343035.989490:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993562880 00000100:00100000:1.0:1763343035.989540:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9321 00000100:00100000:1.0:1763343035.989548:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993562880:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343035.989564:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343035.989591:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6d28 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9477 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.989672:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6d28 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9477 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.989690:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6d28 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9477 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343035.989712:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:1.0:1763343035.989716:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343035.989721:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00000100:00100000:1.0:1763343035.989747:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993562880:12345-192.168.204.21@tcp:101:bash.0 Request processed in 201us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343035.989753:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9321 00000100:00100000:2.0:1763343035.999281:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343035.999571:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993563136 00000100:00100000:0.0:1763343035.999587:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993563136 00000100:00100000:0.0:1763343035.999721:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9322 00000100:00100000:0.0:1763343035.999733:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993563136:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343035.999764:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343035.999768:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343035.999807:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6d28 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9477 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.999834:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:0.0:1763343035.999841:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343035.999859:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae6d2f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac947e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343035.999941:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6d36 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.999959:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6d36 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343035.999971:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6d36 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000040:00080000:0.0:1763343036.000255:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1427, 88 off120480 00000004:00080000:0.0:1763343036.000372:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1229667750123ns, next at 1229610036645ns, rc = 0 00000040:00080000:0.0:1763343036.000417:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1426, 88 off120480 00000004:00080000:0.0:1763343036.000422:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1229667801476ns, next at 1229609967587ns, rc = 0 00000040:00080000:0.0:1763343036.000442:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1427, 88 off120568 00000004:00080000:0.0:1763343036.000445:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1229667824520ns, next at 1229609967587ns, rc = 0 00000040:00080000:0.0:1763343036.000453:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1428, 88 off120568 00000004:00080000:0.0:1763343036.000456:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1229667835358ns, next at 1229610036645ns, rc = 0 00010000:00010000:2.0:1763343036.005805:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6bb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.005832:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6bb5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.005841:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6bb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.005848:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.005855:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6bb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.005864:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6bb5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.005885:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a900) 00010000:00010000:2.0:1763343036.005890:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.005897:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6bb5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.005903:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6bb5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.005939:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6c6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.005945:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6c6b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.005950:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6c6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.005955:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.005958:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6c6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.005963:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6c6b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.005970:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a900) 00010000:00010000:2.0:1763343036.005973:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.005976:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6c6b lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.005984:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6c6b lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.006008:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6d21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.006013:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6d21 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.006018:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6d21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.006022:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.006025:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6d21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.006030:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6d21 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.006037:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:2.0:1763343036.006040:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.006042:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6d21 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.006047:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6d21 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000001:00080000:1.0:1763343036.006120:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939981 is committed 00000004:00080000:1.0:1763343036.006130:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 938 committed 00000004:00080000:1.0:1763343036.006149:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 939 committed 00000100:00100000:0.0:1763343036.007601:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010266880:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343036.007713:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763343036.007810:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 938 committed 00000004:00080000:1.0:1763343036.008124:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 937 committed 00000100:00100000:1.0:1763343036.008199:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010267008:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343036.008236:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343036.008480:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010267392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343036.008508:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343036.008607:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6d36 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac947e expref: 245 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.008656:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:0.0:1763343036.008659:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343036.008680:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae6d2f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac947e expref: 245 pid: 6525 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343036.008702:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6d36 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac947e expref: 244 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.008758:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:0.0:1763343036.008761:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343036.008764:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137c00, rc 0) 00000100:00100000:0.0:1763343036.008833:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:55941:x1848997993563136:12345-192.168.204.21@tcp:101:bash.0 Request processed in 9102us (9581us total) trans 8589939981 rc 0/0 00000100:00100000:0.0:1763343036.008844:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9322 00000100:00100000:2.0:1763343036.009009:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010266880 00000100:00100000:2.0:1763343036.009018:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010266880 00000100:00100000:2.0:1763343036.009064:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010267008 00000100:00100000:2.0:1763343036.009067:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010267008 00000100:00100000:2.0:1763343036.009083:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010267392 00000100:00100000:2.0:1763343036.009085:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010267392 00000100:00100000:2.0:1763343036.009107:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6534 00000100:00100000:2.0:1763343036.009117:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3659:x1848998010266880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343036.009153:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:677 count 1 00010000:00010000:2.0:1763343036.009185:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6d3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.009206:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352de00/0x607405d401ae6ba7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9400 expref: 31 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.009214:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343036.009217:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343036.009221:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6d3d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.009251:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352de00/0x607405d401ae6ba7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9400 expref: 31 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343036.010535:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010267520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343036.010615:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343036.010712:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010267520 00000100:00100000:1.0:1763343036.010720:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010267520 00000100:00100000:1.0:1763343036.010768:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6535 00000100:00100000:1.0:1763343036.010776:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+55:3660:x1848998010267008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763343036.010809:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:678 count 1 00010000:00010000:1.0:1763343036.010836:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6d44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.010856:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6af1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93ba expref: 31 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343036.010864:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.010866:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.010869:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6d44 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.010905:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6af1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93ba expref: 31 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343036.010979:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352de00/0x607405d401ae6ba7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9400 expref: 31 pid: 8408 timeout: 1329 lvb_type: 0 00000100:00100000:2.0:1763343036.010995:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010267776:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343036.011065:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34047269c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343036.011218:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6536 00000100:00100000:2.0:1763343036.011227:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3659:x1848998010267392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343036.011453:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6537 00000100:00100000:0.0:1763343036.011463:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3660:x1848998010267520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343036.011731:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3660:x1848998010267520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 269us (1115us total) trans 17179871599 rc 0/0 00000100:00100000:0.0:1763343036.011740:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6537 00000004:00080000:0.0:1763343036.011803:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34097a5f80/2, rc 0, transno 17179871599 00000100:00100000:0.0:1763343036.011810:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010267520:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343036.012773:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3659:x1848998010267392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1544us (4260us total) trans 21474838897 rc 0/0 00000100:00100000:2.0:1763343036.012782:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6536 00000100:00100000:2.0:1763343036.012825:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010267264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343036.012867:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343036.012890:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010268032:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343036.012921:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343036.012948:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1763343036.012954:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010267136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343036.012976:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343036.012990:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010267648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343036.013011:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343036.013043:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010267264 00000100:00100000:2.0:1763343036.013051:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010267264 00000100:00100000:2.0:1763343036.013081:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010268032 00000100:00100000:2.0:1763343036.013084:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010268032 00000100:00100000:2.0:1763343036.013102:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010267136 00000100:00100000:2.0:1763343036.013104:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010267136 00000100:00100000:2.0:1763343036.013120:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010267648 00000100:00100000:2.0:1763343036.013122:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010267648 00000100:00100000:2.0:1763343036.013138:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6538 00000100:00100000:2.0:1763343036.013146:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3658:x1848998010267264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343036.013173:0:10294:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:676 count 1 00010000:00010000:2.0:1763343036.013197:0:10294:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c400/0x607405d401ae6d4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.013217:0:10294:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae6af8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93c1 expref: 16 pid: 27835 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1763343036.014520:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6539 00000100:00100000:3.0:1763343036.014541:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3658:x1848998010268032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343036.014827:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3658:x1848998010268032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 296us (1904us total) trans 21474838898 rc 0/0 00000100:00100000:3.0:1763343036.014835:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6539 00000100:00100000:3.0:1763343036.014861:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6540 00000100:00100000:3.0:1763343036.014868:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3658:x1848998010267136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343036.014886:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:675 count 1 00010000:00010000:3.0:1763343036.014915:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae6d52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.014935:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae6b99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93f9 expref: 16 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.014943:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343036.014945:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343036.014950:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae6d52 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.014994:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae6b99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93f9 expref: 16 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343036.015090:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6541 00000100:00100000:0.0:1763343036.015104:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3658:x1848998010267648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343036.015223:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3658:x1848998010267648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 123us (2210us total) trans 17179871600 rc 0/0 00000100:00100000:0.0:1763343036.015229:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6541 00000004:00080000:0.0:1763343036.015300:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b5c00/2, rc 0, transno 21474838897 00000100:00100000:0.0:1763343036.015308:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010267392:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343036.015645:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6af1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93ba expref: 31 pid: 27835 timeout: 1329 lvb_type: 1 00000100:00100000:1.0:1763343036.015673:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406551880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010267904:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343036.015775:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe540 going to sleep for 11 seconds 00000004:00080000:1.0:1763343036.015840:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a7800/2, rc 0, transno 17179871600 00000100:00100000:1.0:1763343036.015846:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010267648:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763343036.015858:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b4380/2, rc 0, transno 21474838898 00000100:00100000:1.0:1763343036.015862:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010268032:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1763343036.016133:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae6b99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93f9 expref: 16 pid: 28648 timeout: 1329 lvb_type: 0 00000100:00100000:3.0:1763343036.016147:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010268160:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343036.016179:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509bdff00 going to sleep for 11 seconds 00010000:00010000:2.0:1763343036.016793:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.016798:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.016807:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c400/0x607405d401ae6d4b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.016856:0:10294:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae6af8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93c1 expref: 16 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343036.016867:0:10294:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae6af8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93c1 expref: 16 pid: 27835 timeout: 1329 lvb_type: 1 00000100:00100000:2.0:1763343036.016877:0:10294:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503520e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10294:1848998010268288:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343036.016933:0:10294:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763343036.019311:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.019719:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010267776:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343036.019756:0:8408:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6d3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343036.022130:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.022181:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.022217:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993563264 00000100:00100000:3.0:1763343036.022229:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993563264 00000100:00100000:3.0:1763343036.022304:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6542 00000100:00100000:3.0:1763343036.022316:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:55941:x1848997993563264:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343036.022342:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343036.022376:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6d59 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9485 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343036.022408:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343036.022436:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.022439:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.022452:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6d59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9485 expref: 33 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.022471:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6d59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9485 expref: 33 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.022485:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343036.022555:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+33:55941:x1848997993563264:12345-192.168.204.21@tcp:101:bash.0 Request processed in 241us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343036.022563:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6542 00000100:00100000:2.0:1763343036.023033:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993563648 00000100:00100000:2.0:1763343036.023042:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993563648 00000100:00100000:2.0:1763343036.023087:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9323 00000100:00100000:2.0:1763343036.023095:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56885:x1848997993563648:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.023115:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.023136:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae6d60 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac948c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.023234:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6d67 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023249:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6d67 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023272:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6d67 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023289:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6d6e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023296:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6d6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023303:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6d6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023456:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6d75 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023465:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6d75 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023472:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6d75 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343036.023483:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e0:0x0]: returning size 2 00010000:00010000:2.0:1763343036.023607:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6d67 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023614:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6d67 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023648:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6d67 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023655:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6d67 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023661:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.023665:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6d67 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023674:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6d67 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023693:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3503a3aa00) 00010000:00010000:2.0:1763343036.023697:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.023703:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6d67 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023709:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6d67 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023726:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6d6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023732:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6d6e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023736:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6d6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023741:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.023744:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6d6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023749:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6d6e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023756:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a800) 00010000:00010000:2.0:1763343036.023759:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.023761:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6d6e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023767:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6d6e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.023816:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae6d60 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac948c expref: 247 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.023833:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6d75 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac948c expref: 246 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.023839:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:2.0:1763343036.023842:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343036.023845:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c600, rc 0) 00000100:00100000:2.0:1763343036.023900:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56885:x1848997993563648:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 805us (1782us total) trans 8589939982 rc 0/0 00000100:00100000:2.0:1763343036.023919:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9323 00000100:00100000:1.0:1763343036.025028:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993563392 00000100:00100000:1.0:1763343036.025042:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993563392 00010000:00010000:1.0:1763343036.025084:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352de00/0x607405d401ae6ba7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9400 expref: 33 pid: 8408 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343036.025126:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3069 00000100:00100000:1.0:1763343036.025135:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503523100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+33:2429:x1848997993563392:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343036.025149:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343036.025154:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352de00/0x607405d401ae6ba7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9400 expref: 33 pid: 8408 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343036.025167:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352de00/0x607405d401ae6ba7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9400 expref: 33 pid: 8408 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343036.025188:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352de00/0x607405d401ae6ba7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9400 expref: 33 pid: 8408 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343036.025205:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.025208:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.025214:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6d3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.025225:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6d3d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.025252:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343036.025308:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503523100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2429:x1848997993563392:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 174us (6014us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.025313:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3069 00010000:00010000:0.0:1763343036.025435:0:8408:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6d3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.025446:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6d3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.025456:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6d3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.025463:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6d3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.025489:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343036.025852:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3659:x1848998010266880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16734us (18138us total) trans 17179871601 rc 0/0 00000100:00100000:0.0:1763343036.025865:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6534 00000004:00080000:0.0:1763343036.025942:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34097a5880/2, rc 0, transno 17179871601 00000100:00100000:0.0:1763343036.025952:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010266880:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763343036.026036:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343036.026044:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6d3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.026052:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343036.026056:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6d3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.026065:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6d3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.026079:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6d3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.026087:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6d3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.026108:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343036.026110:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343036.026112:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343036.028779:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406551880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010267904:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343036.028818:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6d44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343036.030086:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.030114:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.030138:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.030161:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.030184:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.030212:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993564416 00000100:00100000:2.0:1763343036.030222:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993564416 00000100:00100000:2.0:1763343036.030290:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3179 00000100:00100000:2.0:1763343036.030300:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56885:x1848997993564416:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343036.030646:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56885:x1848997993564416:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 320us (433us total) trans 8589939983 rc 0/0 00000100:00100000:2.0:1763343036.030655:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3179 00000100:00100000:2.0:1763343036.030778:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993563904 00000100:00100000:2.0:1763343036.030783:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993563904 00010000:00010000:2.0:1763343036.030808:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae6b99 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93f9 expref: 17 pid: 28648 timeout: 1329 lvb_type: 0 00000100:00100000:2.0:1763343036.030836:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993563776 00000100:00100000:2.0:1763343036.030839:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993563776 00010000:00010000:2.0:1763343036.030853:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6af1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93ba expref: 32 pid: 27835 timeout: 1329 lvb_type: 1 00000100:00100000:2.0:1763343036.030868:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993564032 00000100:00100000:2.0:1763343036.030871:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993564032 00010000:00010000:2.0:1763343036.030882:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae6af8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93c1 expref: 18 pid: 27835 timeout: 1329 lvb_type: 1 00000100:00100000:2.0:1763343036.030894:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3070 00000100:00100000:2.0:1763343036.030900:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503521500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993563904:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343036.030928:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343036.030934:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae6b99 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93f9 expref: 18 pid: 28648 timeout: 1329 lvb_type: 0 00010000:00010000:2.0:1763343036.030947:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae6b99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93f9 expref: 18 pid: 28648 timeout: 1329 lvb_type: 0 00010000:00010000:2.0:1763343036.030981:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.030983:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.030989:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae6d52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.031001:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae6d52 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.031032:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343036.031058:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503521500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993563904:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 158us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.031065:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3070 00000100:00100000:2.0:1763343036.031078:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3071 00000100:00100000:2.0:1763343036.031084:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3508045450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2429:x1848997993563776:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343036.031095:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343036.031099:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6af1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93ba expref: 32 pid: 27835 timeout: 1329 lvb_type: 1 00010000:00010000:2.0:1763343036.031110:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6af1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93ba expref: 32 pid: 27835 timeout: 1329 lvb_type: 1 00010000:00010000:2.0:1763343036.031125:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93800/0x607405d401ae6af1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93ba expref: 32 pid: 27835 timeout: 1329 lvb_type: 1 00010000:00010000:2.0:1763343036.031138:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.031140:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.031143:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6d44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.031150:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6d44 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.031169:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343036.031190:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3508045450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2429:x1848997993563776:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 106us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.031197:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3071 00000100:00100000:2.0:1763343036.031253:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3072 00000100:00100000:2.0:1763343036.031260:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503523480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993564032:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343036.031268:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343036.031273:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae6af8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93c1 expref: 17 pid: 27835 timeout: 1329 lvb_type: 1 00010000:00010000:2.0:1763343036.031282:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae6af8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93c1 expref: 17 pid: 27835 timeout: 1329 lvb_type: 1 00010000:00010000:2.0:1763343036.031294:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.031296:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.031299:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c400/0x607405d401ae6d4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.031307:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c400/0x607405d401ae6d4b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.031318:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343036.031336:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503523480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993564032:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 77us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.031344:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3072 00010000:00010000:2.0:1763343036.031447:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6d44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.031456:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6d44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.031468:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6d44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.031476:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6d44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.031494:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343036.031813:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3660:x1848998010267008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21035us (23574us total) trans 17179871602 rc 0/0 00000100:00100000:2.0:1763343036.031822:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6535 00000100:00100000:2.0:1763343036.031838:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993564160 00000100:00100000:2.0:1763343036.031845:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993564160 00000100:00100000:2.0:1763343036.031868:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6543 00000100:00100000:2.0:1763343036.031875:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993564160:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343036.031889:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.031924:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae6d83 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9493 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343036.031950:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343036.031965:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.031968:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.031974:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae6d83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9493 expref: 18 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.031988:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae6d83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9493 expref: 18 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.032005:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352ce00, rc 0) 00000100:00100000:2.0:1763343036.032032:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:55941:x1848997993564160:12345-192.168.204.21@tcp:101:bash.0 Request processed in 157us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.032038:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6543 00010000:00010000:2.0:1763343036.032059:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343036.032066:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6d44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.032074:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343036.032079:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6d44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.032088:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6d44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.032100:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6d44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.032107:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae6d44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.032124:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343036.032126:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343036.032128:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343036.033184:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34097a4a80/2, rc 0, transno 17179871602 00000100:00100000:3.0:1763343036.033197:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010267008:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763343036.033235:0:10294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae6af8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93c1 expref: 17 pid: 27835 timeout: 1329 lvb_type: 1 00000100:00100000:3.0:1763343036.033250:0:10294:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503520e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10294:1848998010268288:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343036.033272:0:10294:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340352c400/0x607405d401ae6d4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.033281:0:10294:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340352c400/0x607405d401ae6d4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.033287:0:10294:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352c400/0x607405d401ae6d4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.033296:0:10294:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c400/0x607405d401ae6d4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.033304:0:10294:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c400/0x607405d401ae6d4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.033327:0:10294:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343036.033599:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3658:x1848998010267264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20452us (20730us total) trans 21474838899 rc 0/0 00000100:00100000:3.0:1763343036.033609:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6538 00010000:00010000:0.0:1763343036.034592:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343036.034605:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352c400/0x607405d401ae6d4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.034615:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343036.034638:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352c400/0x607405d401ae6d4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.034648:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352c400/0x607405d401ae6d4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.034671:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352c400/0x607405d401ae6d4b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.034679:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c400/0x607405d401ae6d4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.034703:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343036.034705:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343036.034707:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343036.034773:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b7100/2, rc 0, transno 21474838899 00000100:00100000:0.0:1763343036.034781:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010267264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343036.042477:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.042560:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993564544 00000100:00100000:3.0:1763343036.042574:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993564544 00002000:00010000:3.0:1763343036.042659:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/679 (0->18446744073709551615) 00002000:00100000:3.0:1763343036.042664:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503523100 with x1848997993564544 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343036.042680:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3503523100. 00000100:00100000:3.0:1763343036.042718:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1596 00000100:00100000:3.0:1763343036.042728:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2431:x1848997993564544:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343036.042970:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343036.042974:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb mtime from disk: 0 -> 1763343035 00002000:00010000:3.0:1763343036.042977:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343036.042980:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb ctime from disk: 0 -> 1763343035 00002000:00010000:3.0:1763343036.042982:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343036.043063:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2431:x1848997993564544:12345-192.168.204.21@tcp:10:bash.0 Request processed in 335us (599us total) trans 17179871603 rc 0/0 00000100:00100000:3.0:1763343036.043072:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1596 00002000:00010000:3.0:1763343036.043077:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/679 (0->18446744073709551615) 00002000:00100000:3.0:1763343036.043079:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503523100 with x1848997993564544 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343036.043084:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3503523100. 00010000:00010000:1.0:1763343036.043681:0:28648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3403528e00/0x607405d401ae6b99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac93f9 expref: 16 pid: 28648 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343036.043702:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010268160:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343036.043733:0:28648:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae6d52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.043746:0:28648:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae6d52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.043754:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae6d52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.043765:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae6d52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.043773:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae6d52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.043805:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343036.043858:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343036.043869:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae6d52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.043880:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343036.043885:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae6d52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.043895:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae6d52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.043929:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae6d52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.043936:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae6d52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.043960:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343036.043962:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343036.043964:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343036.044210:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3658:x1848998010267136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29339us (31230us total) trans 21474838900 rc 0/0 00000100:00100000:1.0:1763343036.044221:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6540 00000004:00080000:0.0:1763343036.044242:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b6d80/2, rc 0, transno 21474838900 00000100:00100000:0.0:1763343036.044252:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010267136:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343036.048161:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.048787:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993564928 00000100:00100000:1.0:1763343036.048802:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993564928 00000100:00100000:0.0:1763343036.049017:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9324 00000100:00100000:0.0:1763343036.049029:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56886:x1848997993564928:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343036.049060:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.049087:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6d8a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac949a expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.049229:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6d91 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.049246:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6d91 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.049259:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6d91 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343036.049283:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e0:0x0]: returning size 2 00010000:00010000:0.0:1763343036.049435:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6d8a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac949a expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.049456:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6d91 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac949a expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.049466:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:0.0:1763343036.049469:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763343036.049473:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137800, rc 0) 00000100:00100000:0.0:1763343036.049566:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56886:x1848997993564928:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 537us (1419us total) trans 8589939984 rc 0/0 00000100:00100000:0.0:1763343036.049574:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9324 00000100:00100000:2.0:1763343036.050343:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.051098:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993564672 00000100:00100000:0.0:1763343036.051111:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993564672 00002000:00010000:0.0:1763343036.051156:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/677 (0->18446744073709551615) 00002000:00100000:0.0:1763343036.051162:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503521500 with x1848997993564672 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343036.051175:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503521500. 00000100:00100000:0.0:1763343036.051237:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1597 00000100:00100000:0.0:1763343036.051247:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993564672:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343036.051519:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2a5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343036.051524:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2a5:0x0] updating lvb mtime from disk: 0 -> 1763343035 00002000:00010000:0.0:1763343036.051527:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2a5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343036.051529:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2a5:0x0] updating lvb ctime from disk: 0 -> 1763343035 00002000:00010000:0.0:1763343036.051532:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2a5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343036.051817:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2432:x1848997993564672:12345-192.168.204.21@tcp:10:bash.0 Request processed in 569us (1475us total) trans 21474838901 rc 0/0 00000100:00100000:0.0:1763343036.051826:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1597 00002000:00010000:0.0:1763343036.051830:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/677 (0->18446744073709551615) 00002000:00100000:0.0:1763343036.051833:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503521500 with x1848997993564672 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343036.051838:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503521500. 00000100:00100000:2.0:1763343036.055289:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.056066:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993565184 00000100:00100000:0.0:1763343036.056084:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993565184 00000100:00100000:0.0:1763343036.056164:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3180 00000100:00100000:0.0:1763343036.056178:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:55941:x1848997993565184:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343036.056650:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:55941:x1848997993565184:12345-192.168.204.21@tcp:35:bash.0 Request processed in 445us (1348us total) trans 8589939985 rc 0/0 00000100:00100000:0.0:1763343036.056660:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3180 00000100:00100000:3.0:1763343036.063791:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.063934:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993565440 00000100:00100000:2.0:1763343036.063947:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993565440 00000100:00100000:2.0:1763343036.064025:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9325 00000100:00100000:2.0:1763343036.064035:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56886:x1848997993565440:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.064062:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.064089:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae6d9f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac94a1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.064246:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.064265:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6d75 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac948c expref: 251 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.064333:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.064378:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6d75 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac948c expref: 251 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.064392:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6d75 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac948c expref: 251 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:2.0:1763343036.064408:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503523800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010268416:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343036.065267:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726540 going to sleep for 11 seconds 00000100:00100000:2.0:1763343036.067928:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503523800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010268416:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343036.067969:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343036.070679:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.072146:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993565568 00000100:00100000:0.0:1763343036.072167:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993565568 00010000:00010000:0.0:1763343036.072231:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6d75 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac948c expref: 252 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:0.0:1763343036.072303:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3073 00000100:00100000:0.0:1763343036.072316:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:2430:x1848997993565568:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343036.072338:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343036.072347:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6d75 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac948c expref: 252 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343036.072364:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6d75 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac948c expref: 252 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343036.072394:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6d75 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac948c expref: 252 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343036.072416:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:0.0:1763343036.072422:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.072434:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.072442:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.072486:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343036.072581:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a65b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:2430:x1848997993565568:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 267us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343036.072590:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3073 00010000:00010000:2.0:1763343036.073068:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.073078:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343036.073108:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e0:0x0]: returning size 5 00010000:00010000:2.0:1763343036.073306:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae6d9f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94a1 expref: 252 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.073328:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94a1 expref: 251 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.073336:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:2.0:1763343036.073339:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763343036.073343:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c800, rc 0) 00000100:00100000:2.0:1763343036.073402:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56886:x1848997993565440:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 9367us (9627us total) trans 8589939986 rc 0/0 00000100:00100000:2.0:1763343036.073411:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9325 00000100:00100000:0.0:1763343036.074067:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.074267:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993565696 00000100:00100000:2.0:1763343036.074285:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993565696 00000100:00100000:2.0:1763343036.074340:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9326 00000100:00100000:2.0:1763343036.074351:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56887:x1848997993565696:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:2.0:1763343036.074374:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.074398:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6db4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac94a8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.074473:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae6dbb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.074488:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae6dbb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.074500:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae6dbb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.074513:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6dc2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.074520:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.074526:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.074610:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6dc9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.074648:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94a1 expref: 252 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.074657:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6dc9 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.074698:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94a1 expref: 252 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.074713:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94a1 expref: 252 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:2.0:1763343036.074730:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503523800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010268544:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343036.074829:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726180 going to sleep for 11 seconds 00000100:00100000:2.0:1763343036.082412:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503523800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010268544:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343036.082454:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6dc9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:0.0:1763343036.085787:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.085843:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.085895:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993565952 00000100:00100000:1.0:1763343036.085919:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993565952 00010000:00010000:1.0:1763343036.085986:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94a1 expref: 253 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343036.086035:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3074 00000100:00100000:1.0:1763343036.086045:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:2432:x1848997993565952:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343036.086066:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343036.086074:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94a1 expref: 253 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343036.086090:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94a1 expref: 253 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343036.086118:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6da6 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1e0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94a1 expref: 253 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:1.0:1763343036.086135:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:1.0:1763343036.086141:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6dc9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.086152:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.086160:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6dc9 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.086201:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343036.086253:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086265:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343036.086350:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e0:0x0]: returning size 5 00000004:00200000:2.0:1763343036.086355:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343036.086382:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086395:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086407:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae6dbb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086414:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae6dbb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086420:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae6dbb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086427:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae6dbb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086434:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.086439:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae6dbb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086446:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae6dbb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086455:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3503a3aa00) 00010000:00010000:2.0:1763343036.086459:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.086463:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae6dbb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086469:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae6dbb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086482:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086487:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6dc2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086493:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086499:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.086501:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086506:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6dc2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086514:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a800) 00010000:00010000:2.0:1763343036.086516:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.086519:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6dc2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086524:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6dc2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.086563:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6db4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94a8 expref: 253 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.086580:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94a8 expref: 252 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.086587:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:2.0:1763343036.086590:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343036.086592:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352de00, rc 0) 00000100:00100000:1.0:1763343036.086728:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:2432:x1848997993565952:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 683us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.086738:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3074 00000100:00100000:3.0:1763343036.086820:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993565824 00000100:00100000:3.0:1763343036.086826:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993565824 00000100:00100000:3.0:1763343036.086873:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9327 00000100:00100000:3.0:1763343036.086881:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56886:x1848997993565824:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343036.086914:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343036.086933:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6dd0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac94af expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.087036:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6dd7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.087047:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.087056:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343036.087078:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e0:0x0]: returning size 5 00000004:00200000:3.0:1763343036.087081:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343036.087094:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.087114:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6dd0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94af expref: 254 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.087127:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94af expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.087135:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:3.0:1763343036.087137:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343036.087140:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:2.0:1763343036.087458:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56887:x1848997993565696:12345-192.168.204.21@tcp:101:rm.0 Request processed in 13107us (13392us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.087467:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9326 00000100:00100000:3.0:1763343036.091504:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56886:x1848997993565824:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4601us (5711us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343036.091521:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9327 00000100:00100000:1.0:1763343036.092209:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.094366:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993566208 00000100:00100000:0.0:1763343036.094389:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993566208 00000100:00100000:0.0:1763343036.094488:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3181 00000100:00100000:0.0:1763343036.094502:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56887:x1848997993566208:12345-192.168.204.21@tcp:35:rm.0 00000100:00100000:3.0:1763343036.094934:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.094982:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56887:x1848997993566208:12345-192.168.204.21@tcp:35:rm.0 Request processed in 481us (2774us total) trans 8589939987 rc 0/0 00000100:00100000:0.0:1763343036.094993:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3181 00000100:00100000:1.0:1763343036.095232:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993566464 00000100:00100000:1.0:1763343036.095240:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993566464 00000100:00100000:1.0:1763343036.095343:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9328 00000100:00100000:1.0:1763343036.095352:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56886:x1848997993566464:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.095366:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.095393:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6dde lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac94b6 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.095495:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6de5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.095514:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6de5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.095527:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6de5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343036.095542:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e0:0x0]: returning size 5 00010000:00010000:1.0:1763343036.095665:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6dde lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94b6 expref: 256 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.095685:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6de5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94b6 expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.095701:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:1.0:1763343036.095706:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343036.095711:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343036.095764:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56886:x1848997993566464:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 413us (833us total) trans 8589939988 rc 0/0 00000100:00100000:1.0:1763343036.095771:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9328 00000100:00100000:3.0:1763343036.101562:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.101618:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.101644:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993566720 00000100:00100000:1.0:1763343036.101659:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993566720 00000100:00100000:1.0:1763343036.101741:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9329 00000100:00100000:1.0:1763343036.101752:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56887:x1848997993566720:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:1.0:1763343036.101829:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1763343036.101864:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae6d91 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac949a expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.101888:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6d36 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac947e expref: 254 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.101902:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae6dc9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94a8 expref: 253 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.101926:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6d1a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9470 expref: 252 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.101937:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:1.0:1763343036.101943:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343036.101985:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6df3 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.102001:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6df3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.102011:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6df3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.102023:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6dfa lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.102030:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6dfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.102035:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6dfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.102135:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e01 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.102147:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6dd7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94af expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.102156:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e01 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.102198:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94af expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.102213:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6dd7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94af expref: 251 pid: 28422 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343036.102230:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406551f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010268672:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343036.102587:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abed80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343036.107029:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.107121:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993566976 00000100:00100000:0.0:1763343036.107134:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993566976 00010000:00010000:0.0:1763343036.107190:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6dd7 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94af expref: 252 pid: 28422 timeout: 1329 lvb_type: 0 00000100:00100000:0.0:1763343036.107243:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3075 00000100:00100000:0.0:1763343036.107256:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a658000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:2430:x1848997993566976:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343036.107289:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343036.107298:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6dd7 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94af expref: 252 pid: 28422 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343036.107314:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6dd7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94af expref: 252 pid: 28422 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343036.107348:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:0.0:1763343036.107355:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e01 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.107368:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e01 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.107376:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e01 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.107401:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343036.107474:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a658000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:2430:x1848997993566976:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 219us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343036.107483:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3075 00010000:00010000:1.0:1763343036.107766:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae6dd7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94af expref: 251 pid: 28422 timeout: 1329 lvb_type: 0 00000100:00100000:1.0:1763343036.107786:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406551f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010268672:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343036.107817:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e01 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.107827:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e01 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.107833:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e01 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00080000:1.0:1763343036.108189:0:28422:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1e0:0x0] is inserted into orphan list, open count = 2 00000100:00100000:2.0:1763343036.108420:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993566848 00000100:00100000:2.0:1763343036.108430:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993566848 00000100:00100000:2.0:1763343036.108480:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6544 00000100:00100000:2.0:1763343036.108489:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a659c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2429:x1848997993566848:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:2.0:1763343036.108539:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6e08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.108558:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6d59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9485 expref: 32 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.108566:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343036.108569:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343036.108573:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6e08 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.108613:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6d59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9485 expref: 32 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.108652:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6d59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9485 expref: 32 pid: 27835 timeout: 1329 lvb_type: 0 00000100:00100000:2.0:1763343036.108671:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503523800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010268800:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343036.108751:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726180 going to sleep for 11 seconds 00010000:00010000:1.0:1763343036.109003:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e01 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.109013:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e01 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.109020:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e01 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.109026:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.109031:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e01 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.109040:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e01 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.109057:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:1.0:1763343036.109061:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343036.109066:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e01 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.109074:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e01 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.109094:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6df3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.109099:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6df3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.109105:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6df3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.109110:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.109113:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6df3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.109119:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6df3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.109127:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab200) 00010000:00010000:1.0:1763343036.109130:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343036.109133:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6df3 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.109140:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6df3 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:1.0:1763343036.109156:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000090d591c7 reply state 00000000418870e4 transno 8589939989 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6dfa lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.109170:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6dfa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.109179:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab000) 00010000:00010000:1.0:1763343036.109182:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343036.109186:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343036.109262:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56887:x1848997993566720:12345-192.168.204.21@tcp:36:rm.0 Request processed in 7510us (7711us total) trans 8589939989 rc 0/0 00000100:00100000:1.0:1763343036.109271:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9329 00000100:00100000:3.0:1763343036.115411:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.115455:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503523800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010268800:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343036.115493:0:28648:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6e08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343036.115576:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993567104 00000100:00100000:0.0:1763343036.115585:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993567104 00002000:00100000:0.0:1763343036.115691:0:28424:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x2a7:0x0] (0->4) req@ffff9a340a658380 x1848997993567104/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:532/0 lens 496/0 e 0 to 0 dl 1763343047 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343036.115702:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340a658380 with x1848997993567104 ext(0->4) 00010000:00010000:0.0:1763343036.115711:0:28424:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6d59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9485 expref: 33 pid: 27835 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343036.115727:0:28424:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6d59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9485 expref: 33 pid: 27835 timeout: 1329 lvb_type: 0 00002000:00010000:0.0:1763343036.115735:0:28424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a340a658380 00000100:00100000:0.0:1763343036.115777:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 106 00000100:00100000:0.0:1763343036.115789:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+33:2431:x1848997993567104:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:0.0:1763343036.122975:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+35:2431:x1848997993567104:12345-192.168.204.21@tcp:4:bash.0 Request processed in 7166us (7558us total) trans 17179871604 rc 0/0 00000100:00100000:0.0:1763343036.123000:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 106 00002000:00100000:0.0:1763343036.123023:0:28424:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x2a7:0x0] (0->4) req@ffff9a340a658380 x1848997993567104/t17179871604(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:532/0 lens 496/448 e 0 to 0 dl 1763343047 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343036.123037:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340a658380 with x1848997993567104 ext(0->4) 00010000:00010000:0.0:1763343036.123052:0:28424:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6d59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9485 expref: 35 pid: 27835 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343036.123075:0:28424:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6d59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9485 expref: 35 pid: 27835 timeout: 1329 lvb_type: 0 00002000:00010000:0.0:1763343036.123092:0:28424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a340a658380 00000100:00100000:3.0:1763343036.124092:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343036.124121:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010268928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1763343036.124207:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343036.124331:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010268928 00000100:00100000:2.0:1763343036.124343:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010268928 00000100:00100000:2.0:1763343036.124413:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:2.0:1763343036.124425:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+57:3660:x1848998010268928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1763343036.124458:0:8411:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484985920 pending 86016 free 3919175680 avail 3687653376 00000100:00100000:2.0:1763343036.124516:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a65a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+57:3660:x1848998010268928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.124523:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1763343036.124670:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010268928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1763343036.125010:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010269056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1763343036.125046:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343036.125766:0:8851:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010269056 00000100:00100000:1.0:1763343036.125777:0:8851:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010269056 00000100:00100000:1.0:1763343036.125823:0:8851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:1.0:1763343036.125832:0:8851:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3660:x1848998010269056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1763343036.125866:0:8851:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484899904 pending 0 free 3920240640 avail 3688718336 00000100:00100000:1.0:1763343036.128699:0:8851:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3660:x1848998010269056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2852us (3635us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.128720:0:8851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:2.0:1763343036.129398:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010269056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1763343036.129834:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.129970:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993567232 00000100:00100000:3.0:1763343036.129981:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993567232 00010000:00010000:3.0:1763343036.130031:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6d59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9485 expref: 35 pid: 27835 timeout: 1329 lvb_type: 0 00000100:00100000:3.0:1763343036.130085:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3076 00000100:00100000:3.0:1763343036.130097:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+35:2430:x1848997993567232:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343036.130121:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1763343036.130146:0:27834:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:3.0:1763343036.130150:0:27834:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763343036.130158:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6d59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9485 expref: 35 pid: 27835 timeout: 1329 lvb_type: 0 00010000:00010000:3.0:1763343036.130173:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6d59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9485 expref: 35 pid: 27835 timeout: 1329 lvb_type: 0 00010000:00010000:3.0:1763343036.130208:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6d59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9485 expref: 35 pid: 27835 timeout: 1329 lvb_type: 0 00010000:00010000:3.0:1763343036.130232:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.130235:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.130241:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6e08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.130253:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6e08 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.130303:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343036.130370:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2430:x1848997993567232:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 275us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343036.130378:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3076 00000100:00100000:0.0:1763343036.132746:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:2.0:1763343036.133416:0:28648:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6e08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.133434:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6e08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.133494:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6e08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.133505:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6e08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.133514:0:28648:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6e08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.133521:0:28648:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343036.133527:0:28648:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6e08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.133536:0:28648:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6e08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.133565:0:28648:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6e08 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.133575:0:28648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae6e08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343036.133743:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a659c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+33:2429:x1848997993566848:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 25250us (32120us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.133756:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6544 00000100:00100000:1.0:1763343036.133878:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993567360 00000100:00100000:1.0:1763343036.133890:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993567360 00000100:00100000:1.0:1763343036.133961:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9330 00000100:00100000:1.0:1763343036.133972:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56888:x1848997993567360:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.134001:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.134028:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6e0f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac94bd expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.134122:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e16 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134137:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e16 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134148:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e16 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134163:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6e1d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134170:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6e1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134177:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6e1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134224:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e16 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134230:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e16 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134236:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134241:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.134245:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134250:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e16 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134259:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab200) 00010000:00010000:1.0:1763343036.134262:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343036.134266:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e16 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134272:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6e16 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134283:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6e1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134289:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6e1d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134294:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6e1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134299:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.134301:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6e1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134306:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6e1d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134313:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab000) 00010000:00010000:1.0:1763343036.134316:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343036.134319:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6e1d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134325:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6e1d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.134356:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6e0f lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94bd expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.134367:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403aab200) 00010000:00010000:1.0:1763343036.134369:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343036.134373:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6e0f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94bd expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.134386:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:1.0:1763343036.134419:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56888:x1848997993567360:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 449us (1687us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343036.134427:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9330 00000100:00100000:0.0:1763343036.146746:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.146801:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.147194:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993567488 00000100:00100000:2.0:1763343036.147208:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993567488 00000100:00100000:2.0:1763343036.147271:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993567744 00000100:00100000:2.0:1763343036.147273:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993567744 00000100:00100000:2.0:1763343036.147807:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9331 00000100:00100000:2.0:1763343036.147819:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56888:x1848997993567488:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.147846:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.147877:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6e24 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac94c4 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.147976:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e2b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.147993:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e2b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148005:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e2b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148015:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e32 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148024:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148029:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148076:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e2b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148083:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e2b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148090:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e2b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148098:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e2b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148105:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.148109:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e2b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148117:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e2b lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148130:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3503a3aa00) 00010000:00010000:2.0:1763343036.148133:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.148137:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e2b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148143:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e2b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148157:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148162:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e32 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148168:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148173:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.148176:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148181:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e32 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148191:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab000) 00010000:00010000:2.0:1763343036.148194:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.148197:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e32 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148202:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e32 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148227:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6e24 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94c4 expref: 254 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.148237:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3503a3aa00) 00010000:00010000:2.0:1763343036.148239:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.148242:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6e24 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94c4 expref: 254 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.148256:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:2.0:1763343036.148332:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56888:x1848997993567488:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 515us (1602us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343036.148340:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9331 00000100:00100000:2.0:1763343036.148360:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9332 00000100:00100000:2.0:1763343036.148366:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56886:x1848997993567744:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:2.0:1763343036.148412:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e39 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148421:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e39 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.148428:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e39 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000040:00080000:2.0:1763343036.148722:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1429, 88 off120656 00000004:00080000:2.0:1763343036.148732:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1229816111055ns, next at 1229610036645ns, rc = 0 00000040:00080000:2.0:1763343036.148762:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1428, 88 off120656 00000004:00080000:2.0:1763343036.148768:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1229816146890ns, next at 1229609967587ns, rc = 0 00000040:00080000:2.0:1763343036.148781:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1429, 88 off120744 00000004:00080000:2.0:1763343036.148785:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1229816163850ns, next at 1229609967587ns, rc = 0 00000040:00080000:2.0:1763343036.148792:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1430, 88 off120744 00000004:00080000:2.0:1763343036.148795:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1229816174377ns, next at 1229610036645ns, rc = 0 00000100:00100000:0.0:1763343036.157889:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.158001:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993567872 00000100:00100000:1.0:1763343036.158017:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993567872 00000100:00100000:0.0:1763343036.158967:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9333 00000100:00100000:0.0:1763343036.158985:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56888:x1848997993567872:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343036.159012:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.159044:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6e40 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac94cb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.159127:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6e47 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.159143:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6e47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.159157:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6e47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343036.159216:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343036.159221:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343036.159262:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6e40 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94cb expref: 256 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.159283:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6e47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94cb expref: 255 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.159299:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2c00) 00010000:00010000:0.0:1763343036.159302:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343036.159306:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137400, rc 0) 00000100:00100000:0.0:1763343036.165936:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56888:x1848997993567872:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6925us (8029us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343036.165959:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9333 00000001:00080000:1.0:1763343036.170477:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939990 is committed 00000004:00080000:1.0:1763343036.170501:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 940 committed 00000004:00080000:1.0:1763343036.170518:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 941 committed 00000004:00080000:1.0:1763343036.170540:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 940 committed 00000004:00080000:1.0:1763343036.170543:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 939 committed 00010000:00010000:3.0:1763343036.171181:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6dfa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.171197:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6dfa lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.171205:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6dfa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.171212:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.171218:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6dfa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.171227:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6dfa lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.171249:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3403aab000) 00010000:00010000:3.0:1763343036.171254:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.171261:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6dfa lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.171268:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6dfa lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343036.171584:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010269184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343036.171700:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343036.171749:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343036.171756:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010269312:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343036.171781:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:2.0:1763343036.171855:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000027a102d1 reply state 00000000ba8dd945 transno 8589939990 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e39 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.171874:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.171884:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:2.0:1763343036.171887:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1763343036.171891:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1763343036.172035:0:10041:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1763343036.172057:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56886:x1848997993567744:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 23686us (25251us total) trans 8589939990 rc 0/0 00000100:00100000:2.0:1763343036.172069:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9332 00010000:00010000:2.0:1763343036.172117:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172126:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172133:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172139:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.172143:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172150:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172160:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:2.0:1763343036.172163:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343036.172165:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e39 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172172:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e39 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000100:00100000:2.0:1763343036.172200:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010269184 00000100:00100000:2.0:1763343036.172209:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010269184 00000100:00100000:2.0:1763343036.172250:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010269312 00000100:00100000:2.0:1763343036.172253:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010269312 00000100:00100000:2.0:1763343036.172271:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6545 00000100:00100000:2.0:1763343036.172293:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3657:x1848998010269184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343036.172437:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.172465:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993568000 00000100:00100000:2.0:1763343036.172468:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993568000 00000100:00100000:2.0:1763343036.172494:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9334 00000100:00100000:2.0:1763343036.172501:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56888:x1848997993568000:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.172516:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.172540:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6e4e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac94d2 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.172617:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e55 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172668:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172679:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172696:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e5c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172703:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172709:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172755:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e55 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172762:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e55 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172767:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172773:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e55 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172777:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.172781:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e55 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172787:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e55 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172795:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2c00) 00010000:00010000:2.0:1763343036.172798:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.172801:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e55 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172807:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e55 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172817:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172822:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e5c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172828:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172832:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.172835:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172841:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e5c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172848:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3aa00) 00010000:00010000:2.0:1763343036.172850:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.172853:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e5c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172862:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e5c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.172894:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6e4e lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94d2 expref: 246 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.172916:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2c00) 00010000:00010000:2.0:1763343036.172919:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.172922:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6e4e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94d2 expref: 246 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.172932:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:2.0:1763343036.172978:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56888:x1848997993568000:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 476us (541us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343036.172985:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9334 00000100:00100000:2.0:1763343036.173064:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:3657:x1848998010269184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 774us (1365us total) trans 17179871605 rc 0/0 00000100:00100000:2.0:1763343036.173071:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6545 00000004:00080000:2.0:1763343036.173119:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3503521f80/2, rc 0, transno 17179871605 00000100:00100000:2.0:1763343036.173126:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010269184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343036.173143:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6546 00000100:00100000:2.0:1763343036.173151:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3657:x1848998010269312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343036.173244:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:3657:x1848998010269312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (1460us total) trans 17179871606 rc 0/0 00000100:00100000:2.0:1763343036.173250:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6546 00000004:00080000:2.0:1763343036.173272:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3503521880/2, rc 0, transno 17179871606 00000100:00100000:2.0:1763343036.173277:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010269312:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343036.173800:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010269568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343036.173846:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343036.173881:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343036.173887:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010269440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343036.173922:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343036.173966:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010269568 00000100:00100000:1.0:1763343036.173972:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010269568 00000100:00100000:0.0:1763343036.173986:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010269440 00000100:00100000:0.0:1763343036.173991:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010269440 00000100:00100000:1.0:1763343036.174012:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6547 00000100:00100000:0.0:1763343036.174016:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6548 00000100:00100000:1.0:1763343036.174019:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3660:x1848998010269568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343036.174022:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3660:x1848998010269440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343036.174148:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3660:x1848998010269568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (301us total) trans 21474838903 rc 0/0 00000100:00100000:1.0:1763343036.174155:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6547 00000004:00080000:3.0:1763343036.174358:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad2680/2, rc 0, transno 21474838903 00000100:00100000:3.0:1763343036.174364:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010269568:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763343036.175252:0:8408:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2a5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343036.175257:0:8408:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2a5:0x0] updating lvb mtime from disk: 1763343035 -> 1763343035 00002000:00010000:1.0:1763343036.175261:0:8408:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2a5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343036.175263:0:8408:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2a5:0x0] updating lvb ctime from disk: 1763343035 -> 1763343035 00002000:00010000:1.0:1763343036.175266:0:8408:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2a5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343036.176168:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3660:x1848998010269440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2141us (2240us total) trans 21474838902 rc 0/0 00000100:00100000:1.0:1763343036.176179:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6548 00000004:00080000:3.0:1763343036.176464:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad1c00/2, rc 0, transno 21474838902 00000100:00100000:3.0:1763343036.176472:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010269440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343036.178386:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.179097:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993568128 00000100:00100000:0.0:1763343036.179113:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993568128 00000100:00100000:0.0:1763343036.179206:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9335 00000100:00100000:0.0:1763343036.179218:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56886:x1848997993568128:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343036.179251:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.179286:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6e63 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac94d9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.179369:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6e63 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94d9 expref: 245 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.179388:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6e63 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94d9 expref: 245 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.179413:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:0.0:1763343036.179417:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343036.179422:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405136600, rc 0) 00000100:00100000:0.0:1763343036.179508:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56886:x1848997993568128:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 291us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343036.179516:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9335 00000100:00100000:0.0:1763343036.183810:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.183917:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993568384 00000100:00100000:2.0:1763343036.183932:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993568384 00000100:00100000:2.0:1763343036.184405:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9336 00000100:00100000:2.0:1763343036.184419:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56888:x1848997993568384:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:1.0:1763343036.184437:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:2.0:1763343036.184777:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.184782:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343036.184821:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6e47 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94cb expref: 245 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.184847:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2c00) 00010000:00010000:2.0:1763343036.184862:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343036.184886:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6e6a lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac94e0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.185041:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e71 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.185056:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e71 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.185067:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e71 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.185081:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e78 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.185089:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.185095:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343036.187013:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993568512 00000100:00100000:3.0:1763343036.187032:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993568512 00000100:00100000:3.0:1763343036.187112:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9337 00000100:00100000:3.0:1763343036.187130:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56886:x1848997993568512:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343036.187156:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343036.187181:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6e7f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac94e7 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.187997:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e8d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.188016:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e8d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.188029:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e8d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343036.188040:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e1:0x0]: returning size 0 00010000:00010000:2.0:1763343036.188073:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e71 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.188081:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e71 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.188087:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e71 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.188094:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e71 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.188101:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.188105:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e71 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.188114:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e71 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.188128:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3503a3aa00) 00010000:00010000:2.0:1763343036.188131:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.188137:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e71 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.188147:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6e71 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:2.0:1763343036.188162:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a703c372 reply state 00000000556178c8 transno 8589939991 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.188174:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.188180:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a800) 00010000:00010000:2.0:1763343036.188183:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343036.188185:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343036.188221:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6e6a lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94e0 expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.188242:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e8d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94e0 expref: 248 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.188249:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a3503a3ad00) 00010000:00010000:2.0:1763343036.188252:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343036.188254:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352dc00, rc 0) 00010000:00010000:3.0:1763343036.188918:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6e86 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.188935:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6e86 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.188945:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6e86 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343036.188982:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e0:0x0]: returning size 5 00000004:00200000:3.0:1763343036.188987:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343036.189002:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6e86 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.189029:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae6e7f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94e7 expref: 250 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.189043:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6e86 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94e7 expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.189049:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:3.0:1763343036.189052:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763343036.189054:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343036.189153:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56886:x1848997993568512:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2024us (4714us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343036.189163:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9337 00000100:00100000:2.0:1763343036.191745:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56888:x1848997993568384:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 7191us (7814us total) trans 8589939991 rc 0/0 00000100:00100000:2.0:1763343036.191764:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9336 00000100:00100000:3.0:1763343036.193687:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.194831:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993568640 00000100:00100000:0.0:1763343036.194848:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993568640 00000100:00100000:0.0:1763343036.194932:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6549 00000100:00100000:0.0:1763343036.194945:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+33:2430:x1848997993568640:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343036.194968:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.194995:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405137800/0x607405d401ae6e9b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac94ee expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343036.195026:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a7:0x0] initial LVB size: 5, mtime: 0x691a7abb, atime: 0x0, ctime: 0x691a7abb, blocks: 0x8 00010000:00010000:0.0:1763343036.195050:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343036.195052:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343036.195066:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405137800/0x607405d401ae6e9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94ee expref: 34 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343036.195087:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3405137800/0x607405d401ae6e9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94ee expref: 34 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343036.195104:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137800, rc 0) 00000100:00100000:0.0:1763343036.195190:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2430:x1848997993568640:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 247us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343036.195197:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6549 00000100:00100000:0.0:1763343036.205886:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.205972:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993568896 00000100:00100000:2.0:1763343036.205986:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993568896 00000100:00100000:2.0:1763343036.206068:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9338 00000100:00100000:2.0:1763343036.206079:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56888:x1848997993568896:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.206112:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.206140:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6ea2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac94f5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.206289:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6ea9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.206306:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e8d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94e0 expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.206316:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6ea9 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.206360:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e8d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94e0 expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.206374:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e8d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94e0 expref: 249 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:2.0:1763343036.206391:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503523800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010269696:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343036.218875:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726180 going to sleep for 11 seconds 00000100:00100000:1.0:1763343036.219178:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.219390:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993569024 00000100:00100000:0.0:1763343036.219404:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993569024 00010000:00010000:0.0:1763343036.219460:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e8d lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94e0 expref: 250 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:0.0:1763343036.219519:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3077 00000100:00100000:0.0:1763343036.219532:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:2429:x1848997993569024:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343036.219554:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343036.219562:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e8d lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94e0 expref: 250 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343036.219577:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e8d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94e0 expref: 250 pid: 6525 timeout: 1329 lvb_type: 0 00010000:00010000:0.0:1763343036.219608:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a3503a3ad00) 00010000:00010000:0.0:1763343036.219615:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6ea9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.219668:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6ea9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.219677:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6ea9 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.219701:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343036.219766:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:2429:x1848997993569024:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 235us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343036.219773:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3077 00010000:00010000:3.0:1763343036.220321:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae6e8d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94e0 expref: 249 pid: 6525 timeout: 1329 lvb_type: 0 00000100:00100000:3.0:1763343036.220340:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503523800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010269696:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343036.220364:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6ea9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.220376:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6ea9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.220382:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6ea9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343036.220410:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e1:0x0]: returning size 0 00000004:00080000:3.0:1763343036.222363:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2a7:0x0], index 0: 0 00000004:00080000:3.0:1763343036.222407:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2a9:0x0], index 1: 0 00000004:00080000:3.0:1763343036.222415:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2aa:0x0], index 1: 0 00000004:00080000:3.0:1763343036.222421:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2a8:0x0], index 0: 0 00010000:00010000:3.0:1763343036.222613:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6ea9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.222673:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6ea9 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.222681:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6ea9 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.222687:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.222692:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6ea9 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.222700:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6ea9 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.222719:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a3503a3ad00) 00010000:00010000:3.0:1763343036.222723:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343036.222728:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6ea9 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.222739:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6ea9 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.222814:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6ea2 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94f5 expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.222827:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a3503a3ad00) 00010000:00010000:3.0:1763343036.222830:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343036.222833:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6ea2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94f5 expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.222851:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:3.0:1763343036.238582:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56888:x1848997993568896:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 32480us (32692us total) trans 8589939992 rc 301/301 00000100:00100000:3.0:1763343036.238601:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9338 00000100:00100000:1.0:1763343036.256731:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.256837:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993569280 00000100:00100000:2.0:1763343036.256852:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993569280 00000100:00100000:2.0:1763343036.256945:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3182 00000100:00100000:2.0:1763343036.256957:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353c652050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56888:x1848997993569280:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343036.257369:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353c652050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56888:x1848997993569280:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 413us (650us total) trans 8589939993 rc 0/0 00000100:00100000:2.0:1763343036.257378:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3182 00000100:00100000:0.0:1763343036.270599:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.270814:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993569536 00000100:00100000:2.0:1763343036.270829:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993569536 00000100:00100000:2.0:1763343036.270912:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3183 00000100:00100000:2.0:1763343036.270926:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56888:x1848997993569536:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343036.271214:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56888:x1848997993569536:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 291us (631us total) trans 8589939994 rc 0/0 00000100:00100000:2.0:1763343036.271223:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3183 00000100:00100000:3.0:1763343036.276850:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.277016:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993569792 00000100:00100000:0.0:1763343036.277035:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993569792 00000100:00100000:0.0:1763343036.277130:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9339 00000100:00100000:0.0:1763343036.277145:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:55941:x1848997993569792:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343036.277185:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.277222:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6eb7 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac94fc expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.277431:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ebe lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277450:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ebe lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277465:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ebe lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277477:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6ec5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277485:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277492:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277754:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6ecc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277778:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6ecc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277792:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6ecc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343036.277803:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e1:0x0]: returning size 0 00010000:00010000:0.0:1763343036.277896:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ebe lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277914:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ebe lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277920:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ebe lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277928:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ebe lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277934:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343036.277938:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ebe lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277946:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ebe lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277958:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2300) 00010000:00010000:0.0:1763343036.277962:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343036.277967:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ebe lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277973:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae6ebe lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277988:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277994:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6ec5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.277999:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.278008:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343036.278011:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.278017:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.278024:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a800) 00010000:00010000:0.0:1763343036.278026:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343036.278029:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6ec5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.278034:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae6ec5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.278080:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae6eb7 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94fc expref: 253 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.278099:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6ecc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94fc expref: 252 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.278106:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:0.0:1763343036.278108:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343036.278111:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480e00, rc 0) 00000100:00100000:0.0:1763343036.278191:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:55941:x1848997993569792:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1049us (1359us total) trans 8589939995 rc 0/0 00000100:00100000:0.0:1763343036.278200:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9339 00000100:00100000:1.0:1763343036.285912:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.285998:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993569920 00000100:00100000:0.0:1763343036.286010:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993569920 00000100:00100000:0.0:1763343036.286230:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9340 00000100:00100000:0.0:1763343036.286243:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:55941:x1848997993569920:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343036.286272:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.286294:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6eda lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9503 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.286332:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae6ee1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.286346:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae6ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.286357:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae6ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.286470:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6eda lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9503 expref: 254 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.286490:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae6ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9503 expref: 253 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.286499:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:0.0:1763343036.286502:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343036.286506:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480600, rc 0) 00000100:00100000:0.0:1763343036.286571:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:55941:x1848997993569920:12345-192.168.204.21@tcp:101:bash.0 Request processed in 332us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343036.286579:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9340 00000100:00100000:1.0:1763343036.296246:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.296507:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993570176 00000100:00100000:0.0:1763343036.296518:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993570176 00000100:00100000:0.0:1763343036.298214:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9341 00000100:00100000:0.0:1763343036.298235:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:55941:x1848997993570176:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343036.298292:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343036.298318:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6ecc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94fc expref: 253 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.298339:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:0.0:1763343036.298344:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343036.298527:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6ee8 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.298540:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.298549:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:0.0:1763343036.298592:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939996 00000004:00010000:0.0:1763343036.298615:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004c366d7f reply state 00000000aa7cc3dc transno 8589939997 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.301781:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6ee8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.301791:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:0.0:1763343036.301794:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343036.301798:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343036.301950:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:55941:x1848997993570176:12345-192.168.204.21@tcp:36:bash.0 Request processed in 3719us (5709us total) trans 8589939997 rc 0/0 00000100:00100000:0.0:1763343036.301958:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9341 00000020:00080000:0.0:1763343036.301964:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343036.309416:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.309464:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.309532:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993570432 00000100:00100000:1.0:1763343036.309543:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993570432 00000100:00100000:0.0:1763343036.309553:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993570304 00000100:00100000:0.0:1763343036.309560:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993570304 00000100:00100000:1.0:1763343036.309609:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9342 00000100:00100000:0.0:1763343036.309610:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6550 00000100:00100000:1.0:1763343036.309646:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:55941:x1848997993570432:12345-192.168.204.21@tcp:101:bash.0 00000100:00100000:0.0:1763343036.309657:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2429:x1848997993570304:12345-192.168.204.21@tcp:23:lfs.0 00010000:00010000:1.0:1763343036.309672:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.309695:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6eef lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac950a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.309747:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6eef lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac950a expref: 256 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343036.309762:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2429:x1848997993570304:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 141us (357us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343036.309763:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6eef lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac950a expref: 256 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343036.309778:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6550 00010000:00010000:1.0:1763343036.309788:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:1.0:1763343036.309793:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343036.309797:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00000100:00100000:1.0:1763343036.309824:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:55941:x1848997993570432:12345-192.168.204.21@tcp:101:bash.0 Request processed in 204us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.309831:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9342 00000100:00100000:1.0:1763343036.322138:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.322187:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.322373:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993570816 00000100:00100000:2.0:1763343036.322385:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993570816 00000100:00100000:2.0:1763343036.322443:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6551 00000100:00100000:2.0:1763343036.322454:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2430:x1848997993570816:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:3.0:1763343036.322508:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993570688 00000100:00100000:3.0:1763343036.322515:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993570688 00000100:00100000:2.0:1763343036.322579:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2430:x1848997993570816:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 126us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.322587:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6551 00000100:00100000:2.0:1763343036.324007:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9343 00000100:00100000:2.0:1763343036.324023:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:55941:x1848997993570688:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343036.324041:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.324044:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343036.324082:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6eef lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac950a expref: 256 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.324101:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:2.0:1763343036.324106:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343036.324120:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6ef6 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9511 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.324172:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6efd lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.324185:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6efd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.324195:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6efd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000040:00080000:2.0:1763343036.324438:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1430, 88 off120832 00000004:00080000:2.0:1763343036.324447:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1229991825738ns, next at 1229609967587ns, rc = 0 00000040:00080000:2.0:1763343036.324494:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1431, 88 off120832 00000004:00080000:2.0:1763343036.324500:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1229991878891ns, next at 1229610036645ns, rc = 0 00000040:00080000:2.0:1763343036.324531:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1432, 88 off120920 00000004:00080000:2.0:1763343036.324535:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1229991914560ns, next at 1229610036645ns, rc = 0 00000040:00080000:2.0:1763343036.324545:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1431, 88 off120920 00000004:00080000:2.0:1763343036.324549:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1229991927751ns, next at 1229609967587ns, rc = 0 00000001:00080000:1.0:1763343036.329544:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939998 is committed 00000004:00080000:1.0:1763343036.329559:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 943 committed 00000004:00080000:1.0:1763343036.329576:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 942 committed 00000004:00080000:1.0:1763343036.329589:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 941 committed 00000004:00080000:1.0:1763343036.329592:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 942 committed 00010000:00010000:3.0:1763343036.329969:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6efd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9511 expref: 250 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.329991:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:3.0:1763343036.329995:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343036.330014:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae6ef6 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9511 expref: 250 pid: 10041 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763343036.330042:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6efd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e1:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9511 expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.330081:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:3.0:1763343036.330084:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343036.330086:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d400, rc 0) 00000100:00100000:3.0:1763343036.330172:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:55941:x1848997993570688:12345-192.168.204.21@tcp:101:bash.0 Request processed in 6153us (8042us total) trans 8589939998 rc 0/0 00000100:00100000:3.0:1763343036.330184:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9343 00010000:00010000:2.0:1763343036.330320:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.330331:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e78 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.330338:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.330345:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.330350:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.330358:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e78 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.330369:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a800) 00010000:00010000:2.0:1763343036.330382:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.330388:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e78 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.330396:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae6e78 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.330418:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6ee8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.330424:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6ee8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.330429:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6ee8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.330435:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501481200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.330438:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6ee8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.330443:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6ee8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.330452:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:2.0:1763343036.330455:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.330458:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6ee8 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.330464:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6ee8 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000100:00100000:0.0:1763343036.330709:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a351fc74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010269952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343036.330787:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343036.330833:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343036.330839:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a351fc76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010269824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343036.330862:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343036.331001:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010270208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343036.331029:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343036.331052:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763343036.331058:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010270080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343036.331079:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343036.331114:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010269952 00000100:00100000:0.0:1763343036.331123:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010269952 00000100:00100000:0.0:1763343036.331170:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010269824 00000100:00100000:0.0:1763343036.331173:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010269824 00000100:00100000:0.0:1763343036.331189:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010270208 00000100:00100000:0.0:1763343036.331191:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010270208 00000100:00100000:0.0:1763343036.331211:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010270080 00000100:00100000:0.0:1763343036.331214:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010270080 00000100:00100000:0.0:1763343036.331239:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6552 00000100:00100000:0.0:1763343036.331248:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+60:3658:x1848998010269952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343036.331476:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+61:3658:x1848998010269952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 227us (687us total) trans 17179871607 rc 0/0 00000100:00100000:0.0:1763343036.331483:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6552 00000100:00100000:0.0:1763343036.331502:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6553 00000100:00100000:0.0:1763343036.331508:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+60:3658:x1848998010269824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343036.331580:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+61:3658:x1848998010269824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (717us total) trans 17179871608 rc 0/0 00000100:00100000:0.0:1763343036.331587:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6553 00000100:00100000:0.0:1763343036.331598:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6554 00000100:00100000:0.0:1763343036.331604:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3660:x1848998010270208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343036.331739:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+33:3660:x1848998010270208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (707us total) trans 21474838904 rc 0/0 00000100:00100000:0.0:1763343036.331745:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6554 00000100:00100000:0.0:1763343036.331757:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6555 00000100:00100000:0.0:1763343036.331763:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3660:x1848998010270080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343036.331836:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+33:3660:x1848998010270080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (755us total) trans 21474838905 rc 0/0 00000100:00100000:0.0:1763343036.331842:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6555 00000004:00080000:0.0:1763343036.331921:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a351fc76d80/2, rc 0, transno 17179871608 00000100:00100000:0.0:1763343036.331928:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a351fc76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010269824:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343036.331939:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a351fc74e00/2, rc 0, transno 17179871607 00000100:00100000:0.0:1763343036.331943:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a351fc74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010269952:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343036.331965:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062cad80/2, rc 0, transno 21474838905 00000100:00100000:0.0:1763343036.331970:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010270080:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343036.331978:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062cb100/2, rc 0, transno 21474838904 00000100:00100000:0.0:1763343036.331981:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010270208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343036.335898:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.336030:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993570944 00000100:00100000:0.0:1763343036.336041:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993570944 00000100:00100000:0.0:1763343036.336175:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1598 00000100:00100000:0.0:1763343036.336190:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2429:x1848997993570944:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:0.0:1763343036.336237:0:28424:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae6f04 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.336253:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343036.336256:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343036.336262:0:28424:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae6f04 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.336278:0:28424:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae6f04 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.336376:0:28424:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae6f04 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.336385:0:28424:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae6f04 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.336394:0:28424:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae6f04 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.336401:0:28424:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343036.336404:0:28424:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae6f04 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.336417:0:28424:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae6f04 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.336432:0:28424:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae6f04 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.336438:0:28424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae6f04 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343036.336509:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2429:x1848997993570944:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 321us (619us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763343036.336516:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1598 00000100:00100000:1.0:1763343036.344547:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.346025:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993571072 00000100:00100000:3.0:1763343036.346044:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993571072 00000100:00100000:3.0:1763343036.346131:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6556 00000100:00100000:3.0:1763343036.346142:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993571072:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343036.346168:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343036.346199:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6f0b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9518 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343036.346231:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343036.346260:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.346262:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.346274:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6f0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9518 expref: 18 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.346295:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6f0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9518 expref: 18 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.346313:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93600, rc 0) 00000100:00100000:3.0:1763343036.346415:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:55941:x1848997993571072:12345-192.168.204.21@tcp:101:bash.0 Request processed in 274us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343036.346423:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6556 00000100:00100000:2.0:1763343036.348708:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.349016:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993571200 00000100:00100000:3.0:1763343036.349029:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993571200 00000100:00100000:1.0:1763343036.351757:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9344 00000100:00100000:1.0:1763343036.351790:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56886:x1848997993571200:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.351827:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.351860:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6f12 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac951f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.351918:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae6f19 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.351937:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae6f19 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.351954:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae6f19 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.352116:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6f12 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac951f expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.352140:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177600/0x607405d401ae6f19 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac951f expref: 248 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.352149:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:1.0:1763343036.352152:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343036.352157:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177600, rc 0) 00000100:00100000:1.0:1763343036.352257:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56886:x1848997993571200:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 483us (3562us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.352268:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9344 00000100:00100000:2.0:1763343036.353529:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.353732:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993571328 00000100:00100000:3.0:1763343036.353745:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993571328 00000100:00100000:3.0:1763343036.353811:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6557 00000100:00100000:3.0:1763343036.353822:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:55941:x1848997993571328:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343036.353843:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343036.353868:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6f20 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9526 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343036.353908:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343036.353933:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.353936:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.353947:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6f20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9526 expref: 35 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.353964:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6f20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9526 expref: 35 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.353978:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343036.354030:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+35:55941:x1848997993571328:12345-192.168.204.21@tcp:101:bash.0 Request processed in 209us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343036.354040:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6557 00000100:00100000:3.0:1763343036.366009:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.366199:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993571456 00000100:00100000:0.0:1763343036.366215:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993571456 00002000:00010000:0.0:1763343036.366279:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/679 (0->18446744073709551615) 00002000:00100000:0.0:1763343036.366285:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a351fc76300 with x1848997993571456 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343036.366302:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a351fc76300. 00000100:00100000:0.0:1763343036.366354:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1599 00000100:00100000:0.0:1763343036.366368:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993571456:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343036.366602:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2a7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343036.366606:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2a7:0x0] updating lvb mtime from disk: 0 -> 1763343036 00002000:00010000:0.0:1763343036.366609:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2a7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343036.366612:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2a7:0x0] updating lvb ctime from disk: 0 -> 1763343036 00002000:00010000:0.0:1763343036.366614:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2a7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343036.366917:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.367225:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993571712 00000100:00100000:1.0:1763343036.367232:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993571712 00000100:00100000:1.0:1763343036.367291:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1600 00000100:00100000:1.0:1763343036.367300:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993571712:12345-192.168.204.21@tcp:4:lfs.0 00002000:00010000:1.0:1763343036.367349:0:8415:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343036.367358:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae6f27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.367374:0:8415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.367377:0:8415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.367383:0:8415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae6f27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.367457:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae6f27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343036.367555:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993571456:12345-192.168.204.21@tcp:10:bash.0 Request processed in 1188us (1559us total) trans 21474838906 rc 0/0 00000100:00100000:0.0:1763343036.367568:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1599 00002000:00010000:0.0:1763343036.367573:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/679 (0->18446744073709551615) 00002000:00100000:0.0:1763343036.367577:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a351fc76300 with x1848997993571456 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343036.367584:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a351fc76300. 00000100:00100000:3.0:1763343036.367843:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.368057:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993571584 00000100:00100000:0.0:1763343036.368064:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993571584 00002000:00010000:0.0:1763343036.368086:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/681 (0->18446744073709551615) 00002000:00100000:0.0:1763343036.368089:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a351fc75c00 with x1848997993571584 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343036.368098:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a351fc75c00. 00000100:00100000:0.0:1763343036.368129:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1601 00000100:00100000:0.0:1763343036.368139:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+35:2429:x1848997993571584:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343036.368261:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2a9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343036.368265:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2a9:0x0] updating lvb mtime from disk: 0 -> 1763343036 00002000:00010000:0.0:1763343036.368268:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2a9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343036.368270:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2a9:0x0] updating lvb ctime from disk: 0 -> 1763343036 00002000:00010000:0.0:1763343036.368272:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2a9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343036.368308:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+36:2429:x1848997993571584:12345-192.168.204.21@tcp:10:bash.0 Request processed in 171us (467us total) trans 17179871609 rc 0/0 00000100:00100000:0.0:1763343036.368315:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1601 00002000:00010000:0.0:1763343036.368319:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/681 (0->18446744073709551615) 00002000:00100000:0.0:1763343036.368322:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a351fc75c00 with x1848997993571584 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343036.368327:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a351fc75c00. 00000100:00100000:3.0:1763343036.375729:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.376181:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993571968 00000100:00100000:0.0:1763343036.376196:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993571968 00000001:00080000:1.0:1763343036.378373:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838907 is committed 00000001:00080000:1.0:1763343036.378399:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838905 is committed 00000100:00100000:2.0:1763343036.378760:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3184 00000100:00100000:2.0:1763343036.378783:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:55941:x1848997993571968:12345-192.168.204.21@tcp:35:bash.0 00002000:00010000:3.0:1763343036.379422:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2a6:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1763343036.379428:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2a6:0x0] updating lvb mtime from disk: 0 -> 1763343036 00002000:00010000:3.0:1763343036.379431:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2a6:0x0] updating lvb ctime from disk: 0 -> 1763343036 00002000:00010000:3.0:1763343036.379434:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2a6:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763343036.379451:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae6f27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.379463:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae6f27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.379473:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae6f27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.379480:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343036.379485:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae6f27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.379495:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae6f27 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.379518:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae6f27 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.379525:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae6f27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343036.380728:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:55941:x1848997993571968:12345-192.168.204.21@tcp:35:bash.0 Request processed in 1943us (5001us total) trans 8589939999 rc 0/0 00000100:00100000:2.0:1763343036.380744:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3184 00000100:00100000:3.0:1763343036.381238:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2429:x1848997993571712:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 13934us (14318us total) trans 21474838907 rc 0/0 00000100:00100000:3.0:1763343036.381249:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1600 00000100:00100000:3.0:1763343036.393357:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.393517:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993572096 00000100:00100000:0.0:1763343036.393530:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993572096 00000100:00100000:0.0:1763343036.393610:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9345 00000100:00100000:0.0:1763343036.393908:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56889:x1848997993572096:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:0.0:1763343036.393942:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.393976:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae6f2e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac952d expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.394065:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6f35 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394082:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6f35 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394096:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6f35 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394110:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6f3c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394117:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6f3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394123:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6f3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394211:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae6f43 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394219:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae6f43 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394224:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae6f43 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343036.394280:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e1:0x0]: returning size 5 00000004:00200000:0.0:1763343036.394285:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343036.394308:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae6f43 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394321:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae6f43 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394330:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6f35 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394336:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6f35 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394342:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6f35 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394348:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6f35 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394354:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501481200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343036.394359:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6f35 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394366:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6f35 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394380:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2300) 00010000:00010000:0.0:1763343036.394384:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343036.394390:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6f35 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394396:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae6f35 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394416:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6f3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394422:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6f3c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394427:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6f3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394432:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343036.394435:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6f3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394440:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6f3c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394447:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c2e00) 00010000:00010000:0.0:1763343036.394449:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343036.394452:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6f3c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394457:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae6f3c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.394491:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae6f2e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac952d expref: 251 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.394506:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae6f43 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac952d expref: 250 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.394514:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:0.0:1763343036.394517:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343036.394520:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dc400, rc 0) 00000100:00100000:0.0:1763343036.394610:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56889:x1848997993572096:12345-192.168.204.21@tcp:101:rm.0 Request processed in 990us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343036.394674:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9345 00000100:00100000:1.0:1763343036.397732:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.398663:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993572352 00000100:00100000:0.0:1763343036.398682:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993572352 00000100:00100000:0.0:1763343036.398760:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9346 00000100:00100000:0.0:1763343036.398771:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56886:x1848997993572352:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343036.398843:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343036.398879:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae6e86 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e0:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94e7 expref: 250 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.398916:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:0.0:1763343036.398923:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343036.399017:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae6f4a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.399035:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae6f4a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.399046:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae6f4a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00010000:0.0:1763343036.399207:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000922a2f64 reply state 00000000ce13eb5e transno 8589940000 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae6f4a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.399222:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae6f4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.399230:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:0.0:1763343036.399234:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343036.399237:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343036.399375:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56886:x1848997993572352:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 604us (1656us total) trans 8589940000 rc 0/0 00000100:00100000:0.0:1763343036.399384:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9346 00000100:00100000:2.0:1763343036.402073:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.402161:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993572608 00000100:00100000:1.0:1763343036.402175:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993572608 00000100:00100000:1.0:1763343036.402247:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9347 00000100:00100000:1.0:1763343036.402258:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56889:x1848997993572608:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:1.0:1763343036.402335:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343036.402377:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6efd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9511 expref: 251 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.404277:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae6f43 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac952d expref: 250 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.404314:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae6ee1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9503 expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343036.404316:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:1.0:1763343036.404334:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:1.0:1763343036.404348:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343036.404389:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6f51 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.404405:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6f51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.404418:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6f51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.404432:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6f58 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.404439:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6f58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.404446:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6f58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.404562:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6f5f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.404571:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6f5f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.404583:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6f5f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000040:00080000:1.0:1763343036.404952:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1432, 64 off120984 00000004:00080000:1.0:1763343036.404962:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1230072340683ns, next at 1231072337277ns, rc = 0 00000040:00080000:1.0:1763343036.404990:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1433, 64 off120984 00000004:00080000:1.0:1763343036.404995:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1230072374736ns, next at 1231072373054ns, rc = 0 00000040:00080000:1.0:1763343036.405006:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1434, 64 off121048 00000040:00080000:1.0:1763343036.405015:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1433, 64 off121048 00010000:00010000:1.0:1763343036.405083:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6f66 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.405094:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6f66 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.405104:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6f66 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.405111:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6f66 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.405118:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6f66 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.405124:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6f66 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.405150:0:6525:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343036.405181:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6f5f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.405188:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6f5f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.405195:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6f5f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.405200:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.405205:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6f5f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.405213:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6f5f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.405457:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343036.405471:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6f66 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.405480:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343036.405484:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6f66 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.405490:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6f66 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.405502:0:13198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a3404421b00) 00010000:00010000:0.0:1763343036.405506:0:13198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343036.405511:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6f66 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.405517:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6f66 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1e1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.405532:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343036.405534:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343036.405535:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343036.406200:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993572736 00000100:00100000:2.0:1763343036.406214:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993572736 00000100:00100000:2.0:1763343036.406301:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6558 00000100:00100000:2.0:1763343036.406313:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:56886:x1848997993572736:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.406338:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.406371:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae6f6d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9534 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343036.406402:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a6:0x0] initial LVB size: 4096, mtime: 0x691a7abc, atime: 0x0, ctime: 0x691a7abc, blocks: 0x8 00010000:00010000:2.0:1763343036.406430:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.406433:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.406443:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae6f6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9534 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.406460:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae6f6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9534 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.406474:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352de00, rc 0) 00000100:00100000:2.0:1763343036.406567:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:56886:x1848997993572736:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 256us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.406575:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6558 00010000:00010000:1.0:1763343036.407430:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e1:0x0].0x0 (ffff9a3404421b00) 00010000:00010000:1.0:1763343036.407433:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343036.407441:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6f5f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.407448:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae6f5f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.409316:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6f51 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.409334:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6f51 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.409341:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6f51 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.409348:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6f51 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.409355:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.409359:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6f51 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.409372:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6f51 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.409403:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421400) 00010000:00010000:1.0:1763343036.409406:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343036.409411:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6f51 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.409418:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6f51 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:1.0:1763343036.409438:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000772106e reply state 0000000052171488 transno 8589940001 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6f58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.409452:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6f58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.409459:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421800) 00010000:00010000:1.0:1763343036.409462:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343036.409465:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343036.409598:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56889:x1848997993572608:12345-192.168.204.21@tcp:36:rm.0 Request processed in 7334us (7533us total) trans 8589940001 rc 0/0 00000100:00100000:1.0:1763343036.409609:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9347 00000100:00100000:0.0:1763343036.414272:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.414465:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993572864 00000100:00100000:2.0:1763343036.414481:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993572864 00000100:00100000:2.0:1763343036.414556:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6559 00000100:00100000:2.0:1763343036.414568:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+36:56886:x1848997993572864:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.414592:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.414644:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae6f74 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac953b expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343036.414673:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343036.414701:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.414704:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.414714:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae6f74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac953b expref: 37 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.414746:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae6f74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac953b expref: 37 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.414761:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c400, rc 0) 00000100:00100000:2.0:1763343036.414837:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+37:56886:x1848997993572864:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 270us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.414845:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6559 00000100:00100000:3.0:1763343036.428339:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.428407:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.428463:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993572992 00000100:00100000:1.0:1763343036.428477:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993572992 00002000:00010000:1.0:1763343036.428534:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/678 (5->18446744073709551615) 00002000:00100000:1.0:1763343036.428540:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a351fc75500 with x1848997993572992 ext(5->18446744073709551615) 00002000:00010000:1.0:1763343036.428555:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a351fc75500. 00000100:00100000:1.0:1763343036.428595:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1602 00000100:00100000:1.0:1763343036.428607:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993572992:12345-192.168.204.21@tcp:10:lfs.0 00000100:00100000:0.0:1763343036.428830:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993573120 00000100:00100000:0.0:1763343036.428837:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993573120 00002000:00010000:0.0:1763343036.428860:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/680 (0->18446744073709551615) 00002000:00100000:0.0:1763343036.428865:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537912300 with x1848997993573120 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343036.428875:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537912300. 00000100:00100000:0.0:1763343036.428962:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1603 00000100:00100000:0.0:1763343036.428972:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+37:2430:x1848997993573120:12345-192.168.204.21@tcp:10:lfs.0 00000100:00100000:3.0:1763343036.428987:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00002000:00010000:0.0:1763343036.429118:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2a8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343036.429121:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2a8:0x0] updating lvb mtime from disk: 0 -> 1763343036 00002000:00010000:0.0:1763343036.429124:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2a8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343036.429127:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2a8:0x0] updating lvb ctime from disk: 0 -> 1763343036 00002000:00010000:0.0:1763343036.429129:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2a8:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1763343036.429160:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2a6:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:1.0:1763343036.429165:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2a6:0x0] updating lvb mtime from disk: 1763343036 -> 1763343036 00002000:00010000:1.0:1763343036.429169:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2a6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343036.429171:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2a6:0x0] updating lvb ctime from disk: 1763343036 -> 1763343036 00002000:00010000:1.0:1763343036.429173:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2a6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343036.429202:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+38:2430:x1848997993573120:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 230us (792us total) trans 17179871610 rc 0/0 00000100:00100000:1.0:1763343036.429207:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993572992:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 600us (880us total) trans 21474838908 rc 0/0 00000100:00100000:0.0:1763343036.429216:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1603 00002000:00010000:0.0:1763343036.429221:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/680 (0->18446744073709551615) 00002000:00100000:0.0:1763343036.429224:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537912300 with x1848997993573120 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343036.429230:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537912300. 00000100:00100000:1.0:1763343036.429234:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1602 00002000:00010000:1.0:1763343036.429239:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/678 (5->18446744073709551615) 00002000:00100000:1.0:1763343036.429242:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a351fc75500 with x1848997993572992 ext(5->18446744073709551615) 00002000:00010000:1.0:1763343036.429247:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a351fc75500. 00000100:00100000:2.0:1763343036.429303:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993573248 00000100:00100000:2.0:1763343036.429309:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993573248 00000100:00100000:2.0:1763343036.429364:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9348 00000100:00100000:2.0:1763343036.429372:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56890:x1848997993573248:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.429391:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.429417:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6f7b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9542 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.429498:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6f82 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429515:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6f82 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429754:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6f82 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429772:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6f89 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429782:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6f89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429789:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6f89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429835:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6f82 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429843:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6f82 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429851:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6f82 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429858:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.429864:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6f82 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429873:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6f82 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429890:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7000) 00010000:00010000:2.0:1763343036.429893:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.429910:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6f82 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429918:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae6f82 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429932:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6f89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429938:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6f89 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429944:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6f89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429950:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.429952:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6f89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429958:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6f89 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429965:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421800) 00010000:00010000:2.0:1763343036.429968:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.429971:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6f89 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.429977:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6f89 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.430007:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6f7b lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9542 expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.430019:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7000) 00010000:00010000:2.0:1763343036.430021:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.430025:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6f7b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9542 expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.430040:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d200, rc 0) 00000100:00100000:2.0:1763343036.430090:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56890:x1848997993573248:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 719us (1104us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343036.430097:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9348 00000100:00100000:1.0:1763343036.435353:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.436490:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.436643:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993573376 00000100:00100000:2.0:1763343036.436656:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993573376 00000100:00100000:2.0:1763343036.436732:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993573632 00000100:00100000:2.0:1763343036.436736:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993573632 00000100:00100000:2.0:1763343036.436768:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9349 00000100:00100000:2.0:1763343036.436780:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56890:x1848997993573376:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.436806:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.436837:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6f90 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9549 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.436934:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae6f97 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.436951:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae6f97 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.436964:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae6f97 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.436976:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6f9e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.436984:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6f9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.436991:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6f9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437039:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae6f97 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437046:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae6f97 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437052:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae6f97 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437058:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae6f97 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437063:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.437068:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae6f97 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437075:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae6f97 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437088:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7e00) 00010000:00010000:2.0:1763343036.437092:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.437096:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae6f97 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437102:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae6f97 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437116:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6f9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437122:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6f9e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437128:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6f9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437132:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.437134:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6f9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437139:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6f9e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437144:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421800) 00010000:00010000:2.0:1763343036.437146:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.437148:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6f9e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437153:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae6f9e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.437177:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6f90 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9549 expref: 252 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.437186:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7e00) 00010000:00010000:2.0:1763343036.437188:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.437191:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae6f90 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9549 expref: 252 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.437203:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d400, rc 0) 00000100:00100000:0.0:1763343036.437486:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9350 00000100:00100000:0.0:1763343036.437498:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56886:x1848997993573632:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343036.437566:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae6fa5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.437577:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae6fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.437585:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae6fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343036.437750:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e6cbf994 reply state 0000000081523326 transno 8589940002 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae6fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.437769:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae6fa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.437776:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:0.0:1763343036.437779:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343036.437782:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343036.437856:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56886:x1848997993573632:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 360us (1372us total) trans 8589940002 rc 0/0 00000100:00100000:0.0:1763343036.437864:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9350 00000100:00100000:2.0:1763343036.441344:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56890:x1848997993573376:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 496us (1935us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343036.441383:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9349 00000100:00100000:3.0:1763343036.443175:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.443229:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.443285:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993573760 00000100:00100000:1.0:1763343036.443298:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993573760 00000100:00100000:1.0:1763343036.443375:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6560 00000100:00100000:1.0:1763343036.443388:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+38:56886:x1848997993573760:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.443416:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.443442:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6fac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9550 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.443478:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405137800/0x607405d401ae6e9b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94ee expref: 39 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343036.443487:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.443489:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.443495:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6fac lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9550 expref: 39 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.443537:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3405137800/0x607405d401ae6e9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94ee expref: 39 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343036.443552:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3405137800/0x607405d401ae6e9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94ee expref: 39 pid: 8408 timeout: 1330 lvb_type: 1 00000100:00100000:1.0:1763343036.443568:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010270336:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343036.443708:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343036.443915:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993573888 00000100:00100000:2.0:1763343036.443921:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993573888 00000100:00100000:2.0:1763343036.443968:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9351 00000100:00100000:2.0:1763343036.443977:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56890:x1848997993573888:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.443993:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.444015:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6fb3 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9557 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.444088:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6fba lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.444103:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6fba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.444117:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6fba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343036.444172:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343036.444179:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343036.444221:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae6fb3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9557 expref: 254 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.444242:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6fba lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9557 expref: 253 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.444252:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7000) 00010000:00010000:2.0:1763343036.444255:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343036.444259:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c600, rc 0) 00000100:00100000:2.0:1763343036.444312:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56890:x1848997993573888:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 335us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.444319:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9351 00000100:00100000:1.0:1763343036.449438:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010270336:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343036.449491:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6fac lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9550 expref: 39 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.449521:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00000100:00100000:1.0:1763343036.449613:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:56886:x1848997993573760:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6227us (6447us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.449670:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6560 00000100:00100000:0.0:1763343036.450773:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.450823:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.450908:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993574144 00000100:00100000:3.0:1763343036.450920:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993574144 00010000:00010000:3.0:1763343036.450968:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405137800/0x607405d401ae6e9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94ee expref: 39 pid: 8408 timeout: 1330 lvb_type: 1 00000100:00100000:3.0:1763343036.451016:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3078 00000100:00100000:3.0:1763343036.451026:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3508046c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2430:x1848997993574144:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343036.451044:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343036.451071:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3405137800/0x607405d401ae6e9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94ee expref: 39 pid: 8408 timeout: 1330 lvb_type: 1 00010000:00010000:3.0:1763343036.451085:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3405137800/0x607405d401ae6e9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94ee expref: 39 pid: 8408 timeout: 1330 lvb_type: 1 00010000:00010000:3.0:1763343036.451116:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405137800/0x607405d401ae6e9b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94ee expref: 39 pid: 8408 timeout: 1330 lvb_type: 1 00000100:00100000:1.0:1763343036.451124:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993574016 00000100:00100000:1.0:1763343036.451129:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993574016 00010000:00010000:3.0:1763343036.451136:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.451138:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.451147:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6fac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9550 expref: 38 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.451159:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6fac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9550 expref: 38 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343036.451170:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9352 00000100:00100000:1.0:1763343036.451177:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56890:x1848997993574016:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.451197:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343036.451205:0:27834:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6fac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9550 expref: 38 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343036.451221:0:27834:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537910e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:27834:1848998010270464:192.168.204.21@tcp:105: 00010000:00010000:1.0:1763343036.451221:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6fc1 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac955e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.451469:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6fc8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451486:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451497:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451508:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6fcf lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451514:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6fcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451519:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6fcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451574:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6fc8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451582:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6fc8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451588:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6fc8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451595:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6fc8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451602:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.451607:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6fc8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451706:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6fc8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451718:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7000) 00010000:00010000:1.0:1763343036.451721:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343036.451728:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6fc8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451735:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae6fc8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451748:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6fcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451754:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6fcf lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451760:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6fcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451765:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.451768:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6fcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451778:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6fcf lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451785:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421800) 00010000:00010000:1.0:1763343036.451788:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343036.451791:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6fcf lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451796:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae6fcf lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.451825:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6fc1 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac955e expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.451835:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7000) 00010000:00010000:1.0:1763343036.451838:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343036.451842:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae6fc1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac955e expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.451973:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:2.0:1763343036.452040:0:27834:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509bdf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343036.452104:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56890:x1848997993574016:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 924us (1335us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343036.452112:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9352 00000100:00100000:2.0:1763343036.457982:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.458182:0:27834:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537910e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:27834:1848998010270464:192.168.204.21@tcp:105: 00010000:00010000:3.0:1763343036.458222:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343036.458266:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993574400 00000100:00100000:1.0:1763343036.458276:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993574400 00000100:00100000:3.0:1763343036.458304:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3508046c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+38:2430:x1848997993574144:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 7278us (7479us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343036.458318:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3078 00000100:00100000:1.0:1763343036.458350:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9353 00000100:00100000:1.0:1763343036.458359:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56890:x1848997993574400:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.458388:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.458392:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343036.458430:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae6fba lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9557 expref: 253 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.458454:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3538bf7000) 00010000:00010000:1.0:1763343036.458478:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343036.458500:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6fd6 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9565 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.458661:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6fdd lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.458677:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6fdd lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.458688:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6fdd lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.458700:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6fe4 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.458708:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.458714:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.459217:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae6feb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.459226:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae6feb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.459234:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae6feb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343036.459245:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e3:0x0]: returning size 0 00000100:00100000:0.0:1763343036.459427:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.459616:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993574528 00000100:00100000:3.0:1763343036.459647:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993574528 00000100:00100000:3.0:1763343036.459729:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6561 00000100:00100000:3.0:1763343036.459738:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+38:2429:x1848997993574528:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:3.0:1763343036.459856:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343036.459860:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb mtime from disk: 1763343035 -> 1763343035 00002000:00010000:3.0:1763343036.459863:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb atime from disk: 0 -> 1763343035 00002000:00010000:3.0:1763343036.459865:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb ctime from disk: 1763343035 -> 1763343036 00002000:00010000:3.0:1763343036.459869:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343036.459930:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2429:x1848997993574528:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 193us (504us total) trans 17179871611 rc 0/0 00000100:00100000:3.0:1763343036.459937:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6561 00010000:00010000:1.0:1763343036.460112:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6fdd lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.460121:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6fdd lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.460127:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6fdd lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.460133:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6fdd lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.460140:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.460145:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6fdd lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.460153:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6fdd lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.460166:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421400) 00010000:00010000:1.0:1763343036.460169:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343036.460174:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6fdd lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.460180:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae6fdd lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:1.0:1763343036.460195:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000015655bd2 reply state 00000000ff192e7b transno 8589940003 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.460208:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6fe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.460214:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421800) 00010000:00010000:1.0:1763343036.460217:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343036.460219:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343036.460253:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae6fd6 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9565 expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.460288:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae6feb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9565 expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.460296:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a3404421b00) 00010000:00010000:1.0:1763343036.460299:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343036.460301:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3ea00, rc 0) 00000100:00100000:1.0:1763343036.460333:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56890:x1848997993574400:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1975us (2380us total) trans 8589940003 rc 0/0 00000100:00100000:1.0:1763343036.460340:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9353 00000100:00100000:0.0:1763343036.467060:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.467321:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993574784 00000100:00100000:2.0:1763343036.467335:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993574784 00000100:00100000:2.0:1763343036.467421:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3185 00000100:00100000:2.0:1763343036.467436:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56886:x1848997993574784:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343036.467696:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.467755:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993575040 00000100:00100000:1.0:1763343036.467762:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993575040 00000100:00100000:1.0:1763343036.467806:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9354 00000100:00100000:1.0:1763343036.467813:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56890:x1848997993575040:12345-192.168.204.21@tcp:101:lfs.0 00000004:00010000:2.0:1763343036.467818:0:14879:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1e0:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6de5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94b6 expref: 256 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.467824:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.467849:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae6ff9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac956c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.467872:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343036.467886:0:14879:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6e63 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94d9 expref: 257 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.467909:0:14879:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343036.467952:0:14879:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6e63 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94d9 expref: 257 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.467967:0:14879:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6e63 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94d9 expref: 257 pid: 6525 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.467970:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7007 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.467980:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae6feb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9565 expref: 257 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343036.467983:0:14879:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010270592:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343036.467987:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7007 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.468003:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae6feb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9565 expref: 257 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.468010:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae6feb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9565 expref: 257 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343036.468019:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010270720:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343036.468074:0:14879:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726240 going to sleep for 11 seconds 00000100:00100000:1.0:1763343036.468491:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe540 going to sleep for 11 seconds 00000100:00100000:0.0:1763343036.470974:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.471000:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.471035:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993575296 00000100:00100000:0.0:1763343036.471046:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993575296 00010000:00010000:0.0:1763343036.471090:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6e63 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94d9 expref: 258 pid: 6525 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343036.471127:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993575168 00000100:00100000:0.0:1763343036.471130:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993575168 00010000:00010000:0.0:1763343036.471145:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae6feb lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9565 expref: 259 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343036.471165:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3079 00000100:00100000:0.0:1763343036.471175:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:2429:x1848997993575296:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343036.471196:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343036.471203:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6e63 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94d9 expref: 259 pid: 6525 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1763343036.471217:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6e63 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94d9 expref: 259 pid: 6525 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1763343036.471247:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:0.0:1763343036.471254:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343036.471278:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343036.471288:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343036.471312:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343036.471375:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:2429:x1848997993575296:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 201us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343036.471384:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3079 00000100:00100000:0.0:1763343036.471405:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3080 00000100:00100000:0.0:1763343036.471412:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:2429:x1848997993575168:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343036.471421:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343036.471426:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae6feb lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9565 expref: 258 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1763343036.471435:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae6feb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9565 expref: 258 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1763343036.471452:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a3404421b00) 00010000:00010000:0.0:1763343036.471458:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7007 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.471465:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7007 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.471470:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7007 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.471482:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343036.471503:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:2429:x1848997993575168:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 92us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343036.471509:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3080 00010000:00010000:1.0:1763343036.472092:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae6feb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9565 expref: 257 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343036.472112:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010270720:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343036.472136:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7007 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.472145:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7007 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.472151:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7007 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343036.472177:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e3:0x0]: returning size 0 00000004:00080000:1.0:1763343036.472401:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2ab:0x0], index 1: 0 00000004:00080000:1.0:1763343036.472410:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2a9:0x0], index 0: 0 00000004:00080000:1.0:1763343036.472415:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2aa:0x0], index 0: 0 00000004:00080000:1.0:1763343036.472419:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2ac:0x0], index 1: 0 00010000:00010000:1.0:1763343036.472543:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7007 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.472552:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7007 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.472559:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7007 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.472565:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.472570:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7007 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.472583:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7007 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.472594:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a3404421b00) 00010000:00010000:1.0:1763343036.472596:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343036.472600:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7007 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.472607:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7007 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.472680:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae6ff9 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac956c expref: 257 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.472689:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a3404421b00) 00010000:00010000:1.0:1763343036.472693:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343036.472696:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae6ff9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac956c expref: 257 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.472710:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3ee00, rc 0) 00000100:00100000:1.0:1763343036.472756:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56890:x1848997993575040:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4943us (5059us total) trans 8589940004 rc 301/301 00000100:00100000:1.0:1763343036.472762:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9354 00010000:00010000:2.0:1763343036.473166:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae6e63 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94d9 expref: 255 pid: 6525 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343036.473182:0:14879:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010270592:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343036.473203:0:14879:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343036.473210:0:14879:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343036.473216:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00000040:00080000:2.0:1763343036.473431:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1435, 88 off121136 00000004:00080000:2.0:1763343036.473440:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1230140818774ns, next at 1231072373054ns, rc = 0 00000040:00080000:2.0:1763343036.473478:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1434, 88 off121136 00000004:00080000:2.0:1763343036.473483:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1230140862354ns, next at 1231072337277ns, rc = 0 00000040:00080000:2.0:1763343036.473504:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1435, 88 off121224 00000004:00080000:2.0:1763343036.473508:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1230140887822ns, next at 1231072337277ns, rc = 0 00000040:00080000:2.0:1763343036.473517:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1436, 88 off121224 00000004:00080000:2.0:1763343036.473522:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1230140901014ns, next at 1231072373054ns, rc = 0 00000001:00080000:1.0:1763343036.476691:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940005 is committed 00000004:00080000:1.0:1763343036.476713:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 945 committed 00010000:00010000:3.0:1763343036.476931:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae6f4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.476948:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae6f4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.476956:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae6f4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.476963:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.476969:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae6f4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.476978:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae6f4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.476999:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:3.0:1763343036.477003:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.477009:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae6f4a lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.477016:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae6f4a lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.477040:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6f58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.477046:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6f58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.477056:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6f58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.477061:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.477063:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6f58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.477069:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6f58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.477076:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421800) 00010000:00010000:3.0:1763343036.477079:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.477082:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6f58 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.477089:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae6f58 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.477099:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae6fa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.477106:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae6fa5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.477112:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae6fa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.477117:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.477120:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae6fa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.477126:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae6fa5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.477135:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:3.0:1763343036.477137:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.477140:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae6fa5 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.477145:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae6fa5 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.477154:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6fe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.477160:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6fe4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.477166:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6fe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.477170:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.477172:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6fe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.477178:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6fe4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.477184:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421800) 00010000:00010000:3.0:1763343036.477187:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.477189:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6fe4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.477196:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae6fe4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00080000:1.0:1763343036.477343:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 946 committed 00000100:00100000:2.0:1763343036.477727:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010270976:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343036.477819:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343036.477864:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763343036.477872:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010270848:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343036.477908:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343036.477946:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010271104:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343036.477977:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343036.477996:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343036.478002:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010271232:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343036.478023:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343036.478060:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010270976 00000100:00100000:2.0:1763343036.478070:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010270976 00000100:00100000:2.0:1763343036.478125:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010270848 00000100:00100000:2.0:1763343036.478129:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010270848 00000100:00100000:2.0:1763343036.478148:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010271104 00000100:00100000:2.0:1763343036.478151:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010271104 00000100:00100000:2.0:1763343036.478166:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010271232 00000100:00100000:2.0:1763343036.478168:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010271232 00000100:00100000:2.0:1763343036.478191:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6562 00000100:00100000:2.0:1763343036.478201:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+64:3658:x1848998010270976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343036.478235:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:682 count 1 00000004:00080000:1.0:1763343036.478357:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 945 committed 00000100:00100000:0.0:1763343036.478682:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6563 00000100:00100000:0.0:1763343036.478694:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e9cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+64:3658:x1848998010270848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343036.478706:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:681 count 1 00010000:00010000:0.0:1763343036.478724:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae7015 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.478749:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6f20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9526 expref: 38 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.478758:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343036.478761:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343036.478765:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae7015 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.478797:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6f20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9526 expref: 38 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.478813:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6f20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9526 expref: 38 pid: 27835 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343036.478826:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010271872:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343036.478920:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35085390c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343036.478941:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6564 00000100:00100000:0.0:1763343036.478949:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:3659:x1848998010271104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343036.479116:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343036.479120:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb mtime from disk: 1763343035 -> 1763343035 00002000:00010000:0.0:1763343036.479123:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb atime from disk: 1763343035 -> 1763343035 00002000:00010000:0.0:1763343036.479125:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb ctime from disk: 1763343036 -> 1763343036 00002000:00010000:0.0:1763343036.479128:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2a7:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343036.479178:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3659:x1848998010271104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (1199us total) trans 17179871612 rc 0/0 00000100:00100000:0.0:1763343036.479186:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6564 00000100:00100000:0.0:1763343036.479210:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6565 00000100:00100000:0.0:1763343036.479217:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:3659:x1848998010271232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343036.479446:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010271360:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343036.479487:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343036.479518:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343036.479524:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010271488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343036.479546:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343036.479575:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010271360 00000100:00100000:3.0:1763343036.479582:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010271360 00002000:00010000:2.0:1763343036.479644:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343036.479651:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae701c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.479659:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.479661:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.479666:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae701c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.479681:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae701c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.479691:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae701c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.479699:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae701c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.479719:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343036.479737:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010271488 00000100:00100000:3.0:1763343036.479741:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010271488 00000100:00100000:3.0:1763343036.479758:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6566 00000100:00100000:3.0:1763343036.479764:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3657:x1848998010271360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343036.479779:0:27833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:679 count 1 00010000:00010000:3.0:1763343036.479796:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae7023 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.479810:0:27833:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6f0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9518 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.479817:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343036.479819:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343036.479821:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae7023 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.479845:0:27833:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6f0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9518 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.479854:0:27833:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6f0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9518 expref: 12 pid: 8408 timeout: 1330 lvb_type: 0 00000100:00100000:3.0:1763343036.479865:0:27833:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537911f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27833:1848998010272000:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343036.479913:0:27833:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509bdff00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343036.479934:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6567 00000100:00100000:2.0:1763343036.479936:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3658:x1848998010270976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1737us (2117us total) trans 17179871614 rc 0/0 00000100:00100000:3.0:1763343036.479941:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3657:x1848998010271488:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343036.479943:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6562 00002000:00080000:3.0:1763343036.479953:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:680 count 1 00002000:00010000:3.0:1763343036.479971:0:15756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343036.479977:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae702a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.479985:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.479987:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.479990:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae702a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.479995:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343036.479999:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae702a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.480003:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae701c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.480007:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae702a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.480011:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343036.480015:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae702a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.480016:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae701c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.480026:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae701c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.480031:0:15756:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343036.480045:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae701c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.480052:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae701c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.480070:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343036.480074:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae702a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.480080:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343036.480084:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae702a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.480090:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae702a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.480099:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae702a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.480106:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae702a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.480118:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343036.480120:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343036.480122:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343036.480182:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3657:x1848998010271488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 237us (631us total) trans 21474838909 rc 0/0 00000100:00100000:3.0:1763343036.480189:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6567 00010000:00010000:3.0:1763343036.480215:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343036.480235:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 944 committed 00000004:00080000:1.0:1763343036.480253:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 943 committed 00002000:00010000:0.0:1763343036.480381:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2a8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343036.480385:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2a8:0x0] updating lvb mtime from disk: 1763343036 -> 1763343036 00002000:00010000:0.0:1763343036.480388:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2a8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343036.480390:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2a8:0x0] updating lvb ctime from disk: 1763343036 -> 1763343036 00002000:00010000:0.0:1763343036.480392:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2a8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343036.480420:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3659:x1848998010271232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1204us (2396us total) trans 17179871613 rc 0/0 00000100:00100000:0.0:1763343036.480430:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6565 00000100:00100000:0.0:1763343036.480456:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010271744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343036.480483:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343036.480506:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763343036.480512:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010271616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343036.480535:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343036.480542:0:3657:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838905 gen 2 00000004:00080000:2.0:1763343036.480547:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c2c6300, transno 21474838873 00000004:00080000:2.0:1763343036.480551:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c2c5f80, transno 21474838874 00000004:00080000:2.0:1763343036.480554:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c2c5c00, transno 21474838875 00000004:00080000:2.0:1763343036.480557:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c2c4700, transno 21474838876 00000004:00080000:2.0:1763343036.480560:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a6d80, transno 21474838877 00000004:00080000:2.0:1763343036.480564:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a6a00, transno 21474838878 00000004:00080000:2.0:1763343036.480567:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c72d80, transno 21474838879 00000004:00080000:2.0:1763343036.480570:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c73b80, transno 21474838880 00000004:00080000:2.0:1763343036.480573:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad6680, transno 21474838882 00000004:00080000:2.0:1763343036.480576:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340465ea00, transno 21474838883 00000004:00080000:2.0:1763343036.480579:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad5880, transno 21474838884 00000004:00080000:0.0:1763343036.480579:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b5880/2, rc 0, transno 17179871613 00000004:00080000:2.0:1763343036.480581:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad4e00, transno 21474838885 00000100:00100000:0.0:1763343036.480584:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010271232:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343036.480585:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340664b800, transno 21474838887 00000004:00080000:2.0:1763343036.480588:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406649c00, transno 21474838888 00000004:00080000:2.0:1763343036.480591:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c2c6a00, transno 21474838889 00000004:00080000:2.0:1763343036.480593:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c2c6d80, transno 21474838890 00000004:00080000:0.0:1763343036.480594:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b4700/2, rc 0, transno 17179871612 00000004:00080000:2.0:1763343036.480596:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406550e00, transno 21474838892 00000100:00100000:0.0:1763343036.480597:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010271104:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343036.480599:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406552680, transno 21474838893 00000004:00080000:2.0:1763343036.480602:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406553480, transno 21474838894 00000004:00080000:2.0:1763343036.480605:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406552300, transno 21474838895 00000004:00080000:2.0:1763343036.480608:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b5c00, transno 21474838897 00000004:00080000:2.0:1763343036.480610:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b4380, transno 21474838898 00000004:00080000:2.0:1763343036.480613:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b7100, transno 21474838899 00000004:00080000:2.0:1763343036.480616:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b6d80, transno 21474838900 00000004:00080000:0.0:1763343036.480617:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a353876ca80/2, rc 0, transno 17179871614 00000004:00080000:2.0:1763343036.480634:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad1c00, transno 21474838902 00000100:00100000:0.0:1763343036.480634:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010270976:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1763343036.480637:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad2680, transno 21474838903 00000004:00080000:2.0:1763343036.480640:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062cb100, transno 21474838904 00000004:00080000:2.0:1763343036.480643:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062cad80, transno 21474838905 00000100:00100000:2.0:1763343036.480650:0:3657:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a3405b7e300 x1848998010271488/t21474838909(21474838909) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763343052 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763343036.480659:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7e300/2, rc 0, transno 21474838909 00000004:00080000:1.0:1763343036.480686:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 944 committed 00000004:00010000:1.0:1763343036.480771:0:14879:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007994cf78 reply state 00000000b72b37da transno 8589940005 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343036.480792:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343036.480801:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:1.0:1763343036.480804:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763343036.480807:0:14879:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343036.480814:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:1.0:1763343036.480816:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343036.480821:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae6de5 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac94b6 expref: 244 pid: 28422 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763343036.480844:0:32355:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 4 in progress, 4 in flight, 28 done 00000100:00100000:0.0:1763343036.480858:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010271744 00000100:00100000:0.0:1763343036.480863:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010271744 00000100:00100000:0.0:1763343036.480886:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010271616 00000100:00100000:0.0:1763343036.480888:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010271616 00000100:00100000:0.0:1763343036.480916:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6568 00000100:00100000:0.0:1763343036.480923:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3660:x1848998010271744:12345-0@lo:2:osp-syn-0-0.0 00010000:00080000:1.0:1763343036.480926:0:14879:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763343036.480940:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56886:x1848997993574784:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 13509us (13898us total) trans 8589940005 rc 0/0 00000100:00100000:1.0:1763343036.480948:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3185 00010000:00010000:1.0:1763343036.480973:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343036.480981:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343036.480987:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343036.480992:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.480997:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00002000:00010000:0.0:1763343036.481001:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2a6:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343036.481003:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2a6:0x0] updating lvb mtime from disk: 1763343036 -> 1763343036 00010000:00010000:1.0:1763343036.481005:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 00002000:00010000:0.0:1763343036.481006:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2a6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343036.481008:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2a6:0x0] updating lvb ctime from disk: 1763343036 -> 1763343036 00002000:00010000:0.0:1763343036.481010:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2a6:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:1.0:1763343036.481015:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:1.0:1763343036.481017:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343036.481020:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343036.481026:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7000 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00000100:00100000:0.0:1763343036.481040:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3660:x1848998010271744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 117us (555us total) trans 21474838910 rc 0/0 00000100:00100000:0.0:1763343036.481046:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6568 00000100:00100000:0.0:1763343036.481058:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6569 00000100:00100000:0.0:1763343036.481065:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3660:x1848998010271616:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343036.481099:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7f100/2, rc 0, transno 21474838910 00000100:00100000:1.0:1763343036.481104:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010271744:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343036.481118:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2a5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343036.481120:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2a5:0x0] updating lvb mtime from disk: 1763343035 -> 1763343035 00002000:00010000:0.0:1763343036.481123:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2a5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343036.481125:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2a5:0x0] updating lvb ctime from disk: 1763343035 -> 1763343035 00002000:00010000:0.0:1763343036.481127:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2a5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343036.481145:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010271488:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343036.481170:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3660:x1848998010271616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (634us total) trans 21474838911 rc 0/0 00000100:00100000:0.0:1763343036.481177:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6569 00000100:00100000:3.0:1763343036.481247:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.481329:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993575552 00000100:00100000:2.0:1763343036.481333:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993575552 00000100:00100000:2.0:1763343036.481362:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3186 00000004:00080000:1.0:1763343036.481395:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7d500/2, rc 0, transno 21474838911 00000100:00100000:1.0:1763343036.481401:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010271616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343036.481423:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56890:x1848997993575552:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343036.481741:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56890:x1848997993575552:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 317us (492us total) trans 8589940006 rc 0/0 00000100:00100000:2.0:1763343036.481748:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3186 00000100:00100000:0.0:1763343036.486288:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.486328:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.486365:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993575680 00000100:00100000:0.0:1763343036.486376:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993575680 00010000:00010000:0.0:1763343036.486426:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6f20 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9526 expref: 39 pid: 27835 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343036.486464:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993575808 00000100:00100000:0.0:1763343036.486467:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993575808 00010000:00010000:0.0:1763343036.486485:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6f0b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9518 expref: 13 pid: 8408 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343036.486507:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3081 00000100:00100000:0.0:1763343036.486515:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2431:x1848997993575680:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343036.486534:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343036.486541:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6f20 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9526 expref: 39 pid: 27835 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1763343036.486555:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6f20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9526 expref: 39 pid: 27835 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1763343036.486590:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343036.486592:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343036.486598:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae7015 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.486610:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae7015 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.486661:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343036.486722:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2431:x1848997993575680:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 206us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343036.486729:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3081 00000100:00100000:0.0:1763343036.486753:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3082 00000100:00100000:0.0:1763343036.486759:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2431:x1848997993575808:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343036.486768:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343036.486773:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6f0b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9518 expref: 13 pid: 8408 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1763343036.486782:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6f0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9518 expref: 13 pid: 8408 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1763343036.486796:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343036.486799:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343036.486802:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae7023 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.486809:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae7023 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.486821:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343036.486840:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2431:x1848997993575808:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 81us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343036.486847:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3082 00000100:00100000:0.0:1763343036.486914:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.487017:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.487043:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993576192 00000100:00100000:0.0:1763343036.487048:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993576192 00000100:00100000:0.0:1763343036.487077:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3187 00000100:00100000:0.0:1763343036.487083:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353c650050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+244:56890:x1848997993576192:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343036.487318:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353c650050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56890:x1848997993576192:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 233us (300us total) trans 8589940007 rc 0/0 00000100:00100000:0.0:1763343036.487325:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3187 00000100:00100000:1.0:1763343036.487669:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993575936 00000100:00100000:1.0:1763343036.487675:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993575936 00000100:00100000:1.0:1763343036.487707:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9355 00000100:00100000:1.0:1763343036.487713:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+245:56886:x1848997993575936:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.487723:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.487744:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae7031 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9573 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.487795:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae7031 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9573 expref: 246 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.487810:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ee00/0x607405d401ae7031 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9573 expref: 246 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.487827:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:1.0:1763343036.487832:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343036.487836:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3ee00, rc 0) 00000100:00100000:1.0:1763343036.487865:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56886:x1848997993575936:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 152us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.487872:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9355 00010000:00010000:3.0:1763343036.488023:0:27833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93600/0x607405d401ae6f0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9518 expref: 12 pid: 8408 timeout: 1330 lvb_type: 0 00000100:00100000:3.0:1763343036.488039:0:27833:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537911f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27833:1848998010272000:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343036.488064:0:27833:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae7023 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.488074:0:27833:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae7023 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.488080:0:27833:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae7023 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.488090:0:27833:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae7023 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.488096:0:27833:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae7023 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.488122:0:27833:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343036.488406:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010271360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8639us (8916us total) trans 21474838912 rc 0/0 00000100:00100000:3.0:1763343036.488416:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6566 00000004:00080000:3.0:1763343036.488464:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062caa00/2, rc 0, transno 21474838912 00000100:00100000:3.0:1763343036.488472:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010271360:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763343036.488915:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343036.488925:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae7023 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.488933:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343036.488938:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae7023 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.488948:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae7023 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.488969:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae7023 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.488977:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae7023 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.488998:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343036.489000:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343036.489002:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343036.489142:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae6f20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9526 expref: 38 pid: 27835 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343036.489155:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010271872:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343036.489175:0:8408:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae7015 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.489183:0:8408:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae7015 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.489189:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae7015 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.489197:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae7015 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.489204:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae7015 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.489231:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343036.489457:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e9cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:3658:x1848998010270848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10766us (11557us total) trans 17179871615 rc 0/0 00000100:00100000:2.0:1763343036.489466:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6563 00000004:00080000:2.0:1763343036.489659:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406551880/2, rc 0, transno 17179871615 00000100:00100000:2.0:1763343036.489666:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010270848:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763343036.489674:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343036.489681:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae7015 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.489695:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343036.489698:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae7015 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.489705:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae7015 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.489718:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae7015 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.489725:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae7015 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.489741:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343036.489743:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343036.489744:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343036.494129:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.494129:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.494402:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993576704 00000100:00100000:3.0:1763343036.494416:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993576704 00000100:00100000:3.0:1763343036.494494:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3188 00000100:00100000:3.0:1763343036.494505:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+246:56886:x1848997993576704:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:3.0:1763343036.494869:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1e0:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763343036.494965:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1437, 64 off121288 00000040:00080000:3.0:1763343036.494993:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1436, 64 off121288 00000040:00080000:3.0:1763343036.495004:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1437, 64 off121352 00000040:00080000:3.0:1763343036.495013:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1438, 64 off121352 00010000:00010000:3.0:1763343036.495092:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7038 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.495116:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7038 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.495131:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7038 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.495141:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7038 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.495148:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7038 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.495154:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7038 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.495184:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343036.495455:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56886:x1848997993576704:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 950us (1342us total) trans 8589940008 rc 0/0 00000100:00100000:3.0:1763343036.495466:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3188 00000100:00100000:3.0:1763343036.495504:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993576448 00000100:00100000:3.0:1763343036.495510:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993576448 00000100:00100000:3.0:1763343036.495547:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9356 00000100:00100000:3.0:1763343036.495555:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:55941:x1848997993576448:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343036.495567:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343036.495583:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae703f lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac957a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.495723:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7046 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.495731:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7046 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.495739:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7046 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.495752:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae704d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.495758:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae704d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.495764:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae704d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.495822:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae7054 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.495829:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae7054 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.495837:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae7054 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:3.0:1763343036.495848:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e3:0x0]: returning size 0 00010000:00010000:3.0:1763343036.496019:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7046 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.496026:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7046 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.496031:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7046 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.496037:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7046 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.496043:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.496048:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7046 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.496056:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7046 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.496069:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:3.0:1763343036.496072:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.496078:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7046 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.496083:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7046 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.496097:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae704d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.496103:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae704d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.496108:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae704d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.496113:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.496116:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae704d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.496122:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae704d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.496129:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8500) 00010000:00010000:3.0:1763343036.496131:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.496134:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae704d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.496140:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae704d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.496182:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae703f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac957a expref: 250 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.496197:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae7054 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac957a expref: 249 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.496204:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:3.0:1763343036.496207:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343036.496209:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405136600, rc 0) 00000100:00100000:3.0:1763343036.496253:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:55941:x1848997993576448:12345-192.168.204.21@tcp:101:bash.0 Request processed in 697us (2141us total) trans 8589940009 rc 0/0 00000100:00100000:3.0:1763343036.496259:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9356 00010000:00010000:2.0:1763343036.496365:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343036.496373:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7038 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343036.496384:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343036.496387:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7038 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343036.496392:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7038 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343036.496402:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e0:0x0].0x0 (ffff9a3503a3a600) 00010000:00010000:2.0:1763343036.496405:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343036.496408:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7038 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343036.496413:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7038 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1e0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343036.496425:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343036.496428:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343036.496430:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343036.500947:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.501068:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993576832 00000100:00100000:2.0:1763343036.501083:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993576832 00000100:00100000:2.0:1763343036.501163:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9357 00000100:00100000:2.0:1763343036.501176:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:55941:x1848997993576832:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343036.501208:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.501237:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7062 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9581 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.501286:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7069 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.501303:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7069 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.501318:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7069 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.501466:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7062 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9581 expref: 251 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.501487:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7069 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9581 expref: 250 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.501497:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:2.0:1763343036.501500:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343036.501505:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c800, rc 0) 00000100:00100000:2.0:1763343036.502737:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:55941:x1848997993576832:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1555us (1795us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.502749:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9357 00000100:00100000:0.0:1763343036.504549:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.504832:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993577088 00000100:00100000:2.0:1763343036.504843:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993577088 00000100:00100000:2.0:1763343036.504913:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9358 00000100:00100000:2.0:1763343036.504923:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56886:x1848997993577088:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.504948:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.504974:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7070 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9588 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.505107:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7077 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343036.505124:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7077 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343036.505140:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7077 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343036.505155:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e3:0x0]: returning size 0 00010000:00010000:2.0:1763343036.505301:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7070 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9588 expref: 253 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.505319:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7077 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9588 expref: 252 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.505329:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:2.0:1763343036.505332:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763343036.505337:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352dc00, rc 0) 00000100:00100000:2.0:1763343036.505417:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56886:x1848997993577088:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 495us (876us total) trans 8589940010 rc 0/0 00000100:00100000:2.0:1763343036.505425:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9358 00000100:00100000:1.0:1763343036.511880:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.511929:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.511992:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993577344 00000100:00100000:0.0:1763343036.512004:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993577344 00000100:00100000:0.0:1763343036.512067:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993577472 00000100:00100000:0.0:1763343036.512070:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993577472 00000100:00100000:0.0:1763343036.512100:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9359 00000100:00100000:0.0:1763343036.512109:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:55941:x1848997993577344:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343036.512189:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343036.512225:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae7054 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac957a expref: 253 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.512248:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:0.0:1763343036.512255:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343036.512519:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7085 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.512537:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7085 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.512548:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7085 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000001:00080000:0.0:1763343036.512608:0:6523:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940011 00000004:00010000:0.0:1763343036.512670:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e30fd5cf reply state 000000008bdf037e transno 8589940012 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7085 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.512683:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7085 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.512690:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:0.0:1763343036.512693:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343036.512695:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343036.512806:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:55941:x1848997993577344:12345-192.168.204.21@tcp:36:bash.0 Request processed in 696us (938us total) trans 8589940012 rc 0/0 00000100:00100000:0.0:1763343036.512814:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9359 00000020:00080000:0.0:1763343036.512821:0:6523:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343036.512847:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9360 00000100:00100000:0.0:1763343036.512855:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56886:x1848997993577472:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343036.512866:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.512877:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae708c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac958f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.512959:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae7093 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.512968:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae7093 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.512976:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae7093 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343036.512995:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e3:0x0]: returning size 0 00000004:00200000:0.0:1763343036.513000:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343036.513016:0:6523:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae7093 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.513040:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae708c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac958f expref: 256 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.513057:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae7093 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac958f expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.513065:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:0.0:1763343036.513068:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343036.513071:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dc400, rc 0) 00000100:00100000:0.0:1763343036.513102:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56886:x1848997993577472:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 248us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343036.513109:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9360 00000100:00100000:1.0:1763343036.516367:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.516564:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993577728 00000100:00100000:0.0:1763343036.516582:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993577728 00000100:00100000:0.0:1763343036.516714:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9361 00000100:00100000:0.0:1763343036.516727:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:55941:x1848997993577728:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343036.516759:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.516763:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343036.516797:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7077 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9588 expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.516817:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:0.0:1763343036.516835:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343036.516852:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae709a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9596 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.516923:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.516937:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae7093 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac958f expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.516946:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.516996:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae7093 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac958f expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.517010:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae7093 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac958f expref: 255 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343036.517026:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010272128:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343036.517139:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3508539480 going to sleep for 11 seconds 00000100:00100000:0.0:1763343036.520931:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.522006:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.522075:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.522152:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993578112 00000100:00100000:1.0:1763343036.522165:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993578112 00000100:00100000:3.0:1763343036.522203:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993577856 00000100:00100000:3.0:1763343036.522208:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993577856 00010000:00010000:1.0:1763343036.522217:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae7093 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac958f expref: 256 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:3.0:1763343036.522250:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993577984 00000100:00100000:3.0:1763343036.522253:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993577984 00000100:00100000:1.0:1763343036.522261:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3083 00000100:00100000:3.0:1763343036.522277:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6570 00000100:00100000:1.0:1763343036.522280:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:2430:x1848997993578112:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1763343036.522283:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993577856:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.522298:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343036.522301:0:27833:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.522305:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae7093 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac958f expref: 256 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.522319:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae7093 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac958f expref: 256 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:3.0:1763343036.522324:0:27833:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405137800/0x607405d401ae70a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac959d expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.522347:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00002000:00010000:3.0:1763343036.522349:0:27833:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343036.522352:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.522364:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.522368:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.522371:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.522372:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.522379:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405137800/0x607405d401ae70a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac959d expref: 13 pid: 27833 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343036.522392:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343036.522394:0:27833:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3405137800/0x607405d401ae70a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac959d expref: 13 pid: 27833 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343036.522407:0:27833:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137800, rc 0) 00010000:00010000:0.0:1763343036.522611:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae7093 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac958f expref: 256 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343036.522656:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010272128:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343036.522685:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.522694:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.522700:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:0.0:1763343036.523032:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1439, 88 off121440 00000004:00080000:0.0:1763343036.523042:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1230190420341ns, next at 1231072373054ns, rc = 0 00000040:00080000:0.0:1763343036.523074:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1438, 88 off121440 00000004:00080000:0.0:1763343036.523079:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1230190458026ns, next at 1231072337277ns, rc = 0 00000040:00080000:0.0:1763343036.523138:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1439, 88 off121528 00000004:00080000:0.0:1763343036.523142:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1230190521706ns, next at 1231072337277ns, rc = 0 00000040:00080000:0.0:1763343036.523163:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1440, 88 off121528 00000004:00080000:0.0:1763343036.523167:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1230190545723ns, next at 1231072373054ns, rc = 0 00000100:00100000:2.0:1763343036.523607:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6571 00000100:00100000:2.0:1763343036.523638:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+38:2430:x1848997993577984:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.523653:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.523672:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae70af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac95a4 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343036.523694:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343036.523710:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.523712:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.523719:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae70af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95a4 expref: 39 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343036.523741:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae70af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95a4 expref: 39 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343036.523753:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c200, rc 0) 00000100:00100000:1.0:1763343036.523853:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:2430:x1848997993578112:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1572us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.523864:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3083 00000100:00100000:3.0:1763343036.523870:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993577856:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1586us (2953us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343036.523877:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6570 00000100:00100000:2.0:1763343036.524525:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2430:x1848997993577984:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 904us (2519us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.524534:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6571 00000100:00100000:1.0:1763343036.534121:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.534299:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993578240 00000100:00100000:3.0:1763343036.534313:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993578240 00000100:00100000:2.0:1763343036.535095:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9362 00000100:00100000:2.0:1763343036.535113:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56886:x1848997993578240:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.535144:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.535172:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae70b6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac95ab expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.535250:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 2/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.535264:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae70b6 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ab expref: 257 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.535289:0:6525:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.535305:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae70b6 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ab expref: 257 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.535322:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:2.0:1763343036.535328:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343036.535333:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae70b6 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ab expref: 257 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.535358:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d800, rc 0) 00000100:00100000:2.0:1763343036.535442:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56886:x1848997993578240:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 334us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.535450:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9362 00000001:00080000:2.0:1763343036.537679:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940013 is committed 00000004:00080000:2.0:1763343036.537697:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 947 committed 00000004:00080000:2.0:1763343036.537707:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 948 committed 00000004:00080000:2.0:1763343036.537728:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 947 committed 00000004:00080000:2.0:1763343036.537731:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 946 committed 00010000:00010000:2.0:1763343036.537848:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9596 expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.537865:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:2.0:1763343036.537868:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343036.537873:0:28422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae70b6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ab expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.537886:0:28422:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae70b6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ab expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.537895:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae70b6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ab expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.537971:0:28422:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae70b6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ab expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.537982:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7085 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.537991:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7085 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.538000:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7085 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343036.538121:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010272768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343036.538180:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010272384:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343036.538211:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343036.538264:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343036.538274:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010273152:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343036.538292:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010272896:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343036.538308:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343036.538344:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010272768 00000100:00100000:0.0:1763343036.538345:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1763343036.538354:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010272768 00000100:00100000:0.0:1763343036.538354:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010272640:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343036.538383:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343036.538403:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010273280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343036.538411:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010272384 00000100:00100000:3.0:1763343036.538416:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010272384 00000100:00100000:0.0:1763343036.538427:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343036.538464:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010272256:192.168.204.21@tcp:105: 00000100:00100000:2.0:1763343036.538481:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010272512:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343036.538512:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343036.538561:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.538567:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7085 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.538577:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7085 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.538591:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:1.0:1763343036.538593:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343036.538597:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7085 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.538604:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7085 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343036.539843:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a351fc74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010273024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343036.539867:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010273152 00000100:00100000:3.0:1763343036.539874:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010273152 00000100:00100000:3.0:1763343036.539929:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010272640 00000100:00100000:3.0:1763343036.539934:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010272640 00000100:00100000:3.0:1763343036.539954:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010273280 00000100:00100000:3.0:1763343036.539957:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010273280 00000100:00100000:3.0:1763343036.539976:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010272512 00000100:00100000:3.0:1763343036.539979:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010272512 00000100:00100000:3.0:1763343036.540007:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6572 00000100:00100000:3.0:1763343036.540018:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3659:x1848998010272768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343036.540281:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3659:x1848998010272768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 264us (2071us total) trans 17179871616 rc 0/0 00000100:00100000:3.0:1763343036.540290:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6572 00000100:00100000:3.0:1763343036.540312:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6573 00000100:00100000:3.0:1763343036.540320:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3657:x1848998010272384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343036.540337:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:679 count 1 00010000:00010000:3.0:1763343036.540361:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.540382:0:28993:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6fac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9550 expref: 38 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.540391:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343036.540393:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343036.540397:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70bd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.540436:0:28993:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6fac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9550 expref: 38 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.540458:0:28993:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6fac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9550 expref: 38 pid: 27835 timeout: 1330 lvb_type: 0 00000100:00100000:3.0:1763343036.540471:0:28993:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537913b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:28993:1848998010273408:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343036.540555:0:28993:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c900 going to sleep for 11 seconds 00000100:00100000:3.0:1763343036.540586:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6574 00000100:00100000:3.0:1763343036.540595:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3659:x1848998010273152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343036.540739:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3659:x1848998010273152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (2431us total) trans 21474838913 rc 0/0 00000100:00100000:3.0:1763343036.540746:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6574 00000100:00100000:3.0:1763343036.540761:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6575 00000100:00100000:3.0:1763343036.540768:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3659:x1848998010272640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343036.540780:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:677 count 1 00010000:00010000:3.0:1763343036.540794:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.540807:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae6d83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9493 expref: 12 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.540814:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343036.540816:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343036.540818:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70c4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.540860:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae6d83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9493 expref: 12 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.540870:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae6d83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9493 expref: 12 pid: 28994 timeout: 1330 lvb_type: 0 00000100:00100000:3.0:1763343036.540881:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537910700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010273536:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343036.540920:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343036.540939:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6576 00000100:00100000:3.0:1763343036.540946:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3659:x1848998010273280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343036.541007:0:28995:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2aa:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343036.541012:0:28995:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2aa:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343036.541015:0:28995:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2aa:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343036.541017:0:28995:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2aa:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343036.541019:0:28995:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2aa:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343036.541031:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6577 00000100:00100000:1.0:1763343036.541042:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:3658:x1848998010272512:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343036.541045:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3659:x1848998010273280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (2619us total) trans 21474838914 rc 0/0 00000100:00100000:3.0:1763343036.541051:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6576 00002000:00080000:1.0:1763343036.541062:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:680 count 1 00010000:00010000:1.0:1763343036.541077:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae70cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.541089:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae6f74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac953b expref: 38 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.541096:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343036.541097:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343036.541099:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae70cb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343036.541117:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537913100/2, rc 0, transno 21474838914 00010000:00010000:1.0:1763343036.541118:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae6f74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac953b expref: 38 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343036.541124:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010273280:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343036.541127:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae6f74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac953b expref: 38 pid: 8408 timeout: 1330 lvb_type: 0 00000004:00080000:3.0:1763343036.541135:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537910380/2, rc 0, transno 21474838913 00000100:00100000:3.0:1763343036.541138:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010273152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343036.541138:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010273664:192.168.204.21@tcp:104: 00000004:00080000:3.0:1763343036.541150:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7d180/2, rc 0, transno 17179871616 00000100:00100000:3.0:1763343036.541154:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010272768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343036.541165:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343036.541175:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343036.541197:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010272896 00000100:00100000:1.0:1763343036.541201:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010272896 00000100:00100000:1.0:1763343036.541226:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6578 00000100:00100000:1.0:1763343036.541233:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3657:x1848998010272896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343036.541244:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:678 count 1 00010000:00010000:1.0:1763343036.541259:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e200/0x607405d401ae70d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.541271:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae6f6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9534 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.541277:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343036.541278:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343036.541281:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e200/0x607405d401ae70d2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.541299:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae6f6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9534 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.541307:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae6f6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9534 expref: 12 pid: 8408 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343036.541322:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1848998010273792:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343036.541350:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abed80 going to sleep for 11 seconds 00000100:00100000:2.0:1763343036.541413:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343036.544833:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010273024 00000100:00100000:3.0:1763343036.544855:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010273024 00000100:00100000:3.0:1763343036.544958:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6579 00000100:00100000:3.0:1763343036.544969:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3658:x1848998010273024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343036.545183:0:27833:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2ac:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343036.545187:0:27833:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2ac:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343036.545190:0:27833:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2ac:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343036.545192:0:27833:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2ac:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343036.545195:0:27833:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2ac:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343036.545285:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+69:3658:x1848998010273024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 317us (3870us total) trans 17179871617 rc 0/0 00000100:00100000:3.0:1763343036.545293:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6579 00000100:00100000:0.0:1763343036.545999:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726480 going to sleep for 11 seconds 00000004:00080000:2.0:1763343036.546101:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a351fc74a80/2, rc 0, transno 17179871617 00000100:00100000:2.0:1763343036.546111:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a351fc74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010273024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343036.549479:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.549534:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.549613:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993578368 00000100:00100000:0.0:1763343036.549645:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993578368 00000100:00100000:2.0:1763343036.549676:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537910700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010273536:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343036.549696:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6fac lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9550 expref: 39 pid: 27835 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343036.549709:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343036.549727:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993578496 00000100:00100000:0.0:1763343036.549731:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993578496 00010000:00010000:0.0:1763343036.549745:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae6d83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9493 expref: 13 pid: 28994 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343036.549757:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3084 00000100:00100000:0.0:1763343036.549762:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3085 00000100:00100000:2.0:1763343036.549768:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2431:x1848997993578368:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1763343036.549768:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3508046450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2431:x1848997993578496:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343036.549785:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343036.549785:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343036.549792:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6fac lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9550 expref: 39 pid: 27835 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1763343036.549792:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae6d83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9493 expref: 13 pid: 28994 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343036.549805:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6fac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9550 expref: 39 pid: 27835 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343036.549860:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.549862:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.549868:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.549880:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70bd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.549912:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343036.549978:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2431:x1848997993578368:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 211us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.549987:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3084 00010000:00010000:3.0:1763343036.551173:0:28993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae6fac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9550 expref: 38 pid: 27835 timeout: 1330 lvb_type: 0 00000100:00100000:3.0:1763343036.551197:0:28993:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537913b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:28993:1848998010273408:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343036.551222:0:28993:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.551233:0:28993:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.551241:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.551254:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.551268:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.551291:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343036.551786:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+69:3657:x1848998010272384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11464us (13519us total) trans 17179871618 rc 0/0 00000100:00100000:3.0:1763343036.551797:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6573 00010000:00010000:3.0:1763343036.551837:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343036.551846:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.551855:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343036.551859:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.551870:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.551891:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.551912:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.551933:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343036.551935:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343036.551938:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343036.551973:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7c000/2, rc 0, transno 17179871618 00000100:00100000:3.0:1763343036.551981:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010272384:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763343036.552651:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae6d83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9493 expref: 13 pid: 28994 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1763343036.552678:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae6d83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9493 expref: 13 pid: 28994 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1763343036.552696:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343036.552699:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343036.552704:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.552715:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70c4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.552791:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343036.552859:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3508046450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2431:x1848997993578496:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 3089us (3322us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.552870:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3085 00000100:00100000:0.0:1763343036.553049:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010273664:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343036.553071:0:15756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae70cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343036.553169:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.553181:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1848998010273792:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343036.553187:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993578624 00000100:00100000:2.0:1763343036.553193:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993578624 00010000:00010000:0.0:1763343036.553193:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e200/0x607405d401ae70d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.553226:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae6f74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac953b expref: 38 pid: 8408 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343036.553260:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3086 00000100:00100000:1.0:1763343036.553364:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.553386:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993578752 00000100:00100000:1.0:1763343036.553390:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993578752 00010000:00010000:1.0:1763343036.553406:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae6f6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9534 expref: 12 pid: 8408 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343036.555070:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3087 00000100:00100000:1.0:1763343036.555092:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993578752:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343036.555115:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343036.555124:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae6f6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9534 expref: 12 pid: 8408 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.555139:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae6f6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9534 expref: 12 pid: 8408 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.555166:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae6f6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9534 expref: 12 pid: 8408 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.555186:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.555188:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.555193:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e200/0x607405d401ae70d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.555206:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e200/0x607405d401ae70d2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.555240:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343036.555365:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e200/0x607405d401ae70d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.555376:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e200/0x607405d401ae70d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.555386:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e200/0x607405d401ae70d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.555394:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e200/0x607405d401ae70d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.555418:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343036.555708:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+38:2429:x1848997993578624:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343036.555720:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343036.555726:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae6f74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac953b expref: 38 pid: 8408 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343036.555739:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae6f74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac953b expref: 38 pid: 8408 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343036.555760:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c400/0x607405d401ae6f74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac953b expref: 38 pid: 8408 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343036.555771:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.555773:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.555776:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae70cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.555784:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae70cb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.555806:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343036.555890:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2429:x1848997993578752:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 809us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.555907:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3087 00010000:00010000:1.0:1763343036.555938:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343036.555945:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e200/0x607405d401ae70d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.555953:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343036.555958:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e200/0x607405d401ae70d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.555968:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e200/0x607405d401ae70d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.555981:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e200/0x607405d401ae70d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.555988:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e200/0x607405d401ae70d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.556005:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343036.556007:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343036.556010:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343036.556045:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3657:x1848998010272896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14811us (14868us total) trans 21474838915 rc 0/0 00000100:00100000:0.0:1763343036.556054:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6578 00000100:00100000:2.0:1763343036.556861:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+37:2429:x1848997993578624:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1153us (3686us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.556874:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3086 00010000:00010000:2.0:1763343036.556922:0:15756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae70cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.556932:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae70cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.556941:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae70cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.556949:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae70cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.556976:0:15756:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343036.557215:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+69:3658:x1848998010272512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16175us (18702us total) trans 17179871619 rc 0/0 00000100:00100000:2.0:1763343036.557223:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6577 00010000:00010000:0.0:1763343036.557495:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343036.557511:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae70cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.557521:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343036.557525:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae70cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.557537:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae70cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.557554:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae70cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.557564:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f800/0x607405d401ae70cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.557582:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343036.557584:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343036.557585:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343036.557742:0:8410:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.557753:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.557760:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.557767:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.557787:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343036.557971:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3659:x1848998010272640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17203us (19586us total) trans 21474838916 rc 0/0 00000100:00100000:3.0:1763343036.557978:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6575 00010000:00010000:3.0:1763343036.558000:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343036.558005:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.558012:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343036.558014:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.558022:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.558034:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.558040:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.558057:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343036.558059:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343036.558061:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343036.558104:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537911f80/2, rc 0, transno 21474838916 00000100:00100000:3.0:1763343036.558113:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010272640:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763343036.558644:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7ca80/2, rc 0, transno 17179871619 00000100:00100000:2.0:1763343036.558653:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010272512:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763343036.560763:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537913480/2, rc 0, transno 21474838915 00000100:00100000:1.0:1763343036.561195:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.561243:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993578880 00000100:00100000:1.0:1763343036.561251:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993578880 00000100:00100000:1.0:1763343036.561319:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3189 00000100:00100000:1.0:1763343036.561330:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56886:x1848997993578880:12345-192.168.204.21@tcp:49:lfs.0 00000100:00100000:1.0:1763343036.561487:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56886:x1848997993578880:12345-192.168.204.21@tcp:49:lfs.0 Request processed in 157us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.561496:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3189 00000100:00100000:3.0:1763343036.561766:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010272896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343036.561909:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010272256:192.168.204.21@tcp:105: 00010000:00010000:2.0:1763343036.561956:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae709a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9596 expref: 248 pid: 28422 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343036.561981:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9596 expref: 247 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.562006:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dce00, rc 0) 00000100:00100000:2.0:1763343036.562038:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:55941:x1848997993577728:12345-192.168.204.21@tcp:101:bash.0 Request processed in 45314us (45686us total) trans 8589940013 rc 0/0 00000100:00100000:2.0:1763343036.562046:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9361 00000100:00100000:2.0:1763343036.567460:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.567506:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.568683:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993579008 00000100:00100000:3.0:1763343036.568700:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993579008 00000100:00100000:3.0:1763343036.568765:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993579136 00000100:00100000:3.0:1763343036.568769:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993579136 00000100:00100000:3.0:1763343036.568811:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6580 00000100:00100000:3.0:1763343036.568823:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+38:55941:x1848997993579008:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343036.568847:0:8410:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343036.568877:0:8410:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac95b2 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343036.568914:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343036.568943:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.568946:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.568960:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95b2 expref: 39 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.568977:0:8410:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95b2 expref: 39 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.568991:0:8410:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137200, rc 0) 00000100:00100000:3.0:1763343036.569064:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:55941:x1848997993579008:12345-192.168.204.21@tcp:101:bash.0 Request processed in 242us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343036.569072:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6580 00000100:00100000:3.0:1763343036.569094:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6581 00000100:00100000:3.0:1763343036.569101:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+38:2429:x1848997993579136:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343036.569107:0:8410:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343036.569116:0:8410:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae70e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac95b9 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343036.569170:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503521180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1848998010273920:192.168.204.21@tcp:106: 00000100:00100000:3.0:1763343036.569234:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c900 going to sleep for 11 seconds 00002000:00010000:3.0:1763343036.573274:0:8410:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x2ab:0x0] updating lvb mtime: 0 -> 1763343036 00002000:00010000:3.0:1763343036.573288:0:8410:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x2ab:0x0] updating lvb atime: 0 -> 1763343036 00002000:00010000:3.0:1763343036.573291:0:8410:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x2ab:0x0] updating lvb ctime: 0 -> 1763343036 00000100:00100000:3.0:1763343036.573321:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503521180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1848998010273920:192.168.204.21@tcp:106: 00010000:00010000:3.0:1763343036.573370:0:8410:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae70e0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95b9 expref: 39 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343036.573400:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405136200/0x607405d401ae70e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95b9 expref: 39 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343036.573417:0:8410:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405136200, rc 0) 00000100:00100000:3.0:1763343036.573498:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+38:2429:x1848997993579136:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4395us (5989us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343036.573509:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6581 00000100:00100000:1.0:1763343036.576492:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.576656:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993579264 00000100:00100000:3.0:1763343036.576670:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993579264 00000100:00100000:3.0:1763343036.576744:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6582 00000100:00100000:3.0:1763343036.576755:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:55941:x1848997993579264:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343036.576778:0:8410:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343036.576808:0:8410:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac95c0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343036.576835:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343036.576866:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.576868:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.576880:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c0 expref: 12 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.576910:0:8410:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c0 expref: 12 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.576926:0:8410:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137400, rc 0) 00000100:00100000:3.0:1763343036.576998:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:55941:x1848997993579264:12345-192.168.204.21@tcp:101:bash.0 Request processed in 243us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343036.577006:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6582 00000100:00100000:2.0:1763343036.579430:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.580231:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.580572:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993579520 00000100:00100000:1.0:1763343036.580587:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993579520 00000100:00100000:2.0:1763343036.580610:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.580664:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3190 00000100:00100000:1.0:1763343036.580675:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+247:56886:x1848997993579520:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343036.581009:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993579648 00000100:00100000:0.0:1763343036.581014:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993579648 00000100:00100000:1.0:1763343036.581025:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56886:x1848997993579520:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 350us (1604us total) trans 8589940014 rc 0/0 00000100:00100000:1.0:1763343036.581034:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3190 00002000:00010000:0.0:1763343036.581044:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/683 (0->18446744073709551615) 00002000:00100000:0.0:1763343036.581050:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095bad80 with x1848997993579648 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343036.581067:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34095bad80. 00000100:00100000:0.0:1763343036.581282:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993579776 00000100:00100000:0.0:1763343036.581286:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993579776 00002000:00010000:0.0:1763343036.581302:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/681 (0->18446744073709551615) 00002000:00100000:0.0:1763343036.581305:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b9f80 with x1848997993579776 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343036.581312:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34095b9f80. 00000100:00100000:0.0:1763343036.581335:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1604 00000100:00100000:0.0:1763343036.581342:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+38:2430:x1848997993579648:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343036.581510:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2ab:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343036.581514:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2ab:0x0] updating lvb mtime from disk: 1763343036 -> 1763343036 00002000:00010000:0.0:1763343036.581516:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2ab:0x0] updating lvb atime from disk: 1763343036 -> 0 00002000:00010000:0.0:1763343036.581519:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2ab:0x0] updating lvb ctime from disk: 1763343036 -> 1763343036 00002000:00010000:0.0:1763343036.581521:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2ab:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343036.581549:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2430:x1848997993579648:12345-192.168.204.21@tcp:10:bash.0 Request processed in 207us (1321us total) trans 17179871620 rc 0/0 00000100:00100000:0.0:1763343036.581555:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1604 00002000:00010000:0.0:1763343036.581558:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/683 (0->18446744073709551615) 00002000:00100000:0.0:1763343036.581561:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095bad80 with x1848997993579648 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343036.581565:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34095bad80. 00000100:00100000:0.0:1763343036.581580:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1605 00000100:00100000:0.0:1763343036.581586:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993579776:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343036.581708:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2a9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343036.581711:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2a9:0x0] updating lvb mtime from disk: 0 -> 1763343036 00002000:00010000:0.0:1763343036.581714:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2a9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343036.581717:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2a9:0x0] updating lvb ctime from disk: 0 -> 1763343036 00002000:00010000:0.0:1763343036.581719:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2a9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343036.581740:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993579776:12345-192.168.204.21@tcp:10:bash.0 Request processed in 154us (1132us total) trans 21474838917 rc 0/0 00000100:00100000:0.0:1763343036.581747:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1605 00002000:00010000:0.0:1763343036.581750:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/681 (0->18446744073709551615) 00002000:00100000:0.0:1763343036.581752:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b9f80 with x1848997993579776 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343036.581757:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34095b9f80. 00000100:00100000:2.0:1763343036.588208:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.588857:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993580032 00000100:00100000:0.0:1763343036.588873:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993580032 00000100:00100000:0.0:1763343036.588973:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9363 00000100:00100000:0.0:1763343036.588986:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56886:x1848997993580032:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343036.589020:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.589052:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae70ee lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac95c7 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.589156:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae70f5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589174:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae70f5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589189:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae70f5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589204:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae70fc lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589212:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae70fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589223:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae70fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589397:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae7103 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589408:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae7103 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589415:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae7103 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343036.589428:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e3:0x0]: returning size 2 00010000:00010000:0.0:1763343036.589539:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae70f5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589548:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae70f5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589556:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae70f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589562:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343036.589567:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae70f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589575:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae70f5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589591:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4300) 00010000:00010000:0.0:1763343036.589594:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343036.589600:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae70f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589611:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae70f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589686:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae70fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589694:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae70fc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589699:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae70fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589704:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343036.589707:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae70fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589712:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae70fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589721:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4f00) 00010000:00010000:0.0:1763343036.589723:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343036.589726:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae70fc lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589730:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae70fc lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.589779:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae70ee lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c7 expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.589798:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae7103 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c7 expref: 250 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.589811:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:0.0:1763343036.589814:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343036.589817:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dc000, rc 0) 00000100:00100000:0.0:1763343036.589908:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56886:x1848997993580032:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 913us (1705us total) trans 8589940015 rc 0/0 00000100:00100000:0.0:1763343036.589918:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9363 00000100:00100000:2.0:1763343036.590543:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.592352:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993580288 00000100:00100000:0.0:1763343036.592373:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993580288 00000100:00100000:1.0:1763343036.594908:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3191 00000100:00100000:1.0:1763343036.594945:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:55941:x1848997993580288:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:1.0:1763343036.595406:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:55941:x1848997993580288:12345-192.168.204.21@tcp:35:bash.0 Request processed in 479us (4862us total) trans 8589940016 rc 0/0 00000100:00100000:1.0:1763343036.595415:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3191 00000100:00100000:2.0:1763343036.597439:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.598204:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993580416 00000100:00100000:0.0:1763343036.598219:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993580416 00000100:00100000:2.0:1763343036.598361:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3192 00000100:00100000:2.0:1763343036.598374:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353c652850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56886:x1848997993580416:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:2.0:1763343036.601731:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353c652850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56886:x1848997993580416:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 3338us (4284us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.601752:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3192 00000100:00100000:2.0:1763343036.607125:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.607422:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993580672 00000100:00100000:3.0:1763343036.607437:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993580672 00000100:00100000:0.0:1763343036.608577:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9364 00000100:00100000:0.0:1763343036.608600:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56886:x1848997993580672:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343036.608658:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.608689:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae7111 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac95ce expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.608842:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7118 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.608862:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7118 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.608877:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7118 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343036.608893:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e3:0x0]: returning size 5 00010000:00010000:0.0:1763343036.609047:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae7111 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ce expref: 254 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.609074:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7118 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ce expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.609085:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:0.0:1763343036.609088:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343036.609093:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dc600, rc 0) 00000100:00100000:0.0:1763343036.609187:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56886:x1848997993580672:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 596us (2077us total) trans 8589940017 rc 0/0 00000100:00100000:0.0:1763343036.609196:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9364 00000100:00100000:1.0:1763343036.614473:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.614580:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993581056 00000100:00100000:2.0:1763343036.614595:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993581056 00000100:00100000:2.0:1763343036.614700:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3193 00000100:00100000:2.0:1763343036.614714:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56886:x1848997993581056:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:2.0:1763343036.614811:0:6527:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1e3:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7118 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ce expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.614867:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7126 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343036.614883:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7069 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9581 expref: 253 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.614893:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae7103 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c7 expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.614913:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9596 expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.614921:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae70b6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ab expref: 253 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.614937:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7126 lrc: 7/0,1 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343036.614987:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae70b6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ab expref: 253 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.615004:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae70b6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ab expref: 253 pid: 6525 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343036.615024:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010274048:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343036.621060:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9596 expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.621087:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9596 expref: 253 pid: 28422 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343036.621110:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095bb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010274176:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343036.621224:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae7103 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c7 expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.621235:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae7103 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c7 expref: 253 pid: 28422 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343036.621245:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095ba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010274304:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343036.621284:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7069 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9581 expref: 253 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.621300:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7069 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9581 expref: 253 pid: 6525 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343036.621310:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010274432:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343036.621338:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a34047269c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343036.624230:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:1.0:1763343036.624510:0:6527:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@0000000024b8295f x1848998010274048) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae70b6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ab expref: 253 pid: 6525 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.624543:0:6527:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae70b6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ab expref: 253 pid: 6525 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.624573:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae70b6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ab expref: 253 pid: 6525 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343036.624593:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010274048:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343036.624607:0:6527:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@000000006ce62c76 x1848998010274176) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9596 expref: 252 pid: 28422 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.624617:0:6527:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9596 expref: 252 pid: 28422 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.624683:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae70a1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9596 expref: 252 pid: 28422 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343036.624694:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095bb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010274176:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343036.624708:0:6527:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@00000000673b7142 x1848998010274304) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae7103 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c7 expref: 251 pid: 28422 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.624719:0:6527:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae7103 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c7 expref: 251 pid: 28422 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.624732:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae7103 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c7 expref: 251 pid: 28422 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343036.624748:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095ba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010274304:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343036.624760:0:6527:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@000000002a81112d x1848998010274432) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7069 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9581 expref: 250 pid: 6525 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.624770:0:6527:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7069 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9581 expref: 250 pid: 6525 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.624781:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7069 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9581 expref: 250 pid: 6525 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343036.624789:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010274432:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343036.624831:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:1.0:1763343036.624838:0:6527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7126 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.624849:0:6527:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7126 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.624857:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7126 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.624884:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7126 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.624909:0:6527:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7126 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.624915:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7126 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00000004:00020000:1.0:1763343036.625121:0:6527:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0000-mdtlov: can not set all stale mirrors for [0x200000405:0x1e3:0x0]: rc = -1 00010000:00010000:1.0:1763343036.625158:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7126 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.625167:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7126 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.625174:0:6527:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7126 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.625181:0:6527:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.625187:0:6527:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7126 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.625194:0:6527:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7126 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.625203:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:1.0:1763343036.625206:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1763343036.625210:0:6527:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7126 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.625216:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7126 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.625226:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8400) 00010000:00010000:1.0:1763343036.625229:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343036.625233:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7118 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ce expref: 249 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343036.625449:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56886:x1848997993581056:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 10736us (10990us total) trans 8589940018 rc -1/-1 00000100:00100000:1.0:1763343036.625462:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3193 00000100:00100000:3.0:1763343036.626235:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993581184 00000100:00100000:3.0:1763343036.626247:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993581184 00000100:00100000:3.0:1763343036.626326:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9365 00000100:00100000:3.0:1763343036.626337:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56891:x1848997993581184:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:3.0:1763343036.626403:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1763343036.626407:0:10041:0:(ldlm_lockd.c:1753:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 607405d401ae70a1) 00010000:00010000:3.0:1763343036.626409:0:10041:0:(ldlm_lockd.c:1753:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 607405d401ae70b6) 00010000:00010000:3.0:1763343036.626411:0:10041:0:(ldlm_lockd.c:1753:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 607405d401ae7103) 00010000:00010000:3.0:1763343036.626413:0:10041:0:(ldlm_lockd.c:1753:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 607405d401ae7069) 00010000:00010000:3.0:1763343036.626415:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343036.626451:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae712d lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.626467:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae712d lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.626479:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae712d lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.626494:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae7134 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.626500:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae7134 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.626506:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae7134 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.626617:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae713b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.626665:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae713b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.626673:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae713b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00080000:3.0:1763343036.626990:0:10041:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1e3:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1763343036.627090:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae713b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627097:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae713b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627104:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae713b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627111:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405136600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.627116:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae713b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627123:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae713b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627135:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a34039e8800) 00010000:00010000:3.0:1763343036.627137:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763343036.627141:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae713b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627147:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae713b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627170:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae712d lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627179:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae712d lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627186:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae712d lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627191:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae712d lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627195:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405136200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.627198:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae712d lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627203:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae712d lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627209:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8b00) 00010000:00010000:3.0:1763343036.627211:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.627214:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae712d lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627219:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae712d lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00010000:3.0:1763343036.627230:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e7b522b4 reply state 00000000e5693fdb transno 8589940019 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae7134 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627240:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae7134 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.627246:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8300) 00010000:00010000:3.0:1763343036.627248:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343036.627251:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343036.627324:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56891:x1848997993581184:12345-192.168.204.21@tcp:36:rm.0 Request processed in 987us (3108us total) trans 8589940019 rc 0/0 00000100:00100000:3.0:1763343036.627332:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9365 00000100:00100000:2.0:1763343036.632361:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.636827:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993581312 00000100:00100000:1.0:1763343036.636845:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993581312 00000100:00100000:1.0:1763343036.636959:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9366 00000100:00100000:1.0:1763343036.636971:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56886:x1848997993581312:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.637004:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.637033:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae7142 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac95d5 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.637109:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae7142 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95d5 expref: 252 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.637126:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e400/0x607405d401ae7142 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95d5 expref: 252 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.637146:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a3404421b00) 00010000:00010000:1.0:1763343036.637149:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343036.637153:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3e400, rc 0) 00000100:00100000:1.0:1763343036.637228:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56886:x1848997993581312:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 260us (4882us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.637235:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9366 00000100:00100000:2.0:1763343036.641066:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.641396:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993581568 00000100:00100000:1.0:1763343036.641410:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993581568 00000100:00100000:1.0:1763343036.641473:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3194 00000100:00100000:1.0:1763343036.641483:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56886:x1848997993581568:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:1.0:1763343036.641815:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1e3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1763343036.641904:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1441, 64 off121592 00000040:00080000:1.0:1763343036.641931:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1440, 64 off121592 00000040:00080000:1.0:1763343036.641939:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1441, 64 off121656 00000040:00080000:1.0:1763343036.641947:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1442, 64 off121656 00010000:00010000:1.0:1763343036.642021:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae7149 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.642042:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae7149 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.642056:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae7149 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.642065:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae7149 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.642072:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae7149 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.642078:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae7149 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343036.642105:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343036.642329:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56886:x1848997993581568:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 845us (1274us total) trans 8589940020 rc 0/0 00000100:00100000:1.0:1763343036.642337:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3194 00010000:00010000:3.0:1763343036.642797:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343036.642807:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae7149 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.642815:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343036.642819:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae7149 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.642828:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae7149 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.642844:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e3:0x0].0x0 (ffff9a3404421b00) 00010000:00010000:3.0:1763343036.642847:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343036.642852:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae7149 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.642858:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae7149 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.642870:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343036.642871:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343036.642874:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343036.647810:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.647925:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993581696 00000100:00100000:1.0:1763343036.647940:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993581696 00000100:00100000:1.0:1763343036.648018:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9367 00000100:00100000:1.0:1763343036.648031:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56892:x1848997993581696:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.648060:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.648092:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae7150 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac95dc expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.648196:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae7157 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648215:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae7157 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648230:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae7157 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648242:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae715e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648250:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae715e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648255:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae715e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648327:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae7157 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648335:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae7157 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648342:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae7157 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648348:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae7157 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648354:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.648359:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae7157 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648371:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae7157 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648386:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421400) 00010000:00010000:1.0:1763343036.648389:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343036.648393:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae7157 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648400:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae7157 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648411:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae715e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648417:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae715e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648422:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae715e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648427:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fa00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.648429:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae715e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648433:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae715e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648439:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8300) 00010000:00010000:1.0:1763343036.648441:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343036.648443:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae715e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648448:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae715e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.648477:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae7150 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95dc expref: 254 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.648487:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421400) 00010000:00010000:1.0:1763343036.648489:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343036.648493:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae7150 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95dc expref: 254 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.648506:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f800, rc 0) 00000100:00100000:1.0:1763343036.648583:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56892:x1848997993581696:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 554us (789us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343036.648591:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9367 00000100:00100000:2.0:1763343036.667518:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.667680:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993581824 00000100:00100000:0.0:1763343036.667693:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993581824 00000100:00100000:0.0:1763343036.667760:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9368 00000100:00100000:0.0:1763343036.667771:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56892:x1848997993581824:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343036.667805:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.667840:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae7165 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac95e3 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.667941:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae716c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.667957:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae716c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.667971:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae716c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.667985:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7173 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.667997:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7173 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668004:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7173 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668054:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae716c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668062:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae716c lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668069:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae716c lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668076:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343036.668080:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae716c lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668088:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae716c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668102:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4300) 00010000:00010000:0.0:1763343036.668106:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343036.668112:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae716c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668119:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae716c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668135:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7173 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668140:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7173 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668147:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7173 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668152:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343036.668155:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7173 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668160:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7173 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668167:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8300) 00010000:00010000:0.0:1763343036.668169:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343036.668172:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7173 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668177:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7173 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.668207:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae7165 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95e3 expref: 254 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.668219:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4300) 00010000:00010000:0.0:1763343036.668221:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343036.668225:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae7165 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95e3 expref: 254 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.668239:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dc200, rc 0) 00000100:00100000:0.0:1763343036.668322:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56892:x1848997993581824:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 552us (826us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343036.668332:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9368 00000100:00100000:2.0:1763343036.673090:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.673992:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993581952 00000100:00100000:1.0:1763343036.674007:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993581952 00000100:00100000:0.0:1763343036.674955:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9369 00000100:00100000:0.0:1763343036.674973:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56892:x1848997993581952:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343036.675000:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.675032:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae717a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac95ea expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.675150:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7181 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.675168:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.675181:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343036.675246:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343036.675252:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343036.675309:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae717a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ea expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.675333:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ea expref: 254 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.675342:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4f00) 00010000:00010000:0.0:1763343036.675346:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343036.675350:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dce00, rc 0) 00000100:00100000:0.0:1763343036.675436:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56892:x1848997993581952:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 467us (2891us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343036.675447:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9369 00000100:00100000:2.0:1763343036.687805:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.687956:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993582080 00000100:00100000:3.0:1763343036.687971:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993582080 00000100:00100000:3.0:1763343036.688065:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9370 00000100:00100000:3.0:1763343036.688077:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56892:x1848997993582080:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343036.688103:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343036.688131:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae7188 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac95f1 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.688223:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae718f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688241:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae718f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688255:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae718f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688343:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7196 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688353:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7196 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688360:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7196 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688413:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae718f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688420:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae718f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688492:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae718f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688500:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae718f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688506:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405136600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.688511:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae718f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688523:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae718f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688536:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4f00) 00010000:00010000:3.0:1763343036.688539:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.688544:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae718f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688550:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae718f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688565:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7196 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688570:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7196 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688576:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7196 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688580:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.688582:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7196 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688587:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7196 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688593:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8300) 00010000:00010000:3.0:1763343036.688595:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.688597:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7196 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688601:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7196 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.688694:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae7188 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95f1 expref: 255 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.688706:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4f00) 00010000:00010000:3.0:1763343036.688709:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.688712:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae7188 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95f1 expref: 255 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.688722:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405136200, rc 0) 00000100:00100000:3.0:1763343036.688800:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56892:x1848997993582080:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 725us (1010us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343036.688809:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9370 00000100:00100000:2.0:1763343036.694657:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.694741:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993582336 00000100:00100000:0.0:1763343036.694755:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993582336 00000100:00100000:0.0:1763343036.694830:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9371 00000100:00100000:0.0:1763343036.694841:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56892:x1848997993582336:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343036.694868:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.694871:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343036.694915:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7181 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ea expref: 254 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.694938:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4f00) 00010000:00010000:0.0:1763343036.694950:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343036.694968:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae719d lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac95f8 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.695106:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae71a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.695121:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae71a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.695131:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae71a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.695142:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae71ab lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.695149:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae71ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.695154:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae71ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.695618:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae71b2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.695666:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae71b2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.695674:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae71b2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343036.695686:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e5:0x0]: returning size 0 00010000:00010000:0.0:1763343036.695715:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae71a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.695722:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae71a4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.695729:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae71a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.695736:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343036.695741:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae71a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.695749:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae71a4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.695758:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4300) 00010000:00010000:0.0:1763343036.695761:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343036.695764:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae71a4 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.698110:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae71a4 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343036.698161:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f32fd6a7 reply state 0000000013effe8f transno 8589940021 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae71ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.698189:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae71ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.698199:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8300) 00010000:00010000:0.0:1763343036.698203:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343036.698210:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343036.698281:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae719d lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95f8 expref: 256 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.698306:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae71b2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95f8 expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.698314:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a34037c4600) 00010000:00010000:0.0:1763343036.698317:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343036.698320:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dc400, rc 0) 00000100:00100000:0.0:1763343036.698891:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56892:x1848997993582336:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4047us (4277us total) trans 8589940021 rc 0/0 00000100:00100000:0.0:1763343036.698911:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9371 00000100:00100000:2.0:1763343036.705914:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.708594:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993582592 00000100:00100000:0.0:1763343036.708617:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993582592 00000100:00100000:0.0:1763343036.708740:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9372 00000100:00100000:0.0:1763343036.708753:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56892:x1848997993582592:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343036.708785:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.708815:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae71c0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac95ff expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.708971:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae71c7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.708990:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae71b2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95f8 expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.708999:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae71c7 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.709043:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae71b2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95f8 expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.709061:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae71b2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95f8 expref: 257 pid: 28422 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343036.709078:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010274560:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343036.709203:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35085399c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343036.710331:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.715355:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993582848 00000100:00100000:1.0:1763343036.715378:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993582848 00000100:00100000:1.0:1763343036.715477:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9373 00000100:00100000:1.0:1763343036.715490:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56893:x1848997993582848:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.715517:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.715544:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae71ce lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9606 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.715717:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae71d5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.715738:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae71d5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.715751:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae71d5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343036.715766:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e5:0x0]: returning size 0 00010000:00010000:1.0:1763343036.715874:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae71d5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.715882:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae71d5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.715889:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae71d5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.715908:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fa00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.715913:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae71d5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.715921:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae71d5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.715935:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a34037c4600) 00010000:00010000:1.0:1763343036.715940:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763343036.715946:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae71d5 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.715953:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae71d5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.716006:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae71ce lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9606 expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.716018:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a34037c4600) 00010000:00010000:1.0:1763343036.716021:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343036.716026:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae71ce lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9606 expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.716042:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f800, rc 0) 00000100:00100000:1.0:1763343036.716151:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56893:x1848997993582848:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 663us (5829us total) trans 8589940022 rc 301/301 00000100:00100000:1.0:1763343036.716161:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9373 00000100:00100000:0.0:1763343036.718938:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010274560:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343036.718977:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae71c7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343036.719068:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.719531:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993582976 00000100:00100000:2.0:1763343036.719541:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993582976 00010000:00010000:2.0:1763343036.719588:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae71b2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95f8 expref: 259 pid: 28422 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343036.719670:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3088 00000100:00100000:2.0:1763343036.719682:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503521180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:2429:x1848997993582976:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343036.719704:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343036.719712:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae71b2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95f8 expref: 259 pid: 28422 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343036.719730:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae71b2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95f8 expref: 259 pid: 28422 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343036.719759:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae71b2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95f8 expref: 259 pid: 28422 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343036.719778:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a34037c4600) 00010000:00010000:2.0:1763343036.719784:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae71c7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.719795:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae71c7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.719804:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae71c7 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.719825:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343036.719907:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503521180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:2429:x1848997993582976:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 226us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.719916:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3088 00010000:00010000:0.0:1763343036.720776:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae71c7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.720788:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae71c7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343036.720819:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e5:0x0]: returning size 0 00000004:00080000:0.0:1763343036.721052:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2ab:0x0], index 0: 0 00000004:00080000:0.0:1763343036.721060:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2ad:0x0], index 1: 0 00000004:00080000:0.0:1763343036.721065:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2ae:0x0], index 1: 0 00000004:00080000:0.0:1763343036.721068:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2ac:0x0], index 0: 0 00010000:00010000:0.0:1763343036.721199:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae71c7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.721208:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae71c7 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.721214:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae71c7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.721220:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343036.721225:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae71c7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.721233:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae71c7 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.721249:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a34037c4600) 00010000:00010000:0.0:1763343036.721252:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343036.721257:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae71c7 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.721262:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae71c7 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343036.721322:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae71c0 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ff expref: 258 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.721334:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a34037c4600) 00010000:00010000:0.0:1763343036.721337:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343036.721340:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae71c0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95ff expref: 258 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.721357:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dce00, rc 0) 00000100:00100000:3.0:1763343036.724399:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.725163:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56892:x1848997993582592:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 16406us (19270us total) trans 8589940023 rc 301/301 00000100:00100000:0.0:1763343036.725178:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9372 00000100:00100000:1.0:1763343036.725510:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993583232 00000100:00100000:1.0:1763343036.725522:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993583232 00000100:00100000:1.0:1763343036.725577:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3195 00000100:00100000:1.0:1763343036.725587:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56893:x1848997993583232:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343036.728383:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56893:x1848997993583232:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 2780us (3983us total) trans 8589940024 rc 0/0 00000100:00100000:1.0:1763343036.728403:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3195 00000100:00100000:3.0:1763343036.735409:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.735521:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.735616:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993583744 00000100:00100000:2.0:1763343036.735669:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993583744 00000100:00100000:2.0:1763343036.735748:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9374 00000100:00100000:2.0:1763343036.735760:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56893:x1848997993583744:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.735790:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.735822:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae71ea lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac960d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.735938:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae71f1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.735956:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae71f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.735970:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae71f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.735983:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae71f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.735991:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae71f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.735999:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae71f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736165:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae71ff lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736174:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae71ff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736182:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae71ff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343036.736194:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e5:0x0]: returning size 0 00010000:00010000:2.0:1763343036.736308:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae71f1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736316:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae71f1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736322:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae71f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736329:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae71f1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736336:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.736342:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae71f1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736350:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae71f1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736364:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:2.0:1763343036.736368:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.736373:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae71f1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736381:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae71f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736396:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae71f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736402:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae71f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736408:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae71f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736413:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.736416:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae71f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736422:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae71f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736429:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8300) 00010000:00010000:2.0:1763343036.736432:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.736436:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae71f8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736442:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae71f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.736486:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae71ea lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac960d expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.736507:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae71ff lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac960d expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.736516:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a35167a9f00) 00010000:00010000:2.0:1763343036.736518:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343036.736521:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c400, rc 0) 00000100:00100000:2.0:1763343036.736614:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56893:x1848997993583744:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 856us (1091us total) trans 8589940025 rc 0/0 00000100:00100000:2.0:1763343036.736664:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9374 00000100:00100000:0.0:1763343036.736990:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993583488 00000100:00100000:0.0:1763343036.736999:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993583488 00000100:00100000:0.0:1763343036.737033:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3196 00000100:00100000:0.0:1763343036.737042:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56892:x1848997993583488:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343036.737199:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56892:x1848997993583488:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 158us (1805us total) trans 8589940026 rc 0/0 00000100:00100000:0.0:1763343036.737206:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3196 00000100:00100000:3.0:1763343036.741327:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.741373:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.741421:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993583872 00000100:00100000:1.0:1763343036.741434:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993583872 00000100:00100000:1.0:1763343036.741501:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993584000 00000100:00100000:1.0:1763343036.741505:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993584000 00000100:00100000:1.0:1763343036.741539:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6583 00000100:00100000:1.0:1763343036.741552:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2429:x1848997993583872:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.741576:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.741606:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae720d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9614 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343036.741657:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343036.741684:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.741687:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.741698:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae720d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9614 expref: 40 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343036.741723:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae720d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9614 expref: 40 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343036.741741:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3ea00, rc 0) 00000100:00100000:1.0:1763343036.741809:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+40:2429:x1848997993583872:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 259us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.741818:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6583 00000100:00100000:1.0:1763343036.741839:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6584 00000100:00100000:1.0:1763343036.741847:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993584000:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.741855:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.741868:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7214 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac961b expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343036.741883:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343036.741909:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.741911:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.741916:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7214 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac961b expref: 14 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343036.741928:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7214 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac961b expref: 14 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343036.741937:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3e800, rc 0) 00000100:00100000:1.0:1763343036.741958:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993584000:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 113us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.741968:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6584 00000100:00100000:3.0:1763343036.747736:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.748081:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993584256 00000100:00100000:1.0:1763343036.748097:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993584256 00000100:00100000:1.0:1763343036.748457:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3197 00000100:00100000:1.0:1763343036.748470:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353c652c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56892:x1848997993584256:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343036.749418:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353c652c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56892:x1848997993584256:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 942us (1689us total) trans 8589940027 rc 0/0 00000100:00100000:1.0:1763343036.749430:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3197 00000100:00100000:1.0:1763343036.752135:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.753843:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993584512 00000100:00100000:0.0:1763343036.753862:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993584512 00000100:00100000:0.0:1763343036.754041:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3198 00000100:00100000:0.0:1763343036.754118:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56893:x1848997993584512:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343036.754425:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56893:x1848997993584512:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 373us (2304us total) trans 8589940028 rc 0/0 00000100:00100000:0.0:1763343036.754434:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3198 00000100:00100000:2.0:1763343036.757291:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.759311:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.759400:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993584768 00000100:00100000:3.0:1763343036.759414:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993584768 00000100:00100000:1.0:1763343036.759616:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993585024 00000100:00100000:1.0:1763343036.759637:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993585024 00000100:00100000:1.0:1763343036.759680:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9375 00000100:00100000:1.0:1763343036.759691:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993584768:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343036.759724:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.759727:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:3.0:1763343036.759800:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9376 00000100:00100000:3.0:1763343036.759808:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56893:x1848997993585024:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343036.759818:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343036.759847:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae721b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9629 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.759992:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7222 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760008:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7222 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760022:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7222 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760033:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7229 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760042:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7229 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760063:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7229 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.760121:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae71ff lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac960d expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.760143:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a35167a9f00) 00010000:00010000:1.0:1763343036.760157:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343036.760167:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae7230 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9622 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.760203:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7237 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760211:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7237 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760219:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7237 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.760227:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343036.760230:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e5:0x0]: returning size 0 00010000:00010000:1.0:1763343036.760240:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7237 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.760247:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.760342:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7222 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760351:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7222 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760362:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7222 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760368:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.760373:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7222 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760380:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7222 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760389:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8b00) 00010000:00010000:3.0:1763343036.760392:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.760396:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7222 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760403:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7222 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760413:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7229 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760419:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7229 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760426:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7229 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760431:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.760434:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7229 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.760435:0:10041:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7237 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760441:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7229 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343036.760448:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.760454:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8300) 00010000:00010000:3.0:1763343036.760457:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.760460:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7229 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760466:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7229 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.760511:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae721b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9629 expref: 267 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.760533:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7237 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9629 expref: 266 pid: 28422 timeout: 1330 lvb_type: 0 00010000:00010000:3.0:1763343036.760543:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7237 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9629 expref: 266 pid: 28422 timeout: 1330 lvb_type: 0 00010000:00010000:3.0:1763343036.760550:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92a00, rc 0) 00000100:00100000:3.0:1763343036.760670:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56893:x1848997993585024:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 860us (1369us total) trans 8589940029 rc 0/0 00000100:00100000:3.0:1763343036.760678:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9376 00000100:00100000:2.0:1763343036.766745:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.766828:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.766950:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993585152 00000100:00100000:1.0:1763343036.766974:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993585152 00010000:00010000:1.0:1763343036.767029:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7237 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9629 expref: 266 pid: 28422 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343036.767077:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3089 00000100:00100000:1.0:1763343036.767088:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:2432:x1848997993585152:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343036.767108:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343036.767115:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7237 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9629 expref: 266 pid: 28422 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.767132:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7237 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9629 expref: 266 pid: 28422 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.767165:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7237 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9629 expref: 266 pid: 28422 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.767187:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:1.0:1763343036.767195:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.767205:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.767214:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.767259:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343036.767326:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:2432:x1848997993585152:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 238us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.767335:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3089 00010000:00010000:3.0:1763343036.767600:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.767610:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343036.767661:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e5:0x0]: returning size 0 00010000:00010000:3.0:1763343036.767855:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae7230 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9622 expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.767875:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9622 expref: 265 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.767882:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:3.0:1763343036.767885:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1763343036.767888:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3fc00, rc 0) 00000100:00100000:3.0:1763343036.767950:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993584768:12345-192.168.204.21@tcp:101:bash.0 Request processed in 8261us (10674us total) trans 8589940030 rc 0/0 00000100:00100000:3.0:1763343036.767958:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9375 00000100:00100000:0.0:1763343036.768121:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993585280 00000100:00100000:0.0:1763343036.768130:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993585280 00000100:00100000:0.0:1763343036.768177:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3199 00000100:00100000:0.0:1763343036.768188:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56893:x1848997993585280:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:0.0:1763343036.768293:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56893:x1848997993585280:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 108us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343036.768301:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3199 00000100:00100000:2.0:1763343036.772473:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.772538:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993585536 00000100:00100000:0.0:1763343036.772552:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993585536 00000100:00100000:0.0:1763343036.772659:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3200 00000100:00100000:0.0:1763343036.772672:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993585536:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343036.772983:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:55941:x1848997993585536:12345-192.168.204.21@tcp:35:bash.0 Request processed in 312us (525us total) trans 8589940031 rc 0/0 00000100:00100000:0.0:1763343036.772990:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3200 00000100:00100000:2.0:1763343036.785759:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.785877:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993585664 00000100:00100000:3.0:1763343036.785901:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993585664 00000100:00100000:3.0:1763343036.785980:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9377 00000100:00100000:3.0:1763343036.785992:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:55941:x1848997993585664:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343036.786025:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343036.786054:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7253 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9630 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.786097:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae725a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.786115:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae725a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.786128:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae725a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.786268:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7253 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9630 expref: 268 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.786369:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae725a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9630 expref: 267 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.786380:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:3.0:1763343036.786384:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343036.786388:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343036.786477:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:55941:x1848997993585664:12345-192.168.204.21@tcp:101:bash.0 Request processed in 486us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343036.786485:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9377 00000100:00100000:3.0:1763343036.793339:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.793397:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.793477:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993585920 00000100:00100000:1.0:1763343036.793492:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993585920 00000100:00100000:1.0:1763343036.793570:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993586176 00000100:00100000:1.0:1763343036.793574:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993586176 00000100:00100000:1.0:1763343036.793611:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9378 00000100:00100000:1.0:1763343036.793652:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56894:x1848997993585920:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.793682:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.793717:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae7261 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9637 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.793822:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae7268 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.793839:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae7268 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.793853:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae7268 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.793871:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae726f lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.793880:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae726f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.793886:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae726f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794035:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae7276 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794047:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae7276 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794054:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae7276 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343036.794066:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e5:0x0]: returning size 0 00010000:00010000:1.0:1763343036.794166:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae7268 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794174:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae7268 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794180:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae7268 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794185:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae7268 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794191:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.794195:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae7268 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794207:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae7268 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794220:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421600) 00010000:00010000:1.0:1763343036.794223:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343036.794227:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae7268 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794233:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae7268 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794245:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae726f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794250:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae726f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794255:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae726f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794259:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.794262:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae726f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794266:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae726f lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794271:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8300) 00010000:00010000:1.0:1763343036.794273:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343036.794276:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae726f lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794280:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae726f lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.794319:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae7261 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9637 expref: 271 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.794338:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae7276 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9637 expref: 270 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.794345:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:1.0:1763343036.794348:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00000100:00100000:2.0:1763343036.794648:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9379 00000100:00100000:2.0:1763343036.794665:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:55941:x1848997993586176:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:2.0:1763343036.794851:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.794865:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae7276 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9637 expref: 271 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.794876:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 4/0,1 mode: --/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.794933:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae7276 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9637 expref: 271 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.795108:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae7276 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9637 expref: 271 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343036.795126:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010274688:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343036.795233:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726540 going to sleep for 11 seconds 00010000:00010000:1.0:1763343036.796422:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3fa00, rc 0) 00000100:00100000:1.0:1763343036.801601:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56894:x1848997993585920:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 7959us (8296us total) trans 8589940032 rc 0/0 00000100:00100000:1.0:1763343036.801633:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9378 00000100:00100000:3.0:1763343036.802590:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010274688:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343036.802665:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:0.0:1763343036.806792:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.806924:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993586304 00000100:00100000:1.0:1763343036.806937:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993586304 00000100:00100000:1.0:1763343036.807008:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9380 00000100:00100000:1.0:1763343036.807021:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56894:x1848997993586304:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.807052:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.807083:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae728b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac963e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.807210:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.807227:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9622 expref: 272 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.807236:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.807245:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 5/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.807265:0:6523:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 4/0,1 mode: --/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.807297:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9622 expref: 272 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.807310:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9622 expref: 272 pid: 10041 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343036.807326:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503523b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010274816:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343036.807429:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abed80 going to sleep for 11 seconds 00000100:00100000:2.0:1763343036.812033:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.812161:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993586432 00000100:00100000:1.0:1763343036.812175:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993586432 00010000:00010000:1.0:1763343036.812237:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae7276 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9637 expref: 273 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343036.812293:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3090 00000100:00100000:1.0:1763343036.812303:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:2431:x1848997993586432:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343036.812325:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343036.812332:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae7276 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9637 expref: 273 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.812346:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae7276 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9637 expref: 273 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.812381:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae7276 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9637 expref: 273 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343036.812403:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:1.0:1763343036.812409:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.812420:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.812428:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.812436:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343036.812444:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.812451:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.812486:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343036.812530:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.812542:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00000001:00080000:3.0:1763343036.812712:0:10041:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940033 00000100:00100000:1.0:1763343036.812764:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:2431:x1848997993586432:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 461us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.812774:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3090 00000004:00010000:3.0:1763343036.812777:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000090f4a951 reply state 0000000076b69fc6 transno 8589940034 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.812793:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.812801:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:3.0:1763343036.812805:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.812807:0:10041:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00000100:00100000:3.0:1763343036.812814:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343036.812924:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:55941:x1848997993586176:12345-192.168.204.21@tcp:36:bash.0 Request processed in 18264us (19525us total) trans 8589940034 rc 0/0 00000100:00100000:3.0:1763343036.812933:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9379 00000020:00080000:3.0:1763343036.812937:0:10041:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343036.818255:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.818676:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993586560 00000100:00100000:3.0:1763343036.818691:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993586560 00010000:00010000:3.0:1763343036.818744:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9622 expref: 273 pid: 10041 timeout: 1330 lvb_type: 0 00000100:00100000:3.0:1763343036.818785:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3091 00000100:00100000:3.0:1763343036.818795:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:2430:x1848997993586560:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343036.818815:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343036.818822:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9622 expref: 273 pid: 10041 timeout: 1330 lvb_type: 0 00010000:00010000:3.0:1763343036.818836:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9622 expref: 273 pid: 10041 timeout: 1330 lvb_type: 0 00010000:00010000:3.0:1763343036.818864:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:3.0:1763343036.818871:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.818883:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.818902:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343036.820335:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.820519:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993586688 00000100:00100000:2.0:1763343036.820530:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993586688 00000100:00100000:2.0:1763343036.820587:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9381 00000100:00100000:2.0:1763343036.820596:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:55941:x1848997993586688:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343036.820640:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.820663:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7299 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9645 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.821194:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7299 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9645 expref: 275 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.821208:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7299 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9645 expref: 275 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.821236:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:2.0:1763343036.821239:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343036.821242:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352dc00, rc 0) 00000100:00100000:2.0:1763343036.821311:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:55941:x1848997993586688:12345-192.168.204.21@tcp:101:bash.0 Request processed in 716us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.821319:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9381 00010000:00010000:1.0:1763343036.821667:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae723e lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1e5:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9622 expref: 274 pid: 10041 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343036.821687:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503523b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010274816:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343036.821716:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343036.822599:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343036.822740:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:2430:x1848997993586560:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 3940us (4497us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.822754:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3091 00010000:00010000:1.0:1763343036.822912:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.822922:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343036.823982:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e5:0x0]: returning size 0 00000004:00200000:1.0:1763343036.823993:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343036.824024:0:6523:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.824077:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae728b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac963e expref: 273 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.824099:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac963e expref: 272 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.824109:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:1.0:1763343036.824112:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343036.824116:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343036.824191:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56894:x1848997993586304:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 17170us (17414us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.824201:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9380 00000100:00100000:3.0:1763343036.824426:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.826741:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993586944 00000100:00100000:1.0:1763343036.826759:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993586944 00000100:00100000:1.0:1763343036.826849:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9382 00000100:00100000:1.0:1763343036.826861:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:55941:x1848997993586944:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343036.826904:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.826908:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343036.828407:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7299 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9645 expref: 272 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.828441:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:1.0:1763343036.828447:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343036.828472:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae72a0 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac964c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.828541:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae72a7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.828578:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac963e expref: 272 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.828591:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae72a7 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343036.828657:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac963e expref: 272 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.828677:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac963e expref: 272 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343036.828695:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503523b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010274944:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343036.828819:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abed80 going to sleep for 11 seconds 00010000:00010000:2.0:1763343036.832746:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343036.834384:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.834447:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993587200 00000100:00100000:1.0:1763343036.834461:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993587200 00000100:00100000:1.0:1763343036.834543:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3201 00000100:00100000:1.0:1763343036.834753:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56894:x1848997993587200:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343036.835111:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:56894:x1848997993587200:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 362us (739us total) trans 8589940035 rc 0/0 00000100:00100000:1.0:1763343036.835121:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3201 00000100:00100000:1.0:1763343036.840339:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503523b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010274944:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343036.840383:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae72a7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343036.840420:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.840502:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993587328 00000100:00100000:2.0:1763343036.840511:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993587328 00010000:00010000:2.0:1763343036.840573:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac963e expref: 274 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343036.840671:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3092 00000100:00100000:2.0:1763343036.840683:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3508046050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:2429:x1848997993587328:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343036.840702:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343036.840709:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac963e expref: 274 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343036.840723:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac963e expref: 274 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343036.840752:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7292 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac963e expref: 274 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343036.840777:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:2.0:1763343036.840783:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae72a7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343036.840794:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae72a7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343036.840803:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae72a7 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343036.840828:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343036.840909:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3508046050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:2429:x1848997993587328:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 226us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.840919:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3092 00000100:00100000:3.0:1763343036.840926:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.840995:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993587584 00000100:00100000:2.0:1763343036.840999:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993587584 00000100:00100000:2.0:1763343036.841033:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9383 00000100:00100000:2.0:1763343036.841042:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56894:x1848997993587584:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.841064:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.841090:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae72ae lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9653 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.841205:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae72b5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841217:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae72b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841225:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae72b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841236:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae72bc lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841244:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae72bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841251:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae72bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841388:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae72c3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841398:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae72c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841405:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae72c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:2.0:1763343036.841416:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e5:0x0]: returning size 0 00010000:00010000:0.0:1763343036.841511:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae72a7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343036.841519:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae72c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343036.841521:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae72a7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343036.841538:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae72c3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841547:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae72c3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841554:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.841559:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae72c3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841567:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae72c3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841577:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:2.0:1763343036.841581:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1763343036.841585:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae72c3 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841591:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae72c3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841607:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae72b5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841613:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae72b5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841658:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae72b5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841667:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae72b5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841673:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.841677:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae72b5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841684:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae72b5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841693:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:2.0:1763343036.841696:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.841699:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae72b5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841706:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae72b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841717:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae72bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841724:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae72bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841730:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae72bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841734:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.841737:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae72bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841743:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae72bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841752:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8300) 00010000:00010000:2.0:1763343036.841755:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.841758:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae72bc lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841763:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae72bc lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.841802:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae72ae lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9653 expref: 275 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.841811:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a35167a9600) 00000040:00080000:0.0:1763343036.841813:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1442, 88 off121744 00010000:00010000:2.0:1763343036.841814:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343036.841820:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae72ae lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9653 expref: 275 pid: 10041 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763343036.841825:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1230509203275ns, next at 1231072337277ns, rc = 0 00010000:00010000:2.0:1763343036.841845:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d400, rc 0) 00000040:00080000:0.0:1763343036.841855:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1443, 88 off121744 00000004:00080000:0.0:1763343036.841862:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1230509241149ns, next at 1231072373054ns, rc = 0 00000040:00080000:0.0:1763343036.841878:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1444, 88 off121832 00000004:00080000:0.0:1763343036.841884:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1230509263118ns, next at 1231072373054ns, rc = 0 00000100:00100000:2.0:1763343036.841900:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:56894:x1848997993587584:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 849us (965us total) trans 8589940036 rc 301/301 00000040:00080000:0.0:1763343036.841903:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1443, 88 off121832 00000004:00080000:0.0:1763343036.841912:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1230509291654ns, next at 1231072337277ns, rc = 0 00000100:00100000:2.0:1763343036.841913:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9383 00000100:00100000:3.0:1763343036.846203:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.849948:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993587712 00000100:00100000:2.0:1763343036.849971:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993587712 00000100:00100000:2.0:1763343036.850068:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9384 00000100:00100000:2.0:1763343036.850080:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:56894:x1848997993587712:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.850107:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.850136:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae72d1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac965a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.850268:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae72d8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.850285:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae72a7 lrc: 2/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343036.850295:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae72d8 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.850320:0:6525:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae72a7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343036.850333:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae72d8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:2.0:1763343036.854874:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940037 is committed 00000004:00080000:2.0:1763343036.854900:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 950 committed 00000004:00080000:2.0:1763343036.854926:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 949 committed 00000004:00080000:2.0:1763343036.854937:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 948 committed 00000004:00080000:2.0:1763343036.854943:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 949 committed 00000100:00100000:2.0:1763343036.855024:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763343036.855052:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010275200:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343036.855099:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010275328:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343036.855142:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343036.855180:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010275072:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343036.855200:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343036.855236:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010275200 00000100:00100000:2.0:1763343036.855244:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010275200 00000100:00100000:2.0:1763343036.855296:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010275072 00000100:00100000:2.0:1763343036.855300:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010275072 00000100:00100000:2.0:1763343036.855321:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6585 00000100:00100000:2.0:1763343036.855330:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3658:x1848998010275200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343036.855362:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:682 count 1 00010000:00010000:2.0:1763343036.855396:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae72df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.855421:0:28993:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405137800/0x607405d401ae70a8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac959d expref: 13 pid: 27833 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343036.855430:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343036.855433:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae7134 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.855434:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.855440:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae72df lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.855448:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae7134 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.855459:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae7134 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.855466:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.855472:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae7134 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.855476:0:28993:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3405137800/0x607405d401ae70a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac959d expref: 13 pid: 27833 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343036.855485:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae7134 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.855513:0:28993:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3405137800/0x607405d401ae70a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac959d expref: 13 pid: 27833 timeout: 1330 lvb_type: 1 00010000:00010000:3.0:1763343036.855515:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8300) 00010000:00010000:3.0:1763343036.855522:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.855528:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae7134 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000100:00100000:2.0:1763343036.855536:0:28993:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010275584:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343036.855539:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae7134 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.855614:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae71ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343036.855617:0:28993:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726240 going to sleep for 11 seconds 00010000:00010000:3.0:1763343036.855655:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae71ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.855663:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae71ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.855669:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc600 already unused, calling callback (ffffffffc19a2550) 00000100:00100000:2.0:1763343036.855672:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6586 00010000:00010000:3.0:1763343036.855675:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae71ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.855684:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae71ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343036.855684:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3658:x1848998010275072:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1763343036.855700:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8300) 00002000:00080000:2.0:1763343036.855703:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:681 count 1 00010000:00010000:3.0:1763343036.855704:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.855710:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae71ab lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343036.855717:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae71ab lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343036.855720:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae72e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.855736:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c0 expref: 13 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.855740:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.855746:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343036.855750:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343036.855751:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.855756:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae72e6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.855761:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343036.855784:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c0 expref: 13 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.855794:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c0 expref: 13 pid: 8410 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343036.855804:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010275712:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343036.855838:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726600 going to sleep for 11 seconds 00000100:00100000:0.0:1763343036.855847:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343036.855874:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343036.855882:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010275456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343036.855921:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343036.855971:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010275328 00000100:00100000:0.0:1763343036.855976:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010275328 00000100:00100000:0.0:1763343036.856006:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010275456 00000100:00100000:0.0:1763343036.856010:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010275456 00000100:00100000:0.0:1763343036.856030:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6587 00000100:00100000:0.0:1763343036.856038:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3659:x1848998010275328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343036.856110:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010276224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343036.856144:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343036.856170:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343036.856177:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010276096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343036.856199:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343036.856227:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010276224 00000100:00100000:1.0:1763343036.856231:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010276224 00000100:00100000:0.0:1763343036.856244:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010275328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (397us total) trans 21474838918 rc 0/0 00000100:00100000:0.0:1763343036.856253:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6587 00000100:00100000:1.0:1763343036.856260:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010276096 00000100:00100000:1.0:1763343036.856264:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010276096 00000100:00100000:0.0:1763343036.856277:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6588 00000100:00100000:0.0:1763343036.856285:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3659:x1848998010275456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343036.856354:0:15756:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2ac:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343036.856358:0:15756:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2ac:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343036.856361:0:15756:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2ac:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343036.856363:0:15756:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2ac:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343036.856366:0:15756:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2ac:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343036.856391:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010275456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (471us total) trans 21474838919 rc 0/0 00000100:00100000:1.0:1763343036.856772:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6589 00000100:00100000:0.0:1763343036.856785:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6588 00000100:00100000:1.0:1763343036.856786:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+70:3660:x1848998010276224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343036.856808:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6590 00010000:00010000:3.0:1763343036.856815:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d200 already unused, calling callback (ffffffffc19a2550) 00000100:00100000:0.0:1763343036.856817:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+70:3660:x1848998010276096:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763343036.856821:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.856830:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.856844:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:3.0:1763343036.856847:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.856851:0:3643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae72d8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.856861:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343036.856868:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7284 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00002000:00010000:1.0:1763343036.856903:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2ae:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343036.856908:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2ae:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343036.856911:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2ae:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343036.856914:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2ae:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343036.856917:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2ae:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343036.856966:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+72:3660:x1848998010276224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 186us (821us total) trans 17179871621 rc 0/0 00000100:00100000:1.0:1763343036.856978:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6589 00000004:00080000:3.0:1763343036.857013:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b8380/2, rc 0, transno 17179871621 00000100:00100000:3.0:1763343036.857022:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010276224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343036.857027:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010275840:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343036.857069:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343036.857078:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+71:3660:x1848998010276096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 260us (875us total) trans 17179871622 rc 0/0 00000100:00100000:0.0:1763343036.857086:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6590 00000100:00100000:1.0:1763343036.857094:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343036.857104:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010275840 00000100:00100000:1.0:1763343036.857105:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010275968:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343036.857111:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010275840 00000100:00100000:1.0:1763343036.857137:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343036.857143:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6591 00000100:00100000:0.0:1763343036.857152:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+71:3657:x1848998010275840:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763343036.857165:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3503521180/2, rc 0, transno 17179871622 00002000:00080000:0.0:1763343036.857167:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:683 count 1 00000100:00100000:3.0:1763343036.857170:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010276096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343036.857176:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010275968 00000100:00100000:1.0:1763343036.857182:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010275968 00010000:00010000:0.0:1763343036.857183:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae72ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.857201:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95b2 expref: 39 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.857208:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343036.857211:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343036.857214:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae72ed lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343036.857219:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6592 00000100:00100000:1.0:1763343036.857230:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+72:3657:x1848998010275968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763343036.857244:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:684 count 1 00010000:00010000:0.0:1763343036.857253:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95b2 expref: 39 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.857258:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae72f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.857274:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae70af lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95a4 expref: 39 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343036.857281:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.857283:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.857286:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae72f4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.857308:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae70af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95a4 expref: 39 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343036.857320:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae70af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95a4 expref: 39 pid: 8408 timeout: 1330 lvb_type: 1 00000100:00100000:1.0:1763343036.857338:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010276480:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343036.857373:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abed80 going to sleep for 11 seconds 00010000:00010000:0.0:1763343036.857375:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95b2 expref: 39 pid: 8410 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343036.857389:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010276352:192.168.204.21@tcp:104: 00000004:00080000:1.0:1763343036.857413:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406550380/2, rc 0, transno 21474838919 00000100:00100000:1.0:1763343036.857422:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010275456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343036.857425:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35085399c0 going to sleep for 11 seconds 00000004:00080000:1.0:1763343036.857435:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3403ad4e00/2, rc 0, transno 21474838918 00000100:00100000:1.0:1763343036.857440:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010275328:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763343036.857526:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae72a7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac964c expref: 250 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.857537:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:0.0:1763343036.857539:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343036.857542:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae72d8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.857555:0:6523:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae72d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.857561:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae72d8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343036.857609:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae72a0 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac964c expref: 250 pid: 6523 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343036.857654:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae72a7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac964c expref: 249 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.857690:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:0.0:1763343036.857719:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:55941:x1848997993586944:12345-192.168.204.21@tcp:101:bash.0 Request processed in 30861us (33295us total) trans 8589940037 rc 0/0 00000100:00100000:0.0:1763343036.857729:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9382 00010000:00010000:3.0:1763343036.857984:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae72d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.857993:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae72d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343036.858039:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e5:0x0]: returning size 2 00000004:00200000:3.0:1763343036.858045:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343036.858068:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae72d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.858097:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae72d1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac965a expref: 249 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.858116:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae72d8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac965a expref: 248 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.858123:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:3.0:1763343036.858126:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763343036.858128:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c600, rc 0) 00000100:00100000:3.0:1763343036.858175:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56894:x1848997993587712:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8097us (11987us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343036.858182:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9384 00000100:00100000:3.0:1763343036.861132:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.861158:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.861184:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.861208:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.861282:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010275712:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343036.861319:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae72e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343036.861357:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993587968 00000100:00100000:0.0:1763343036.861364:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993587968 00010000:00010000:0.0:1763343036.861401:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c0 expref: 14 pid: 8410 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343036.862979:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993588224 00000100:00100000:0.0:1763343036.862995:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993588224 00010000:00010000:0.0:1763343036.863036:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70d9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95b2 expref: 40 pid: 8410 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343036.868478:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993587840 00000100:00100000:2.0:1763343036.868500:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993587840 00000100:00100000:0.0:1763343036.868646:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993588096 00000100:00100000:0.0:1763343036.868652:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993588096 00000100:00100000:2.0:1763343036.868685:0:28993:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010275584:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343036.868712:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae70af lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95a4 expref: 41 pid: 8408 timeout: 1330 lvb_type: 1 00010000:00010000:2.0:1763343036.868725:0:28993:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae72df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343036.868749:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3093 00000100:00100000:2.0:1763343036.868766:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3094 00000100:00100000:0.0:1763343036.868766:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2432:x1848997993587968:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763343036.868781:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+41:2432:x1848997993588224:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343036.868789:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343036.868795:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343036.868800:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c0 expref: 15 pid: 8410 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343036.868806:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70d9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95b2 expref: 41 pid: 8410 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1763343036.868821:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c0 expref: 15 pid: 8410 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343036.868826:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95b2 expref: 41 pid: 8410 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1763343036.868861:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405137400/0x607405d401ae70e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95c0 expref: 15 pid: 8410 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343036.868863:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.868867:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.868874:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae72ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.868881:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343036.868885:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.868887:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae72ed lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.868897:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae72e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.868919:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae72e6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.868932:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343036.868955:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343036.868975:0:8410:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae72e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.868985:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae72e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.868995:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae72e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.869004:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae72e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343036.869014:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+41:2432:x1848997993588224:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 235us (7852us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343036.869027:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343036.869028:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3094 00000100:00100000:2.0:1763343036.869055:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3095 00000100:00100000:2.0:1763343036.869063:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+40:2432:x1848997993588096:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343036.869071:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343036.869076:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae70af lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95a4 expref: 40 pid: 8408 timeout: 1330 lvb_type: 1 00010000:00010000:2.0:1763343036.869086:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae70af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95a4 expref: 40 pid: 8408 timeout: 1330 lvb_type: 1 00010000:00010000:2.0:1763343036.869100:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.869101:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.869105:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae72f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.869113:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae72f4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.869126:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343036.869146:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+40:2432:x1848997993588096:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 84us (7936us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.869153:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3095 00010000:00010000:2.0:1763343036.869184:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405137800/0x607405d401ae70a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac959d expref: 14 pid: 27833 timeout: 1330 lvb_type: 1 00000100:00100000:2.0:1763343036.869210:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3096 00000100:00100000:2.0:1763343036.869218:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2432:x1848997993587840:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343036.869227:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343036.869232:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3405137800/0x607405d401ae70a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac959d expref: 14 pid: 27833 timeout: 1330 lvb_type: 1 00010000:00010000:2.0:1763343036.869242:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3405137800/0x607405d401ae70a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac959d expref: 14 pid: 27833 timeout: 1330 lvb_type: 1 00010000:00010000:2.0:1763343036.869258:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405137800/0x607405d401ae70a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac959d expref: 14 pid: 27833 timeout: 1330 lvb_type: 1 00010000:00010000:2.0:1763343036.869269:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.869271:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.869274:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae72df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.869281:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae72df lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.869297:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343036.869315:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2432:x1848997993587840:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 98us (8129us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.869322:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3096 00010000:00010000:2.0:1763343036.869338:0:28993:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae72df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.869346:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae72df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.869356:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae72df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.869364:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae72df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.869389:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1763343036.869761:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343036.869772:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae72e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.869781:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343036.869786:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae72e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.869797:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae72e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.869812:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae72e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.869826:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae72e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.869847:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343036.869850:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae72df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.869857:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343036.869860:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae72df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.869868:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae72df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.869877:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae72df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.869885:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae72df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.869905:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343036.869907:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343036.869909:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343036.871398:0:28995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae70af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95a4 expref: 39 pid: 8408 timeout: 1330 lvb_type: 1 00000100:00100000:1.0:1763343036.871422:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010276480:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343036.871452:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae72f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.871464:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae72f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.871472:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae72f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343036.871479:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3658:x1848998010275072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15792us (16271us total) trans 21474838920 rc 0/0 00010000:00010000:1.0:1763343036.871487:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae72f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343036.871494:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6586 00010000:00010000:1.0:1763343036.871501:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae72f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.871535:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343036.871543:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343036.871551:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae72f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.871560:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343036.871564:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae72f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.871574:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae72f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.871594:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae72f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.871603:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae72f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.871640:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343036.871642:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343036.871644:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343036.871677:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405137200/0x607405d401ae70d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac95b2 expref: 38 pid: 8410 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343036.871688:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010276352:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343036.871703:0:15756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae72ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.871712:0:15756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae72ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.871718:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae72ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.871726:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae72ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.871733:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae72ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.871750:0:15756:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343036.871969:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+74:3657:x1848998010275968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14739us (14831us total) trans 17179871623 rc 0/0 00000100:00100000:1.0:1763343036.871978:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6592 00010000:00010000:1.0:1763343036.872000:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343036.872005:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae72ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.872013:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343036.872017:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae72ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.872025:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae72ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.872038:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae72ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.872046:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae72ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.872062:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343036.872064:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343036.872066:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343036.872094:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3503522300/2, rc 0, transno 17179871623 00000100:00100000:1.0:1763343036.872101:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010275968:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1763343036.872137:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3403ad6680/2, rc 0, transno 21474838920 00000100:00100000:1.0:1763343036.872142:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010275072:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343036.872232:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2432:x1848997993587968:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 3473us (11114us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.872243:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3093 00000100:00100000:0.0:1763343036.872274:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:3657:x1848998010275840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15115us (15198us total) trans 17179871624 rc 0/0 00000100:00100000:0.0:1763343036.872283:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6591 00010000:00010000:0.0:1763343036.872317:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343036.872343:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3503523b80/2, rc 0, transno 17179871624 00000100:00100000:0.0:1763343036.872349:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010275840:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343036.873131:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.875358:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010275200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20013us (20201us total) trans 21474838921 rc 0/0 00000100:00100000:2.0:1763343036.875378:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6585 00000004:00080000:0.0:1763343036.875394:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3403ad5880/2, rc 0, transno 21474838921 00000100:00100000:0.0:1763343036.875410:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010275200:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343036.875544:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.875576:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993588352 00000100:00100000:1.0:1763343036.875587:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993588352 00000100:00100000:0.0:1763343036.875730:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6593 00000100:00100000:0.0:1763343036.875740:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:55941:x1848997993588352:12345-192.168.204.21@tcp:101:bash.0 00000100:00100000:1.0:1763343036.875960:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993588480 00000100:00100000:1.0:1763343036.875965:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993588480 00000100:00100000:1.0:1763343036.876006:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6594 00000100:00100000:1.0:1763343036.876015:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993588480:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343036.876026:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.876045:0:15756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343036.876054:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae72fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9668 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.876059:0:15756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3501481200/0x607405d401ae7302 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9661 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343036.876101:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343036.876128:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.876131:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.876149:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae72fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9668 expref: 15 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343036.876173:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae72fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9668 expref: 15 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343036.876183:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343036.876186:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343036.876191:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501481200/0x607405d401ae7302 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9661 expref: 15 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.876224:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae72fb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9668 expref: 15 pid: 28995 timeout: 1330 lvb_type: 1 00010000:00010000:1.0:1763343036.876237:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae72fb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9668 expref: 15 pid: 28995 timeout: 1330 lvb_type: 1 00010000:00010000:0.0:1763343036.876261:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae72fb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9668 expref: 15 pid: 28995 timeout: 1330 lvb_type: 1 00010000:00010000:0.0:1763343036.876273:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae72fb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9668 expref: 15 pid: 28995 timeout: 1330 lvb_type: 1 00010000:00010000:1.0:1763343036.876292:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:0.0:1763343036.876307:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010276608:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343036.876367:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993588480:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 352us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.876377:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6594 00000100:00100000:0.0:1763343036.876382:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3508539480 going to sleep for 11 seconds 00000100:00100000:2.0:1763343036.882613:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010276608:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343036.882695:0:15756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3501481200/0x607405d401ae7302 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9661 expref: 14 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.882721:0:15756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501481200, rc 0) 00000100:00100000:3.0:1763343036.882880:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.882959:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993588736 00000100:00100000:0.0:1763343036.882970:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993588736 00000100:00100000:0.0:1763343036.883044:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3202 00000100:00100000:0.0:1763343036.883056:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+248:56894:x1848997993588736:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343036.883334:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56894:x1848997993588736:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 280us (455us total) trans 8589940038 rc 0/0 00000100:00100000:0.0:1763343036.883343:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3202 00000100:00100000:2.0:1763343036.883489:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:55941:x1848997993588352:12345-192.168.204.21@tcp:101:bash.0 Request processed in 7748us (10363us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.883500:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6593 00000100:00100000:0.0:1763343036.890501:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.891997:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993588864 00000100:00100000:1.0:1763343036.892017:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993588864 00010000:00010000:1.0:1763343036.892079:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae72fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9668 expref: 14 pid: 28995 timeout: 1330 lvb_type: 1 00000100:00100000:1.0:1763343036.892138:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3097 00000100:00100000:1.0:1763343036.892149:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993588864:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343036.892172:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343036.892180:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae72fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9668 expref: 14 pid: 28995 timeout: 1330 lvb_type: 1 00010000:00010000:1.0:1763343036.892195:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae72fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9668 expref: 14 pid: 28995 timeout: 1330 lvb_type: 1 00010000:00010000:1.0:1763343036.892227:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae72fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9668 expref: 14 pid: 28995 timeout: 1330 lvb_type: 1 00010000:00010000:1.0:1763343036.892248:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.892251:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343036.892260:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3501481200/0x607405d401ae7302 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9661 expref: 13 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.892276:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501481200/0x607405d401ae7302 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9661 expref: 13 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.892327:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a3501481200/0x607405d401ae7302 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9661 expref: 13 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343036.892343:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1848998010276736:192.168.204.21@tcp:105: 00000100:00100000:1.0:1763343036.892454:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abed80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343036.892749:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.892790:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993589120 00000100:00100000:3.0:1763343036.892795:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993589120 00000100:00100000:3.0:1763343036.892844:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9385 00000100:00100000:3.0:1763343036.892852:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56894:x1848997993589120:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343036.892879:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343036.892919:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7309 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac966f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.893016:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7310 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893031:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7310 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893043:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7310 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893056:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7317 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893062:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7317 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893068:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7317 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893214:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae731e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893224:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae731e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893231:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae731e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343036.893248:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e5:0x0]: returning size 2 00010000:00010000:3.0:1763343036.893359:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7310 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893368:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7310 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893373:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7310 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893380:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7310 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893385:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.893390:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7310 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893398:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7310 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893410:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:3.0:1763343036.893413:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.893419:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7310 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893427:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7310 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893439:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7317 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893445:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7317 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893453:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7317 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893458:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.893461:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7317 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893466:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7317 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893473:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8a00) 00010000:00010000:3.0:1763343036.893475:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.893478:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7317 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893483:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7317 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.893530:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7309 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac966f expref: 252 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.893545:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae731e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac966f expref: 251 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.893552:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:3.0:1763343036.893554:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343036.893557:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93600, rc 0) 00000100:00100000:3.0:1763343036.893607:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56894:x1848997993589120:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 755us (858us total) trans 8589940039 rc 0/0 00000100:00100000:3.0:1763343036.893615:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9385 00000100:00100000:1.0:1763343036.903925:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1848998010276736:192.168.204.21@tcp:105: 00010000:00010000:1.0:1763343036.903966:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343036.904227:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993588864:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 12076us (13739us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.904242:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3097 00000100:00100000:0.0:1763343036.908845:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.908901:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.909006:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993589376 00000100:00100000:1.0:1763343036.909020:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993589376 00000100:00100000:1.0:1763343036.909095:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3203 00000100:00100000:1.0:1763343036.909107:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350922a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56894:x1848997993589376:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343036.909500:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993589504 00000100:00100000:2.0:1763343036.909506:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993589504 00000100:00100000:2.0:1763343036.909548:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6595 00000100:00100000:2.0:1763343036.909556:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+38:55941:x1848997993589504:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343036.909569:0:15756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.909599:0:15756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae732c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9676 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343036.909666:0:15756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343036.909688:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.909691:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343036.909703:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae732c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9676 expref: 39 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.909721:0:15756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae732c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9676 expref: 39 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.909735:0:15756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d400, rc 0) 00000100:00100000:1.0:1763343036.910756:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350922a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56894:x1848997993589376:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1641us (1917us total) trans 8589940040 rc 0/0 00000100:00100000:1.0:1763343036.910770:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3203 00000100:00100000:2.0:1763343036.910897:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:55941:x1848997993589504:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1332us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343036.910906:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6595 00000100:00100000:3.0:1763343036.916053:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.916090:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.916139:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.916159:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993589632 00000100:00100000:2.0:1763343036.916178:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993589632 00002000:00010000:2.0:1763343036.916244:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/683 (0->18446744073709551615) 00002000:00100000:2.0:1763343036.916250:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34050f5c00 with x1848997993589632 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343036.916266:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34050f5c00. 00000100:00100000:2.0:1763343036.916309:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993589760 00000100:00100000:2.0:1763343036.916313:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993589760 00002000:00010000:2.0:1763343036.916328:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/685 (0->18446744073709551615) 00002000:00100000:2.0:1763343036.916331:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34050f7480 with x1848997993589760 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343036.916338:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34050f7480. 00000100:00100000:2.0:1763343036.916368:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1606 00000100:00100000:2.0:1763343036.916380:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993589632:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:3.0:1763343036.916441:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1607 00000100:00100000:3.0:1763343036.916457:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2430:x1848997993589760:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343036.916698:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2ab:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343036.916703:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2ab:0x0] updating lvb mtime from disk: 0 -> 1763343036 00002000:00010000:2.0:1763343036.916706:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2ab:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343036.916709:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2ab:0x0] updating lvb ctime from disk: 0 -> 1763343036 00002000:00010000:3.0:1763343036.916712:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2ad:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343036.916712:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2ab:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1763343036.916724:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2ad:0x0] updating lvb mtime from disk: 0 -> 1763343036 00002000:00010000:3.0:1763343036.916729:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2ad:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343036.916732:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2ad:0x0] updating lvb ctime from disk: 0 -> 1763343036 00002000:00010000:3.0:1763343036.916734:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2ad:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343036.916877:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+40:2430:x1848997993589760:12345-192.168.204.21@tcp:10:bash.0 Request processed in 425us (784us total) trans 17179871625 rc 0/0 00000100:00100000:3.0:1763343036.916886:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1607 00002000:00010000:3.0:1763343036.916899:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/685 (0->18446744073709551615) 00002000:00100000:3.0:1763343036.916902:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34050f7480 with x1848997993589760 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343036.916909:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34050f7480. 00000100:00100000:1.0:1763343036.917221:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993589888 00000100:00100000:1.0:1763343036.917230:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993589888 00000100:00100000:1.0:1763343036.917297:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3204 00000100:00100000:1.0:1763343036.917308:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56894:x1848997993589888:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:1.0:1763343036.917468:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56894:x1848997993589888:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 162us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343036.917475:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3204 00000100:00100000:2.0:1763343036.917666:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993589632:12345-192.168.204.21@tcp:10:bash.0 Request processed in 1286us (1626us total) trans 21474838922 rc 0/0 00000100:00100000:2.0:1763343036.917676:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1606 00002000:00010000:2.0:1763343036.917680:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/683 (0->18446744073709551615) 00002000:00100000:2.0:1763343036.917684:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34050f5c00 with x1848997993589632 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343036.917692:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34050f5c00. 00000100:00100000:2.0:1763343036.923552:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.929018:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993590144 00000100:00100000:0.0:1763343036.929044:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993590144 00000100:00100000:0.0:1763343036.929157:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9386 00000100:00100000:0.0:1763343036.929171:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56894:x1848997993590144:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343036.929202:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.929232:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7333 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac967d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.929391:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae733a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.929411:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae733a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.929431:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae733a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343036.929448:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e5:0x0]: returning size 2 00010000:00010000:0.0:1763343036.929594:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7333 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac967d expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.929695:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae733a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac967d expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.929707:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:0.0:1763343036.929710:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343036.929715:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480e00, rc 0) 00000100:00100000:0.0:1763343036.929820:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56894:x1848997993590144:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 652us (6283us total) trans 8589940041 rc 0/0 00000100:00100000:0.0:1763343036.929829:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9386 00000100:00100000:0.0:1763343036.939200:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.939268:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993590400 00000100:00100000:3.0:1763343036.939283:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993590400 00000100:00100000:0.0:1763343036.939321:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.939370:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9387 00000100:00100000:3.0:1763343036.939381:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56895:x1848997993590400:12345-192.168.204.21@tcp:36:rm.0 00000100:00100000:1.0:1763343036.939411:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993590656 00000100:00100000:1.0:1763343036.939418:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993590656 00010000:00010000:3.0:1763343036.939450:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00000100:00100000:1.0:1763343036.939467:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3205 00000100:00100000:1.0:1763343036.939477:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56894:x1848997993590656:12345-192.168.204.21@tcp:35:lfs.0 00010000:00010000:3.0:1763343036.939487:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae72a7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac964c expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.939515:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae731e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac966f expref: 254 pid: 6525 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1763343036.939533:0:14879:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1e5:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae733a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac967d expref: 253 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.939536:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae72d8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac965a expref: 253 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.939584:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7348 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343036.939812:0:14879:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae725a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40201000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9630 expref: 252 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.939824:0:14879:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7348 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343036.939867:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:3.0:1763343036.939884:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7348 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343036.939900:0:6525:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7348 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343036.939907:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7348 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343036.939930:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343036.939932:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae725a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9630 expref: 252 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343036.939949:0:14879:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7348 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343036.939957:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae734f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343036.939959:0:14879:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7348 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343036.939974:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7348 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343036.939975:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae734f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.939994:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae734f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940008:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae7356 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940015:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae7356 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940023:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae7356 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940118:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae735d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940127:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae735d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940134:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae735d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00020000:1.0:1763343036.940170:0:14879:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0000-mdtlov: can not set all stale mirrors for [0x200000405:0x1e5:0x0]: rc = -1 00010000:00010000:1.0:1763343036.940213:0:14879:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7348 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343036.940221:0:14879:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7348 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343036.940228:0:14879:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7348 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343036.940235:0:14879:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343036.940240:0:14879:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7348 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343036.940248:0:14879:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7348 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343036.940263:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:1.0:1763343036.940266:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1763343036.940270:0:14879:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7348 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343036.940276:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7348 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343036.940287:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:1.0:1763343036.940289:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343036.940293:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae733a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac967d expref: 251 pid: 6523 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343036.940388:0:6525:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1e5:0x0] is inserted into orphan list, open count = 2 00010000:00010000:3.0:1763343036.940491:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae735d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940498:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae735d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940504:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae735d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940508:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.940511:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae735d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940517:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae735d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940525:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:3.0:1763343036.940527:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763343036.940529:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae735d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940535:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae735d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940552:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae734f lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940563:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae734f lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940569:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae734f lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940574:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae734f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940578:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343036.940581:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae734f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940586:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae734f lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940592:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:3.0:1763343036.940594:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343036.940596:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae734f lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940600:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae734f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:3.0:1763343036.940611:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a3144935 reply state 0000000076d31bb6 transno 8589940042 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae7356 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940656:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae7356 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343036.940663:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8a00) 00010000:00010000:3.0:1763343036.940665:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343036.940667:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343036.940718:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56894:x1848997993590656:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1241us (1395us total) trans 8589940043 rc -1/-1 00000100:00100000:1.0:1763343036.940730:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3205 00000100:00100000:3.0:1763343036.941086:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56895:x1848997993590400:12345-192.168.204.21@tcp:36:rm.0 Request processed in 1705us (1902us total) trans 8589940042 rc 0/0 00000100:00100000:3.0:1763343036.941095:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9387 00000100:00100000:2.0:1763343036.944787:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343036.944852:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993590784 00000100:00100000:3.0:1763343036.944866:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993590784 00000100:00100000:3.0:1763343036.944966:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9388 00000100:00100000:3.0:1763343036.944978:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56894:x1848997993590784:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343036.945012:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343036.945046:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae7364 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9684 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.945131:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae7364 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9684 expref: 253 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.945148:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137c00/0x607405d401ae7364 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9684 expref: 253 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343036.945168:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a34039e8300) 00010000:00010000:3.0:1763343036.945171:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343036.945176:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137c00, rc 0) 00000100:00100000:3.0:1763343036.946939:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56894:x1848997993590784:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1945us (2150us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343036.946955:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9388 00000100:00100000:2.0:1763343036.958270:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343036.959178:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993591040 00000100:00100000:1.0:1763343036.959194:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993591040 00000100:00100000:0.0:1763343036.959855:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3206 00000100:00100000:0.0:1763343036.959874:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56894:x1848997993591040:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:0.0:1763343036.960203:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1e5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343036.960299:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1444, 64 off121896 00000040:00080000:0.0:1763343036.960327:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1445, 64 off121896 00000040:00080000:0.0:1763343036.960337:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1446, 64 off121960 00000040:00080000:0.0:1763343036.960346:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1445, 64 off121960 00010000:00010000:0.0:1763343036.960426:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae736b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343036.960453:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae736b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343036.960466:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae736b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343036.960476:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae736b lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343036.960483:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae736b lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343036.960489:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae736b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343036.960518:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343036.960604:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343036.960617:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae736b lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.960657:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343036.960661:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae736b lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.960672:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae736b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.960692:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e5:0x0].0x0 (ffff9a34039e8300) 00010000:00010000:3.0:1763343036.960695:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343036.960701:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae736b lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.960707:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae736b lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343036.960727:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343036.960730:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343036.960732:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343036.960831:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56894:x1848997993591040:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 960us (2573us total) trans 8589940044 rc 0/0 00000100:00100000:0.0:1763343036.960843:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3206 00000100:00100000:0.0:1763343036.981736:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343036.981824:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993591168 00000100:00100000:2.0:1763343036.981833:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993591168 00000100:00100000:2.0:1763343036.981904:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9389 00000100:00100000:2.0:1763343036.981915:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56896:x1848997993591168:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343036.981939:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343036.981963:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7372 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac968b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.982026:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7379 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982041:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7379 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982055:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7379 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982066:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7380 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982073:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982079:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982116:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7379 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982123:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7379 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982128:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7379 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982134:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7379 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982140:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.982144:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7379 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982151:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7379 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982162:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289300) 00010000:00010000:2.0:1763343036.982166:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.982170:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7379 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982177:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7379 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982203:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982209:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7380 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982214:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7380 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982219:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343036.982221:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7380 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982226:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7380 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982233:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8a00) 00010000:00010000:2.0:1763343036.982236:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.982238:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7380 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982244:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7380 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343036.982269:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7372 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac968b expref: 255 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.982279:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289300) 00010000:00010000:2.0:1763343036.982282:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343036.982286:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7372 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac968b expref: 255 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343036.982298:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352ce00, rc 0) 00000100:00100000:2.0:1763343036.982364:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56896:x1848997993591168:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 451us (638us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343036.982373:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9389 00000100:00100000:2.0:1763343036.996716:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343036.996785:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993591296 00000100:00100000:0.0:1763343036.996800:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993591296 00000100:00100000:0.0:1763343036.996879:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9390 00000100:00100000:0.0:1763343036.996899:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56896:x1848997993591296:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343036.996918:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343036.996943:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7387 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9692 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.997033:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae738e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997053:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae738e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997064:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae738e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997075:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7395 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997082:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7395 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997088:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7395 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997129:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae738e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997136:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae738e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997141:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae738e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997148:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae738e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997154:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343036.997158:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae738e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997165:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae738e lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997180:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4600) 00010000:00010000:0.0:1763343036.997183:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343036.997188:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae738e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997195:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae738e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997210:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7395 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997216:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7395 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997222:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7395 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997226:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343036.997229:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7395 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997235:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7395 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997242:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8a00) 00010000:00010000:0.0:1763343036.997244:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343036.997247:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7395 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997252:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7395 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343036.997277:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7387 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9692 expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.997288:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4600) 00010000:00010000:0.0:1763343036.997291:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343036.997295:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7387 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9692 expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343036.997308:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480e00, rc 0) 00000100:00100000:0.0:1763343036.998463:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56896:x1848997993591296:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1566us (1755us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343036.998474:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9390 00000100:00100000:3.0:1763343037.007124:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.007174:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.007432:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993591424 00000100:00100000:1.0:1763343037.007446:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993591424 00000100:00080000:2.0:1763343037.007581:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1763343037.008187:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993591680 00000100:00100000:0.0:1763343037.008205:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993591680 00000100:00100000:3.0:1763343037.008208:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9391 00000100:00100000:3.0:1763343037.008231:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56896:x1848997993591424:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343037.008260:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763343037.008301:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9392 00000100:00100000:0.0:1763343037.008315:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56897:x1848997993591680:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343037.008335:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.008364:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae739c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac96a0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.008408:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae73a3 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9699 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.008447:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae73aa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.008463:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae73aa lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.008474:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae73b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.008477:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae73aa lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.008512:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae73b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.008514:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae73b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.008538:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae73b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.008548:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae73b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.008571:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae73b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.008615:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae73aa lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:3.0:1763343037.008616:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343037.008656:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343037.008667:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae73aa lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.008676:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae73aa lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.008683:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae73aa lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.008690:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.008696:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae73aa lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.008706:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae73aa lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.008709:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae73a3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9699 expref: 258 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.008742:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4600) 00010000:00010000:0.0:1763343037.008748:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343037.008801:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae73b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9699 expref: 257 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.008812:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4600) 00010000:00010000:3.0:1763343037.008815:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343037.008819:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405137400, rc 0) 00000100:00100000:3.0:1763343037.008911:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56896:x1848997993591424:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 690us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.008919:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9391 00010000:00010000:0.0:1763343037.010149:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae73aa lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.010167:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae73aa lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.010188:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae73b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.010195:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae73b8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.010201:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae73b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.010207:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.010212:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae73b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.010218:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae73b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.010232:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8a00) 00010000:00010000:0.0:1763343037.010235:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.010239:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae73b8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.010245:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae73b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.010288:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae739c lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96a0 expref: 256 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.010299:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4600) 00010000:00010000:0.0:1763343037.010301:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343037.010304:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae739c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96a0 expref: 256 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.010312:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480e00, rc 0) 00000100:00100000:1.0:1763343037.011318:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56897:x1848997993591680:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2998us (4136us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343037.011332:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9392 00000100:00100000:2.0:1763343037.025126:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.027517:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993591936 00000100:00100000:1.0:1763343037.027538:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993591936 00000100:00100000:1.0:1763343037.027687:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9393 00000100:00100000:1.0:1763343037.027699:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56896:x1848997993591936:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343037.027726:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.027729:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343037.027764:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae73b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9699 expref: 255 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.027791:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4600) 00010000:00010000:1.0:1763343037.027804:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343037.027832:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae73bf lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac96a7 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.027972:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae73c6 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.027987:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae73c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.027997:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae73c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.028008:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae73cd lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.028014:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae73cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.028019:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae73cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.031433:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae73d4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.031465:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae73d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.031480:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae73d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343037.031498:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e6:0x0]: returning size 0 00010000:00010000:1.0:1763343037.031538:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae73c6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.031546:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae73c6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.031552:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae73c6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.031560:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae73c6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.031567:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.031572:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae73c6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.031584:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae73c6 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.031598:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421300) 00010000:00010000:1.0:1763343037.031602:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.031608:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae73c6 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.031615:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae73c6 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:1.0:1763343037.031673:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008abaec92 reply state 000000003a05f758 transno 8589940045 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae73cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.031687:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae73cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.031694:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8a00) 00010000:00010000:1.0:1763343037.031696:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343037.031699:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343037.031742:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae73bf lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96a7 expref: 257 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.031762:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae73d4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96a7 expref: 256 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.031770:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3404421700) 00010000:00010000:1.0:1763343037.031772:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343037.031775:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:1.0:1763343037.031868:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56896:x1848997993591936:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4170us (6750us total) trans 8589940045 rc 0/0 00000100:00100000:1.0:1763343037.031882:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9393 00000100:00100000:3.0:1763343037.036720:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.037539:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993592192 00000100:00100000:1.0:1763343037.037556:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993592192 00000100:00100000:2.0:1763343037.038245:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9394 00000100:00100000:2.0:1763343037.038273:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56896:x1848997993592192:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.038309:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.038338:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae73e2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac96ae expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.038486:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae73e9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.038505:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae73d4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96a7 expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.038515:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae73e9 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.038559:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae73d4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96a7 expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.038574:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae73d4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96a7 expref: 258 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343037.038592:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010276992:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343037.038761:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726180 going to sleep for 11 seconds 00000100:00100000:0.0:1763343037.046663:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.046866:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993592320 00000100:00100000:1.0:1763343037.046881:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993592320 00010000:00010000:1.0:1763343037.046956:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae73d4 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96a7 expref: 259 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343037.047015:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3098 00000100:00100000:1.0:1763343037.047027:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:2430:x1848997993592320:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343037.047048:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343037.047055:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae73d4 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96a7 expref: 259 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343037.047070:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae73d4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96a7 expref: 259 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343037.047099:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3404421700) 00010000:00010000:1.0:1763343037.047105:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae73e9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.047115:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae73e9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.047123:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae73e9 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.047144:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343037.047217:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:2430:x1848997993592320:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 191us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.047226:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3098 00010000:00010000:2.0:1763343037.047517:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae73d4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96a7 expref: 258 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343037.047549:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010276992:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343037.047577:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae73e9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.047587:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae73e9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.047593:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae73e9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343037.047819:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e6:0x0]: returning size 0 00000004:00080000:2.0:1763343037.048309:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2af:0x0], index 1: 0 00000004:00080000:2.0:1763343037.048320:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2ad:0x0], index 0: 0 00000004:00080000:2.0:1763343037.048326:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2ae:0x0], index 0: 0 00000004:00080000:2.0:1763343037.048330:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2b0:0x0], index 1: 0 00010000:00010000:2.0:1763343037.048445:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae73e9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.048454:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae73e9 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.048460:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae73e9 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.048468:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.048472:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae73e9 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.048479:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae73e9 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.048495:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3404421700) 00010000:00010000:2.0:1763343037.048498:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343037.048503:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae73e9 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.048508:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae73e9 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.048560:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae73e2 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ae expref: 258 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.048571:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3404421700) 00010000:00010000:2.0:1763343037.048573:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343037.048577:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae73e2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ae expref: 258 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.048590:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352ce00, rc 0) 00000100:00100000:2.0:1763343037.049843:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56896:x1848997993592192:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 11579us (13128us total) trans 8589940046 rc 301/301 00000100:00100000:2.0:1763343037.049855:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9394 00000100:00100000:1.0:1763343037.051441:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.051608:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993592576 00000100:00100000:2.0:1763343037.051717:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993592576 00000100:00100000:2.0:1763343037.051796:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9395 00000100:00100000:2.0:1763343037.051805:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56898:x1848997993592576:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.051827:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.051851:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae73f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac96b5 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.052440:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae73fe lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052528:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae73fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052541:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae73fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052553:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7405 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052560:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7405 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052566:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7405 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052778:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae740c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052787:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae740c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052794:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae740c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052882:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae73fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052899:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae73fe lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052906:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae73fe lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052911:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.052915:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae73fe lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052922:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae73fe lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052933:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289300) 00010000:00010000:2.0:1763343037.052937:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.052941:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae73fe lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052945:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae73fe lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052959:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7405 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052964:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7405 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052969:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7405 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052973:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.052976:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7405 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052985:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7405 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.052992:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8a00) 00010000:00010000:2.0:1763343037.052995:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.052997:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7405 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.053003:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7405 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.053152:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae73f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96b5 expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.053170:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae740c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96b5 expref: 259 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.053177:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:2.0:1763343037.053179:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343037.053181:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c600, rc 0) 00000100:00100000:2.0:1763343037.053248:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56898:x1848997993592576:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1443us (1812us total) trans 8589940047 rc 0/0 00000100:00100000:2.0:1763343037.053257:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9395 00000100:00100000:3.0:1763343037.053966:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.054178:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993592832 00000100:00100000:2.0:1763343037.054188:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993592832 00000100:00100000:2.0:1763343037.054231:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3207 00000100:00100000:2.0:1763343037.054238:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56896:x1848997993592832:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343037.054483:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56896:x1848997993592832:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 244us (525us total) trans 8589940048 rc 0/0 00000100:00100000:2.0:1763343037.054492:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3207 00000100:00100000:0.0:1763343037.063602:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.063685:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.063802:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993593216 00000100:00100000:3.0:1763343037.063812:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993593216 00000100:00100000:3.0:1763343037.064112:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3208 00000100:00100000:3.0:1763343037.064125:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350922ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56896:x1848997993593216:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343037.065214:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993592960 00000100:00100000:2.0:1763343037.065224:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993592960 00000100:00100000:2.0:1763343037.065275:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6596 00000100:00100000:2.0:1763343037.065285:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+40:2432:x1848997993592960:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.065298:0:15756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.065322:0:15756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae741a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac96bc expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343037.065377:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350922ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56896:x1848997993593216:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1254us (1689us total) trans 8589940049 rc 0/0 00000100:00100000:3.0:1763343037.065387:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3208 00002000:00010000:2.0:1763343037.065430:0:15756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343037.065450:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.065453:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.065464:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae741a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96bc expref: 41 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343037.065481:0:15756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae741a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96bc expref: 41 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343037.065495:0:15756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352ce00, rc 0) 00000100:00100000:2.0:1763343037.065518:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+41:2432:x1848997993592960:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 236us (1926us total) trans 0 rc 0/0 00000100:00080000:0.0:1763343037.065523:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1763343037.065528:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6596 00000100:00100000:0.0:1763343037.076524:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.077045:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.077170:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993593600 00000100:00100000:1.0:1763343037.077186:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993593600 00000100:00100000:1.0:1763343037.077253:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993593472 00000100:00100000:1.0:1763343037.077257:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993593472 00000100:00100000:2.0:1763343037.077277:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9396 00000100:00100000:1.0:1763343037.077288:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9397 00000100:00100000:2.0:1763343037.077294:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56898:x1848997993593600:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:1.0:1763343037.077301:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993593472:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343037.077332:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.077336:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343037.077339:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.077362:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7421 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac96ca expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.077366:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae740c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96b5 expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.077398:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:1.0:1763343037.077404:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343037.077419:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7428 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac96c3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.077433:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7421 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ca expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.077448:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7421 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ca expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.077467:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:2.0:1763343037.077471:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343037.077475:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352de00, rc 0) 00010000:00010000:1.0:1763343037.077535:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae742f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.077547:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae742f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.077559:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae742f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343037.077574:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e6:0x0]: returning size 0 00000100:00100000:3.0:1763343037.077745:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56898:x1848997993593600:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 455us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.077757:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9396 00010000:00010000:0.0:1763343037.078290:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7428 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96c3 expref: 264 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.078317:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae742f lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96c3 expref: 263 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.078326:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:0.0:1763343037.078329:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1763343037.078332:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:0.0:1763343037.078399:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:55941:x1848997993593472:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1103us (1356us total) trans 8589940050 rc 0/0 00000100:00100000:0.0:1763343037.078408:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9397 00000100:00100000:3.0:1763343037.084188:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.084357:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993593728 00000100:00100000:0.0:1763343037.084373:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993593728 00000100:00100000:3.0:1763343037.085396:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9398 00000100:00100000:3.0:1763343037.085572:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:55941:x1848997993593728:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343037.085608:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.085658:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae743d lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac96d1 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.085707:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae7444 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.085726:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae7444 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.085743:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae7444 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.085913:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae743d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96d1 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.085936:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae7444 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96d1 expref: 264 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.085946:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:3.0:1763343037.085950:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343037.085954:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405136600, rc 0) 00000100:00100000:3.0:1763343037.086064:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993593728:12345-192.168.204.21@tcp:101:bash.0 Request processed in 656us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.086077:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9398 00000100:00100000:2.0:1763343037.086163:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.087601:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993593984 00000100:00100000:3.0:1763343037.087613:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993593984 00000100:00100000:3.0:1763343037.088357:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3209 00000100:00100000:3.0:1763343037.088369:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56898:x1848997993593984:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343037.089032:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56898:x1848997993593984:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 663us (2874us total) trans 8589940051 rc 0/0 00000100:00100000:3.0:1763343037.089040:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3209 00000100:00100000:2.0:1763343037.092656:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.092750:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993594240 00000100:00100000:0.0:1763343037.092769:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993594240 00000100:00100000:0.0:1763343037.092931:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9399 00000100:00100000:0.0:1763343037.092944:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993594240:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343037.095287:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343037.095339:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae742f lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96c3 expref: 265 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.095369:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:0.0:1763343037.095376:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343037.095645:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae744b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.095664:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae744b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.095676:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae744b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000001:00080000:0.0:1763343037.095736:0:6523:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940052 00000004:00010000:0.0:1763343037.095766:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a6ee44f7 reply state 00000000045796c0 transno 8589940053 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae744b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.095781:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae744b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.095788:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:0.0:1763343037.095791:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343037.095794:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343037.095942:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:55941:x1848997993594240:12345-192.168.204.21@tcp:36:bash.0 Request processed in 2999us (3319us total) trans 8589940053 rc 0/0 00000100:00100000:0.0:1763343037.095953:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9399 00000020:00080000:0.0:1763343037.095960:0:6523:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343037.100354:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.101531:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993594496 00000100:00100000:0.0:1763343037.101547:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993594496 00000100:00100000:0.0:1763343037.101647:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9400 00000100:00100000:0.0:1763343037.101658:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56898:x1848997993594496:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343037.101691:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.101719:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7452 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac96d8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.101811:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7459 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.101827:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7459 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.101840:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7459 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.101850:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7460 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.101856:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7460 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.101862:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7460 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102003:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7467 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102011:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7467 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102017:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7467 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343037.102028:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e6:0x0]: returning size 0 00010000:00010000:0.0:1763343037.102123:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7459 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102130:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7459 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102136:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7459 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102141:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7459 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102147:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.102151:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7459 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102158:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7459 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102169:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4300) 00010000:00010000:0.0:1763343037.102172:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.102176:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7459 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102181:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7459 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102194:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7460 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102199:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7460 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102203:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7460 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102208:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.102210:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7460 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102214:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7460 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102219:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8a00) 00010000:00010000:0.0:1763343037.102220:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.102224:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7460 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102228:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae7460 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.102264:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7452 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96d8 expref: 270 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.102280:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7467 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96d8 expref: 269 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.102287:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:0.0:1763343037.102289:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343037.102292:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dce00, rc 0) 00000100:00100000:0.0:1763343037.102664:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56898:x1848997993594496:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1005us (2324us total) trans 8589940054 rc 0/0 00000100:00100000:0.0:1763343037.102672:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9400 00000100:00100000:2.0:1763343037.106944:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.108772:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993594752 00000100:00100000:0.0:1763343037.109805:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993594752 00000100:00100000:0.0:1763343037.109912:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9401 00000100:00100000:0.0:1763343037.109924:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:55941:x1848997993594752:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343037.109958:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.109963:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343037.110000:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7421 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ca expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.110023:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:0.0:1763343037.110030:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343037.110049:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae7475 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac96df expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.110113:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae747c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.110129:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7467 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96d8 expref: 269 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.110140:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae747c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.110182:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7467 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96d8 expref: 269 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.110196:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7467 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96d8 expref: 269 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343037.110213:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406553800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010277120:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343037.110328:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35085390c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343037.112706:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.112805:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993595008 00000100:00100000:3.0:1763343037.112819:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993595008 00000100:00100000:3.0:1763343037.112903:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3210 00000100:00100000:3.0:1763343037.112915:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56898:x1848997993595008:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343037.117098:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56898:x1848997993595008:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 4170us (4476us total) trans 8589940055 rc 0/0 00000100:00100000:3.0:1763343037.117116:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3210 00000100:00100000:1.0:1763343037.118770:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.118858:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993595136 00000100:00100000:2.0:1763343037.118870:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993595136 00010000:00010000:2.0:1763343037.118928:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7467 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96d8 expref: 271 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343037.118978:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3099 00000100:00100000:2.0:1763343037.118989:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3508044850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:2430:x1848997993595136:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343037.119007:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343037.119015:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7467 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96d8 expref: 271 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343037.119030:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7467 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96d8 expref: 271 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343037.119060:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:2.0:1763343037.119066:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae747c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.119078:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae747c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.119086:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae747c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.119108:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343037.119167:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3508044850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:2430:x1848997993595136:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 179us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.119175:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3099 00010000:00010000:0.0:1763343037.119350:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae7467 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96d8 expref: 270 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343037.119369:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406553800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010277120:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343037.119392:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae747c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.119402:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae747c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.119408:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae747c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:0.0:1763343037.119731:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1447, 88 off122048 00000004:00080000:0.0:1763343037.119743:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1230787121101ns, next at 1231072373054ns, rc = 0 00000040:00080000:0.0:1763343037.119768:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1446, 88 off122048 00000004:00080000:0.0:1763343037.119774:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1230787153624ns, next at 1231072337277ns, rc = 0 00000040:00080000:0.0:1763343037.119838:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1447, 88 off122136 00000004:00080000:0.0:1763343037.119843:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1230787222462ns, next at 1231072337277ns, rc = 0 00000040:00080000:0.0:1763343037.119864:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1448, 88 off122136 00000004:00080000:0.0:1763343037.119868:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1230787247634ns, next at 1231072373054ns, rc = 0 00000100:00100000:1.0:1763343037.125616:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.125895:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993595392 00000100:00100000:3.0:1763343037.125909:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993595392 00000100:00100000:3.0:1763343037.126243:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9402 00000100:00100000:3.0:1763343037.126257:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56898:x1848997993595392:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343037.126285:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.126318:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae7483 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac96e6 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.126420:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae748a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126442:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae748a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126456:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae748a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126467:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae7491 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126475:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae7491 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126481:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae7491 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126660:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7498 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126673:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7498 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126681:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7498 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343037.126694:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e6:0x0]: returning size 2 00010000:00010000:3.0:1763343037.126816:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7498 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126824:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7498 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126831:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7498 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126841:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343037.126846:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7498 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126853:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7498 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126866:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:3.0:1763343037.126870:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1763343037.126876:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7498 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126881:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7498 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126910:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae748a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126916:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae748a lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126921:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae748a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126925:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343037.126928:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae748a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126934:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae748a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126941:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:3.0:1763343037.126944:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343037.126947:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae748a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126953:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137800/0x607405d401ae748a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126961:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae7491 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126967:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae7491 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126973:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae7491 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126977:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343037.126980:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae7491 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126986:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae7491 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.126993:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8a00) 00010000:00010000:3.0:1763343037.126996:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343037.126999:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae7491 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.127004:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137400/0x607405d401ae7491 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.127050:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae7483 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96e6 expref: 273 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.127062:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:3.0:1763343037.127065:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343037.127069:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136200/0x607405d401ae7483 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96e6 expref: 273 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.127085:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405136200, rc 0) 00000100:00100000:3.0:1763343037.127169:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56898:x1848997993595392:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 914us (1568us total) trans 8589940057 rc 301/301 00000100:00100000:3.0:1763343037.127178:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9402 00000001:00080000:2.0:1763343037.127950:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940056 is committed 00000004:00080000:2.0:1763343037.127962:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 951 committed 00000004:00080000:2.0:1763343037.127975:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 952 committed 00000004:00080000:2.0:1763343037.127986:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 951 committed 00000004:00080000:2.0:1763343037.127989:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 950 committed 00010000:00010000:1.0:1763343037.128808:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae7356 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.128826:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae7356 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.128833:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae7356 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.128839:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405137200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.128844:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae7356 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.128852:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae7356 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.128870:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8a00) 00010000:00010000:1.0:1763343037.128873:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.128878:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae7356 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.128894:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405137200/0x607405d401ae7356 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.128922:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae73cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.128928:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae73cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.128934:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae73cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.128938:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.128942:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae73cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.128948:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae73cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.128955:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8a00) 00010000:00010000:1.0:1763343037.128957:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.128961:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae73cd lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.128966:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae73cd lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.128986:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae744b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.128992:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae744b lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.128997:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae744b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.129002:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.129004:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae744b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.129010:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae744b lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.129018:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:1.0:1763343037.129020:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.129023:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae744b lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.129033:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae744b lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:1.0:1763343037.129071:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010277504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.129156:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.129219:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343037.129226:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010277632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.129248:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.129291:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010277504 00000100:00100000:1.0:1763343037.129300:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010277504 00000100:00100000:1.0:1763343037.129363:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010277632 00000100:00100000:1.0:1763343037.129366:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010277632 00000100:00100000:1.0:1763343037.129386:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6597 00000100:00100000:1.0:1763343037.129395:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+74:3659:x1848998010277504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343037.129674:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353796b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010277248:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343037.129714:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343037.129744:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343037.129750:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010277376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343037.129775:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343037.129816:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010277248 00000100:00100000:0.0:1763343037.129821:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010277248 00000100:00100000:0.0:1763343037.129849:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010277376 00000100:00100000:0.0:1763343037.129852:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010277376 00000100:00100000:0.0:1763343037.129880:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6598 00000100:00100000:0.0:1763343037.129902:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+77:3659:x1848998010277632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763343037.129917:0:28995:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343037.129927:0:28995:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343037.129929:0:28995:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343037.129931:0:28995:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343037.129933:0:28995:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343037.130294:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+78:3659:x1848998010277504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 895us (1132us total) trans 17179871626 rc 0/0 00000100:00100000:0.0:1763343037.130308:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+78:3659:x1848998010277632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 417us (1056us total) trans 17179871627 rc 0/0 00000100:00100000:1.0:1763343037.130309:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6597 00000100:00100000:0.0:1763343037.130325:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6598 00000100:00100000:0.0:1763343037.130360:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6599 00000100:00100000:1.0:1763343037.130369:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6600 00000100:00100000:0.0:1763343037.130371:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e9cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3657:x1848998010277248:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.130385:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3657:x1848998010277376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343037.130393:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:685 count 1 00002000:00080000:1.0:1763343037.130416:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:686 count 1 00010000:00010000:0.0:1763343037.130419:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae74a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.130438:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae74ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.130445:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae732c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9676 expref: 40 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.130466:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343037.130469:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343037.130477:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae720d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9614 expref: 40 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343037.130477:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae74a6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.130529:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae732c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9676 expref: 40 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.130546:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae732c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9676 expref: 40 pid: 15756 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343037.130561:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010277760:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343037.130675:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.130678:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1763343037.130680:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35085399c0 going to sleep for 11 seconds 00010000:00010000:1.0:1763343037.130682:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae74ad lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.130730:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae720d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9614 expref: 40 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343037.130744:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae720d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9614 expref: 40 pid: 8407 timeout: 1330 lvb_type: 1 00000100:00100000:1.0:1763343037.130760:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010277888:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343037.130775:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae747c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96df expref: 250 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.130789:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:0.0:1763343037.130792:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343037.130814:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae7475 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96df expref: 250 pid: 6523 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1763343037.130818:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abed80 going to sleep for 11 seconds 00010000:00010000:0.0:1763343037.130849:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae747c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96df expref: 249 pid: 6523 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1763343037.130855:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1763343037.130906:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:0.0:1763343037.130912:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343037.130915:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dc000, rc 0) 00000100:00100000:0.0:1763343037.130955:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:55941:x1848997993594752:12345-192.168.204.21@tcp:101:bash.0 Request processed in 21032us (24023us total) trans 8589940056 rc 0/0 00000100:00100000:0.0:1763343037.130963:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9401 00000004:00080000:0.0:1763343037.131041:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34034f2d80/2, rc 0, transno 17179871627 00000100:00100000:0.0:1763343037.131048:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010277632:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343037.131058:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b0e00/2, rc 0, transno 17179871626 00000100:00100000:0.0:1763343037.131064:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010277504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343037.131082:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010278272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343037.131116:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343037.131145:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343037.131152:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010278016:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343037.131159:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010278400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343037.131419:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010278272 00000100:00100000:2.0:1763343037.131427:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010278272 00000100:00100000:2.0:1763343037.131476:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6601 00000100:00100000:2.0:1763343037.131485:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010278272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343037.135021:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.135038:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010278144:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343037.135148:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010278400 00000100:00100000:0.0:1763343037.135161:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010278400 00000100:00100000:0.0:1763343037.135226:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6602 00000100:00100000:0.0:1763343037.135237:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3659:x1848998010278400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343037.135438:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.135524:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010278144 00000100:00100000:0.0:1763343037.135527:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3659:x1848998010278400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 289us (518us total) trans 21474838924 rc 0/0 00000100:00100000:1.0:1763343037.135534:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010278144 00000100:00100000:0.0:1763343037.135541:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6602 00000100:00100000:0.0:1763343037.135575:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6603 00000100:00100000:0.0:1763343037.135589:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3658:x1848998010278144:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1763343037.135602:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1763343037.135608:0:10294:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:684 count 1 00010000:00010000:0.0:1763343037.135668:0:10294:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34064dce00/0x607405d401ae74b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.135693:0:10294:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7214 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac961b expref: 13 pid: 8407 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1763343037.135704:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343037.135715:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.135718:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.135724:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34064dce00/0x607405d401ae74b4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343037.135748:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010278016 00000100:00100000:1.0:1763343037.135754:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010278016 00010000:00010000:0.0:1763343037.135772:0:10294:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7214 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac961b expref: 13 pid: 8407 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1763343037.135787:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6604 00010000:00010000:0.0:1763343037.135793:0:10294:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7214 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac961b expref: 13 pid: 8407 timeout: 1330 lvb_type: 1 00000100:00100000:1.0:1763343037.135804:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3657:x1848998010278016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343037.135844:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:683 count 1 00010000:00010000:1.0:1763343037.135869:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae74bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.135905:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3501481200/0x607405d401ae7302 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9661 expref: 13 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.135914:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343037.135916:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343037.135920:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae74bb lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.135953:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3501481200/0x607405d401ae7302 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9661 expref: 13 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.135965:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3501481200/0x607405d401ae7302 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9661 expref: 13 pid: 15756 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343037.135979:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340683b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010278656:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343037.136039:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe9c0 going to sleep for 11 seconds 00000004:00080000:1.0:1763343037.136105:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3404ba6d80/2, rc 0, transno 21474838924 00000100:00100000:1.0:1763343037.136112:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010278400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343037.136691:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3659:x1848998010278272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5201us (5567us total) trans 21474838923 rc 0/0 00000100:00100000:2.0:1763343037.136703:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6601 00000100:00100000:3.0:1763343037.138568:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.138660:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993595648 00000100:00100000:2.0:1763343037.138672:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993595648 00000100:00100000:2.0:1763343037.138738:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3211 00000100:00100000:2.0:1763343037.138750:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56898:x1848997993595648:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343037.139091:0:10294:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10294:1848998010278528:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343037.139471:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56898:x1848997993595648:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 721us (914us total) trans 8589940058 rc 0/0 00000100:00100000:2.0:1763343037.139780:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3211 00000004:00080000:1.0:1763343037.140063:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3404ba4380/2, rc 0, transno 21474838923 00000100:00100000:1.0:1763343037.140079:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010278272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343037.140202:0:10294:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3508539480 going to sleep for 11 seconds 00000100:00100000:0.0:1763343037.141537:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010277760:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343037.141578:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae74a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343037.142518:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010277888:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343037.142553:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae74ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343037.143939:0:10294:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10294:1848998010278528:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343037.143979:0:10294:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a34064dce00/0x607405d401ae74b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343037.150724:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.151403:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340683b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010278656:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343037.151442:0:28648:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae74bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343037.151569:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993596160 00000100:00100000:1.0:1763343037.151579:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993596160 00010000:00010000:1.0:1763343037.151670:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7214 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac961b expref: 14 pid: 8407 timeout: 1330 lvb_type: 1 00000100:00100000:1.0:1763343037.151718:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3100 00000100:00100000:1.0:1763343037.151729:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2432:x1848997993596160:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343037.151749:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343037.151755:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7214 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac961b expref: 14 pid: 8407 timeout: 1330 lvb_type: 1 00010000:00010000:1.0:1763343037.151768:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7214 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac961b expref: 14 pid: 8407 timeout: 1330 lvb_type: 1 00010000:00010000:1.0:1763343037.151796:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae7214 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac961b expref: 14 pid: 8407 timeout: 1330 lvb_type: 1 00010000:00010000:1.0:1763343037.151816:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.151819:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.151824:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a34064dce00/0x607405d401ae74b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.151836:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34064dce00/0x607405d401ae74b4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.151864:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343037.151936:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2432:x1848997993596160:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 208us (2317us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.151945:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3100 00010000:00010000:1.0:1763343037.151978:0:10294:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a34064dce00/0x607405d401ae74b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.151987:0:10294:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34064dce00/0x607405d401ae74b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.151999:0:10294:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34064dce00/0x607405d401ae74b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.152008:0:10294:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a34064dce00/0x607405d401ae74b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.152026:0:10294:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343037.152325:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3658:x1848998010278144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16741us (16888us total) trans 21474838925 rc 0/0 00000100:00100000:1.0:1763343037.152335:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6603 00000004:00080000:1.0:1763343037.152384:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3404ba5880/2, rc 0, transno 21474838925 00000100:00100000:1.0:1763343037.152392:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010278144:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1763343037.152596:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343037.152605:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a34064dce00/0x607405d401ae74b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.152654:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343037.152659:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34064dce00/0x607405d401ae74b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.152669:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34064dce00/0x607405d401ae74b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.152687:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a34064dce00/0x607405d401ae74b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.152695:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34064dce00/0x607405d401ae74b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.152716:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343037.152718:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343037.152720:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343037.152906:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.152999:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.153036:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.153058:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993596288 00000100:00100000:2.0:1763343037.153065:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993596288 00010000:00010000:2.0:1763343037.153094:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501481200/0x607405d401ae7302 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9661 expref: 13 pid: 15756 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343037.153118:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993595776 00000100:00100000:2.0:1763343037.153121:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993595776 00010000:00010000:2.0:1763343037.153136:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae732c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9676 expref: 41 pid: 15756 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343037.153152:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993595904 00000100:00100000:2.0:1763343037.153155:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993595904 00010000:00010000:2.0:1763343037.153167:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae720d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9614 expref: 42 pid: 8407 timeout: 1330 lvb_type: 1 00000100:00100000:2.0:1763343037.153181:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3101 00000100:00100000:2.0:1763343037.153189:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2431:x1848997993596288:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343037.153201:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343037.153206:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3501481200/0x607405d401ae7302 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9661 expref: 13 pid: 15756 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343037.153216:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3501481200/0x607405d401ae7302 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9661 expref: 13 pid: 15756 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343037.153233:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3501481200/0x607405d401ae7302 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9661 expref: 13 pid: 15756 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343037.153249:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.153251:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.153256:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae74bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.153266:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae74bb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.153287:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343037.153328:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2431:x1848997993596288:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 138us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.153335:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3101 00000100:00100000:2.0:1763343037.153351:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3102 00000100:00100000:2.0:1763343037.153358:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+42:2429:x1848997993595776:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343037.153367:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343037.153372:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae732c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9676 expref: 42 pid: 15756 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343037.153383:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae732c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9676 expref: 42 pid: 15756 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343037.153404:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae732c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9676 expref: 42 pid: 15756 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343037.153414:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.153416:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.153420:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae74a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.153429:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae74a6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.153445:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343037.153462:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+41:2429:x1848997993595776:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 105us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.153469:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3102 00000100:00100000:2.0:1763343037.153481:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3103 00000100:00100000:2.0:1763343037.153487:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+40:2429:x1848997993595904:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343037.153494:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343037.153499:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae720d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9614 expref: 40 pid: 8407 timeout: 1330 lvb_type: 1 00010000:00010000:2.0:1763343037.153509:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae720d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9614 expref: 40 pid: 8407 timeout: 1330 lvb_type: 1 00010000:00010000:2.0:1763343037.153522:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3ea00/0x607405d401ae720d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9614 expref: 40 pid: 8407 timeout: 1330 lvb_type: 1 00010000:00010000:2.0:1763343037.153537:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.153539:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.153542:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae74ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.153549:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae74ad lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.153564:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343037.153583:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2429:x1848997993595904:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 95us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.153590:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3103 00010000:00010000:0.0:1763343037.154212:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae74a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.154223:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae74a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.154234:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae74a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.154241:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae74a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.154273:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343037.154576:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e9cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+77:3657:x1848998010277248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24204us (24858us total) trans 17179871628 rc 0/0 00000100:00100000:0.0:1763343037.154586:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6599 00000004:00080000:0.0:1763343037.154811:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a353796b100/2, rc 0, transno 17179871628 00000100:00100000:0.0:1763343037.154818:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353796b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010277248:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1763343037.155097:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1763343037.155116:0:28648:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae74bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.155127:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae74bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.155136:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae74bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.155144:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae74bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.155161:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343037.155341:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3657:x1848998010278016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19543us (19643us total) trans 21474838926 rc 0/0 00000100:00100000:3.0:1763343037.155351:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6604 00000100:00100000:3.0:1763343037.155414:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.155441:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.155461:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993596032 00000100:00100000:3.0:1763343037.155469:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993596032 00000100:00100000:3.0:1763343037.155507:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6605 00000100:00100000:3.0:1763343037.155515:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:55941:x1848997993596032:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343037.155535:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.155555:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac96ed expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.155584:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae741a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96bc expref: 40 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343037.155592:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.155595:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.155600:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 40 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.155671:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae741a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96bc expref: 40 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343037.155687:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae741a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96bc expref: 40 pid: 15756 timeout: 1330 lvb_type: 1 00000100:00100000:3.0:1763343037.155702:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34050f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010278784:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343037.155775:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133ccc0 going to sleep for 11 seconds 00010000:00010000:1.0:1763343037.157967:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae74ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.157991:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae74ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.158005:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae74ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.158014:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae74ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.158052:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1763343037.158427:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+77:3657:x1848998010277376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28043us (28646us total) trans 17179871629 rc 0/0 00000100:00100000:1.0:1763343037.158438:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6600 00010000:00010000:2.0:1763343037.158706:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1763343037.158718:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae74a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.158728:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343037.158734:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae74a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.158745:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae74a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.158772:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae74a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.158780:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc600/0x607405d401ae74a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.158805:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343037.158811:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae74bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.158817:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343037.158820:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae74bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.158827:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae74bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.158847:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae74bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.158854:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae74bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.158871:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343037.158875:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae74ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.158882:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343037.158895:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae74ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.158903:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae74ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.158914:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae74ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.158921:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176600/0x607405d401ae74ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.158935:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343037.158936:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343037.158938:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343037.158958:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993596416 00000100:00100000:2.0:1763343037.158969:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993596416 00010000:00010000:0.0:1763343037.158994:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343037.159024:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3212 00000100:00100000:2.0:1763343037.159033:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56898:x1848997993596416:12345-192.168.204.21@tcp:33:lfs.0 00000004:00080000:0.0:1763343037.159053:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3404ba4e00/2, rc 0, transno 21474838926 00000100:00100000:0.0:1763343037.159061:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010278016:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1763343037.159079:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b0a80/2, rc 0, transno 17179871629 00000100:00100000:0.0:1763343037.159083:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010277376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343037.159214:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56898:x1848997993596416:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 181us (3801us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.159221:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3212 00010000:00010000:3.0:1763343037.159518:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343037.161676:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34050f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:28648:1848998010278784:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343037.161721:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 40 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.161746:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:0.0:1763343037.161812:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+40:55941:x1848997993596032:12345-192.168.204.21@tcp:101:bash.0 Request processed in 6295us (6368us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.161824:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6605 00000100:00100000:0.0:1763343037.163513:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.163575:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993596544 00000100:00100000:1.0:1763343037.163590:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993596544 00010000:00010000:1.0:1763343037.163705:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae741a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96bc expref: 40 pid: 15756 timeout: 1330 lvb_type: 1 00000100:00100000:1.0:1763343037.163754:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3104 00000100:00100000:1.0:1763343037.163765:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+40:2430:x1848997993596544:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343037.163785:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343037.163792:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae741a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96bc expref: 40 pid: 15756 timeout: 1330 lvb_type: 1 00010000:00010000:1.0:1763343037.163812:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae741a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96bc expref: 40 pid: 15756 timeout: 1330 lvb_type: 1 00010000:00010000:1.0:1763343037.163841:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae741a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96bc expref: 40 pid: 15756 timeout: 1330 lvb_type: 1 00010000:00010000:1.0:1763343037.163858:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.163860:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.163869:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 39 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.163880:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 39 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.163943:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 39 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343037.163959:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406838380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1848998010278912:192.168.204.21@tcp:105: 00000100:00100000:1.0:1763343037.164062:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe900 going to sleep for 11 seconds 00000100:00100000:1.0:1763343037.173111:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406838380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1848998010278912:192.168.204.21@tcp:105: 00010000:00010000:1.0:1763343037.173150:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343037.173231:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2430:x1848997993596544:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 9466us (9726us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.173245:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3104 00000100:00100000:3.0:1763343037.177215:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.177369:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993596672 00000100:00100000:1.0:1763343037.177383:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993596672 00000100:00100000:1.0:1763343037.177453:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6606 00000100:00100000:1.0:1763343037.177464:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:55941:x1848997993596672:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343037.177487:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.177515:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae74c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac96f4 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343037.177545:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343037.177577:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.177580:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.177591:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae74c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96f4 expref: 13 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.177610:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae74c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96f4 expref: 13 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.177666:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343037.177741:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:55941:x1848997993596672:12345-192.168.204.21@tcp:101:bash.0 Request processed in 278us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.177749:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6606 00000100:00100000:0.0:1763343037.182185:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.182237:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.182343:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993596800 00000100:00100000:2.0:1763343037.182358:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993596800 00002000:00010000:2.0:1763343037.182413:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/687 (0->18446744073709551615) 00002000:00100000:2.0:1763343037.182418:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b4380 with x1848997993596800 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343037.182445:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34095b4380. 00000100:00100000:2.0:1763343037.182479:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993596928 00000100:00100000:2.0:1763343037.182483:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993596928 00002000:00010000:2.0:1763343037.182499:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/685 (0->18446744073709551615) 00002000:00100000:2.0:1763343037.182502:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b7100 with x1848997993596928 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343037.182510:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34095b7100. 00000100:00100000:2.0:1763343037.182540:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1608 00000100:00100000:2.0:1763343037.182552:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2432:x1848997993596800:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343037.182847:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343037.182851:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb mtime from disk: 0 -> 1763343037 00002000:00010000:2.0:1763343037.182854:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343037.182857:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb ctime from disk: 0 -> 1763343037 00002000:00010000:2.0:1763343037.182859:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343037.182940:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+40:2432:x1848997993596800:12345-192.168.204.21@tcp:10:bash.0 Request processed in 388us (771us total) trans 17179871630 rc 0/0 00000100:00100000:2.0:1763343037.182949:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1608 00002000:00010000:2.0:1763343037.182954:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/687 (0->18446744073709551615) 00002000:00100000:2.0:1763343037.182956:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b4380 with x1848997993596800 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343037.182961:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34095b4380. 00000100:00100000:2.0:1763343037.182982:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1609 00000100:00100000:2.0:1763343037.182989:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2432:x1848997993596928:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343037.183090:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2ad:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343037.183093:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2ad:0x0] updating lvb mtime from disk: 0 -> 1763343037 00002000:00010000:2.0:1763343037.183095:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2ad:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343037.183097:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2ad:0x0] updating lvb ctime from disk: 0 -> 1763343037 00002000:00010000:2.0:1763343037.183099:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2ad:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343037.183119:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2432:x1848997993596928:12345-192.168.204.21@tcp:10:bash.0 Request processed in 131us (882us total) trans 21474838927 rc 0/0 00000100:00100000:2.0:1763343037.183125:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1609 00002000:00010000:2.0:1763343037.183128:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/685 (0->18446744073709551615) 00002000:00100000:2.0:1763343037.183131:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b7100 with x1848997993596928 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343037.183135:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34095b7100. 00000100:00100000:1.0:1763343037.191437:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.191546:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993597184 00000100:00100000:3.0:1763343037.191560:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993597184 00000100:00100000:3.0:1763343037.191661:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9403 00000100:00100000:3.0:1763343037.191674:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56899:x1848997993597184:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343037.191701:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.191733:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae74d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac96fb expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.191868:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae74d7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.191900:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae74d7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.191915:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae74d7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.191929:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae74de lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.191936:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae74de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.191943:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae74de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192089:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae74e5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192101:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae74e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192113:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae74e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343037.192124:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e6:0x0]: returning size 2 00010000:00010000:3.0:1763343037.192231:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae74d7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192239:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae74d7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192246:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae74d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192253:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343037.192258:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae74d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192267:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae74d7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192283:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:3.0:1763343037.192287:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343037.192293:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae74d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192300:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae74d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192317:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae74de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192322:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae74de lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192332:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae74de lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192338:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343037.192341:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae74de lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192346:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae74de lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192352:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8500) 00010000:00010000:3.0:1763343037.192355:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343037.192358:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae74de lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192365:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae74de lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.192414:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae74d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96fb expref: 253 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.192433:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae74e5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96fb expref: 252 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.192441:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:3.0:1763343037.192444:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343037.192447:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343037.192546:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56899:x1848997993597184:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 874us (1123us total) trans 8589940059 rc 0/0 00000100:00100000:3.0:1763343037.192555:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9403 00000100:00100000:1.0:1763343037.193798:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.194458:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993597440 00000100:00100000:2.0:1763343037.194473:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993597440 00000100:00100000:2.0:1763343037.195786:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3213 00000100:00100000:2.0:1763343037.195811:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:55941:x1848997993597440:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:2.0:1763343037.196258:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:55941:x1848997993597440:12345-192.168.204.21@tcp:35:bash.0 Request processed in 457us (2468us total) trans 8589940060 rc 0/0 00000100:00100000:2.0:1763343037.196267:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3213 00000100:00100000:2.0:1763343037.206591:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.206806:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993597696 00000100:00100000:3.0:1763343037.206821:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993597696 00000100:00100000:3.0:1763343037.206897:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3214 00000100:00100000:3.0:1763343037.206907:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3509228850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56899:x1848997993597696:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343037.207280:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3509228850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56899:x1848997993597696:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 373us (702us total) trans 8589940061 rc 0/0 00000100:00100000:3.0:1763343037.207288:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3214 00000100:00100000:1.0:1763343037.217314:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.220827:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.221015:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993597952 00000100:00100000:0.0:1763343037.221029:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993597952 00000100:00100000:1.0:1763343037.221186:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9404 00000100:00100000:1.0:1763343037.221199:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56899:x1848997993597952:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343037.221232:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.221261:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae74f3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9702 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.221428:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.221447:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae74e5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96fb expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.221457:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.221500:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae74e5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96fb expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.221515:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae74e5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96fb expref: 255 pid: 28422 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343037.221532:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406838e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010279040:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343037.222433:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993598208 00000100:00100000:3.0:1763343037.222449:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993598208 00000100:00100000:3.0:1763343037.222508:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9405 00000100:00100000:3.0:1763343037.222518:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56900:x1848997993598208:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:3.0:1763343037.222565:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763343037.222593:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae747c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96df expref: 256 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.222616:0:10041:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae74e5 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96fb expref: 255 pid: 28422 timeout: 1330 lvb_type: 0 00010000:00010000:3.0:1763343037.222653:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405136600/0x607405d401ae7444 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96d1 expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.222666:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:3.0:1763343037.222672:0:10041:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.222680:0:10041:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.222687:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.222708:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343037.222735:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7501 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343037.222744:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7501 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343037.222753:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7501 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343037.222765:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7508 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343037.222772:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7508 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343037.222779:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7508 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343037.222873:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343037.222895:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.222904:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343037.222917:0:10041:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.222926:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:1.0:1763343037.223772:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe900 going to sleep for 11 seconds 00010000:00010000:2.0:1763343037.228751:0:6523:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@00000000ad557972 x1848998010279040) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae74e5 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96fb expref: 254 pid: 28422 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343037.228783:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae74e5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96fb expref: 254 pid: 28422 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343037.228802:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406838e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010279040:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343037.228832:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:2.0:1763343037.228838:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.228849:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.228858:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.228869:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.228876:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343037.228920:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e6:0x0]: returning size 5 00010000:00010000:2.0:1763343037.229120:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae74f3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9702 expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.229146:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9702 expref: 254 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343037.229157:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9702 expref: 254 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343037.229165:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:2.0:1763343037.231745:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56899:x1848997993597952:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 10529us (14426us total) trans 8589940062 rc 0/0 00000100:00100000:2.0:1763343037.231761:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9404 00000100:00100000:1.0:1763343037.235965:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.236107:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.236194:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993598336 00000100:00100000:2.0:1763343037.236207:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993598336 00000100:00100000:2.0:1763343037.236945:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9406 00000100:00100000:2.0:1763343037.236961:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56899:x1848997993598336:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.236998:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.237027:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae751d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9709 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.237161:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7524 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.237185:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.237194:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7524 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.237217:0:6523:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.237229:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7524 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:3.0:1763343037.237416:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993598464 00000100:00100000:3.0:1763343037.237425:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993598464 00010000:00010000:3.0:1763343037.237455:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9702 expref: 256 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:3.0:1763343037.237492:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3105 00000100:00100000:3.0:1763343037.237501:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:2429:x1848997993598464:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343037.237514:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343037.237520:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9702 expref: 256 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:3.0:1763343037.237534:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9702 expref: 256 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:3.0:1763343037.237559:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae74fa lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1e6:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9702 expref: 256 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:3.0:1763343037.237578:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:3.0:1763343037.237583:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343037.237591:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343037.237598:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343037.237606:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7524 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.237617:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7524 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.237647:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7524 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.237670:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343037.237741:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:2429:x1848997993598464:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 240us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.237750:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3105 00010000:00010000:1.0:1763343037.237828:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.237837:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00000004:00080000:1.0:1763343037.238164:0:10041:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1e6:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1763343037.238272:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238281:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238290:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238297:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.238300:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238309:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238320:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:1.0:1763343037.238323:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343037.238326:0:10041:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7524 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.238334:0:10041:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7524 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.238339:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7524 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.238375:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238383:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae750f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238403:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7501 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238409:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7501 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238415:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7501 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238422:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7501 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238426:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.238429:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7501 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238435:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7501 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238442:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e8600) 00010000:00010000:1.0:1763343037.238446:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.238449:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7501 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238455:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7501 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00010000:1.0:1763343037.238471:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000950dde1e reply state 00000000048ca486 transno 8589940063 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7508 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238484:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7508 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.238491:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8500) 00010000:00010000:1.0:1763343037.238494:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343037.238496:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343037.238554:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56900:x1848997993598208:12345-192.168.204.21@tcp:36:rm.0 Request processed in 16036us (17743us total) trans 8589940063 rc 0/0 00000100:00100000:1.0:1763343037.238562:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9405 00010000:00010000:3.0:1763343037.238742:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7524 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.238751:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7524 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:3.0:1763343037.238782:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e6:0x0]: returning size 5 00000004:00200000:3.0:1763343037.238788:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343037.238807:0:6523:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7524 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.238838:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae751d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9709 expref: 256 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.238855:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7524 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9709 expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.238865:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:3.0:1763343037.238867:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343037.238870:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352cc00, rc 0) 00000100:00100000:3.0:1763343037.238923:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56899:x1848997993598336:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1967us (2974us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.238931:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9406 00000100:00100000:1.0:1763343037.244032:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.244122:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993598720 00000100:00100000:3.0:1763343037.244140:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993598720 00000100:00100000:1.0:1763343037.245364:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9407 00000100:00100000:1.0:1763343037.245380:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56899:x1848997993598720:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343037.245416:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.245449:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae752b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9710 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.246658:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7532 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.246682:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7532 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.246695:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7532 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343037.246710:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e6:0x0]: returning size 5 00010000:00010000:1.0:1763343037.246849:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae752b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9710 expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.246870:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7532 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9710 expref: 257 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.246880:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:1.0:1763343037.246893:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343037.246897:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:1.0:1763343037.246999:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56899:x1848997993598720:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1622us (2983us total) trans 8589940064 rc 0/0 00000100:00100000:1.0:1763343037.247010:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9407 00000100:00100000:2.0:1763343037.255304:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.257081:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993598848 00000100:00100000:0.0:1763343037.257102:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993598848 00000100:00100000:0.0:1763343037.257182:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6607 00000100:00100000:0.0:1763343037.257194:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+40:2432:x1848997993598848:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:0.0:1763343037.257256:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc200/0x607405d401ae7540 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.257280:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 40 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.257288:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343037.257291:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343037.257295:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc200/0x607405d401ae7540 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.257341:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 40 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.257358:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 40 pid: 28648 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343037.257376:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010279168:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343037.257492:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35085390c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343037.266825:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010279168:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343037.266868:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc200/0x607405d401ae7540 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343037.268082:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.268126:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.268427:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993598976 00000100:00100000:3.0:1763343037.268440:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993598976 00002000:00100000:3.0:1763343037.268502:0:28424:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x2af:0x0] (0->4) req@ffff9a340683a680 x1848997993598976/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:533/0 lens 496/0 e 0 to 0 dl 1763343048 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343037.268514:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340683a680 with x1848997993598976 ext(0->4) 00010000:00010000:3.0:1763343037.268525:0:28424:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 41 pid: 28648 timeout: 1330 lvb_type: 0 00010000:00010000:3.0:1763343037.268543:0:28424:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 41 pid: 28648 timeout: 1330 lvb_type: 0 00002000:00010000:3.0:1763343037.268552:0:28424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a340683a680 00000100:00100000:3.0:1763343037.268595:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 107 00000100:00100000:3.0:1763343037.268606:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+41:2429:x1848997993598976:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:2.0:1763343037.269361:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993599104 00000100:00100000:2.0:1763343037.269372:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993599104 00000100:00100000:2.0:1763343037.269427:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9408 00000100:00100000:2.0:1763343037.269435:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56901:x1848997993599104:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.269454:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.269483:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7547 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9717 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.269563:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae754e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269580:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae754e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269593:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae754e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269603:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7555 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269612:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7555 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269636:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7555 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269681:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae754e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269688:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae754e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269695:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae754e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269701:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae754e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269707:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.269712:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae754e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269720:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae754e lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269735:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:2.0:1763343037.269739:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.269744:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae754e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269750:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae754e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269767:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7555 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269773:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7555 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269778:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7555 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269783:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.269786:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7555 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269791:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7555 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269798:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8500) 00010000:00010000:2.0:1763343037.269801:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.269803:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7555 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269809:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7555 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.269840:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7547 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9717 expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.269851:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:2.0:1763343037.269854:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.269857:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7547 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9717 expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.269871:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d400, rc 0) 00000100:00100000:2.0:1763343037.269960:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56901:x1848997993599104:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 525us (1832us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343037.269968:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9408 00000100:00100000:2.0:1763343037.276843:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.276925:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993599232 00000100:00100000:1.0:1763343037.276941:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993599232 00000100:00100000:1.0:1763343037.277017:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9409 00000100:00100000:1.0:1763343037.277028:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56901:x1848997993599232:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343037.277056:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.277090:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae755c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac971e expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.277179:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7563 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277195:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7563 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277208:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7563 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277219:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae756a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277226:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae756a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277233:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae756a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277282:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7563 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277289:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7563 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277295:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7563 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277302:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7563 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277307:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.277312:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7563 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277320:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7563 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277334:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421400) 00010000:00010000:1.0:1763343037.277338:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.277343:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7563 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277350:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7563 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277365:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae756a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277371:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae756a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277377:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae756a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277382:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.277384:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae756a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277390:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae756a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277401:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8500) 00010000:00010000:1.0:1763343037.277404:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.277407:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae756a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.277412:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae756a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000100:00100000:0.0:1763343037.277657:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+43:2429:x1848997993598976:12345-192.168.204.21@tcp:4:bash.0 Request processed in 9050us (9580us total) trans 17179871631 rc 0/0 00000100:00100000:0.0:1763343037.277668:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 107 00002000:00100000:0.0:1763343037.277679:0:28424:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x2af:0x0] (0->4) req@ffff9a340683a680 x1848997993598976/t17179871631(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:533/0 lens 496/448 e 0 to 0 dl 1763343048 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343037.277696:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340683a680 with x1848997993598976 ext(0->4) 00010000:00010000:0.0:1763343037.277704:0:28424:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 43 pid: 28648 timeout: 1330 lvb_type: 0 00010000:00010000:0.0:1763343037.277719:0:28424:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 43 pid: 28648 timeout: 1330 lvb_type: 0 00002000:00010000:0.0:1763343037.277726:0:28424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a340683a680 00010000:00010000:1.0:1763343037.278826:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae755c lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac971e expref: 258 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.278849:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421400) 00010000:00010000:1.0:1763343037.278852:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.278858:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae755c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac971e expref: 258 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.278881:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00000100:00100000:1.0:1763343037.279417:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56901:x1848997993599232:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2388us (2584us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343037.279426:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9409 00000100:00100000:0.0:1763343037.285125:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.285206:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.285276:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993599360 00000100:00100000:1.0:1763343037.285289:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993599360 00000100:00100000:1.0:1763343037.285359:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9410 00000100:00100000:1.0:1763343037.285370:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56901:x1848997993599360:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343037.285395:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.285423:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7571 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9725 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.285532:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7578 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.285548:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7578 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.285562:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7578 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343037.285649:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343037.285655:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343037.285704:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7571 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9725 expref: 259 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.285726:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7578 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9725 expref: 258 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.285737:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421600) 00010000:00010000:1.0:1763343037.285741:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343037.285744:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:1.0:1763343037.285826:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56901:x1848997993599360:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 458us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.285834:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9410 00000100:00100000:2.0:1763343037.285945:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993599488 00000100:00100000:2.0:1763343037.285951:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993599488 00010000:00010000:2.0:1763343037.285978:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 43 pid: 28648 timeout: 1330 lvb_type: 0 00000100:00100000:2.0:1763343037.286013:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3106 00000100:00100000:2.0:1763343037.286022:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3508046850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+43:2430:x1848997993599488:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343037.286035:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763343037.286059:0:27834:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763343037.286063:0:27834:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343037.286070:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 43 pid: 28648 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343037.286082:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 43 pid: 28648 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343037.286103:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae74c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96ed expref: 43 pid: 28648 timeout: 1330 lvb_type: 0 00010000:00010000:2.0:1763343037.286116:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.286119:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.286124:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc200/0x607405d401ae7540 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.286134:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc200/0x607405d401ae7540 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.286163:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343037.286188:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3508046850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+42:2430:x1848997993599488:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 167us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.286195:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3106 00010000:00010000:3.0:1763343037.286397:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc200/0x607405d401ae7540 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.286408:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc200/0x607405d401ae7540 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.286431:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc200/0x607405d401ae7540 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.286440:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc200/0x607405d401ae7540 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.286447:0:27835:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc200/0x607405d401ae7540 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.286455:0:27835:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343037.286459:0:27835:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc200/0x607405d401ae7540 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.286468:0:27835:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc200/0x607405d401ae7540 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.286480:0:27835:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc200/0x607405d401ae7540 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.286487:0:27835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34064dc200/0x607405d401ae7540 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343037.286535:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+41:2432:x1848997993598848:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 29343us (31246us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.286543:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6607 00000100:00100000:2.0:1763343037.289091:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.289193:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993599744 00000100:00100000:0.0:1763343037.289205:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993599744 00000100:00100000:0.0:1763343037.289288:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9411 00000100:00100000:0.0:1763343037.289300:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56899:x1848997993599744:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343037.289369:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343037.289420:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7524 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9709 expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.289444:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:0.0:1763343037.289450:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343037.289494:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae757f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.289509:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae757f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.289519:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae757f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:0.0:1763343037.289868:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1449, 88 off122224 00000004:00080000:0.0:1763343037.289877:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1230957255970ns, next at 1231072373054ns, rc = 0 00000040:00080000:0.0:1763343037.289927:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1448, 88 off122224 00000004:00080000:0.0:1763343037.289933:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1230957311870ns, next at 1231072337277ns, rc = 0 00000040:00080000:0.0:1763343037.289959:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1449, 88 off122312 00000004:00080000:0.0:1763343037.289964:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1230957343225ns, next at 1231072337277ns, rc = 0 00000040:00080000:0.0:1763343037.289974:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1450, 88 off122312 00000004:00080000:0.0:1763343037.289979:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1230957357953ns, next at 1231072373054ns, rc = 0 00000001:00080000:3.0:1763343037.292170:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940065 is committed 00000004:00080000:3.0:1763343037.292187:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 953 committed 00010000:00010000:1.0:1763343037.292393:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7508 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.292409:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7508 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.292416:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7508 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.292423:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.292428:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7508 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.292436:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7508 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.292453:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e8500) 00010000:00010000:1.0:1763343037.292456:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.292461:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7508 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.292466:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7508 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00080000:3.0:1763343037.292518:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 954 committed 00000004:00080000:3.0:1763343037.292567:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 953 committed 00000100:00100000:1.0:1763343037.292696:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010279296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343037.292781:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.292828:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343037.292834:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010279424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343037.292854:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343037.292860:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.292900:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010279296 00000100:00100000:1.0:1763343037.292909:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010279296 00000100:00100000:0.0:1763343037.292914:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010279424 00000100:00100000:0.0:1763343037.292918:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010279424 00000100:00100000:0.0:1763343037.292964:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6608 00000100:00100000:0.0:1763343037.292975:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3657:x1848998010279424:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343037.292976:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 952 committed 00000100:00100000:0.0:1763343037.293182:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3657:x1848998010279424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (326us total) trans 21474838928 rc 0/0 00000100:00100000:0.0:1763343037.293190:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6608 00000100:00100000:2.0:1763343037.293331:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010279680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343037.293360:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343037.293380:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343037.293384:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010279552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343037.293398:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343037.293420:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010279680 00000100:00100000:2.0:1763343037.293423:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010279680 00000100:00100000:1.0:1763343037.293823:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010279552 00000100:00100000:1.0:1763343037.293829:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010279552 00000100:00100000:1.0:1763343037.293853:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6609 00000100:00100000:1.0:1763343037.293860:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3657:x1848998010279296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763343037.293975:0:28648:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2ad:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343037.293980:0:28648:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2ad:0x0] updating lvb mtime from disk: 1763343037 -> 1763343037 00002000:00010000:1.0:1763343037.293983:0:28648:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2ad:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343037.293987:0:28648:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2ad:0x0] updating lvb ctime from disk: 1763343037 -> 1763343037 00002000:00010000:1.0:1763343037.293990:0:28648:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2ad:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343037.294030:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3657:x1848998010279296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (1249us total) trans 21474838929 rc 0/0 00000100:00100000:1.0:1763343037.294037:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6609 00000100:00100000:1.0:1763343037.294057:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6610 00000100:00100000:1.0:1763343037.294063:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+78:3660:x1848998010279552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.294168:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+79:3660:x1848998010279552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (767us total) trans 17179871632 rc 0/0 00000100:00100000:1.0:1763343037.294175:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6610 00000004:00080000:1.0:1763343037.294248:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f38700/2, rc 0, transno 17179871632 00000100:00100000:1.0:1763343037.294256:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010279552:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763343037.294305:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406839c00/2, rc 0, transno 21474838928 00000100:00100000:1.0:1763343037.294310:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010279424:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343037.294319:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406838000/2, rc 0, transno 21474838929 00000100:00100000:1.0:1763343037.294323:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010279296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343037.294342:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993599872 00000100:00100000:1.0:1763343037.294346:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993599872 00000100:00100000:1.0:1763343037.294390:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9412 00000100:00100000:1.0:1763343037.294398:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56901:x1848997993599872:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343037.294413:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.294435:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae7586 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac972c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.294509:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae758d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294527:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae758d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294541:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae758d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294557:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7594 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294564:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7594 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294572:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7594 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294613:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae758d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294652:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae758d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294659:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae758d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294667:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae758d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294674:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.294679:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae758d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294687:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae758d lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294704:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421600) 00010000:00010000:1.0:1763343037.294708:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.294712:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae758d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294719:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae758d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294733:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7594 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294739:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7594 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294745:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7594 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294750:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.294753:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7594 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294759:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7594 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294765:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421d00) 00010000:00010000:1.0:1763343037.294768:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.294771:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7594 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294776:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7594 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.294811:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae7586 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac972c expref: 258 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.294823:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421600) 00010000:00010000:1.0:1763343037.294826:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.294830:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae7586 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac972c expref: 258 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.294839:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:1.0:1763343037.294909:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56901:x1848997993599872:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 510us (2049us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343037.294916:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9412 00000004:00010000:0.0:1763343037.295511:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000467aa2fe reply state 000000004f64b882 transno 8589940065 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae757f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.295534:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae757f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.295541:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:0.0:1763343037.295543:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343037.295546:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1763343037.295648:0:6523:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343037.295663:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56899:x1848997993599744:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 6364us (6583us total) trans 8589940065 rc 0/0 00000100:00100000:0.0:1763343037.295674:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9411 00000100:00100000:0.0:1763343037.298906:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.298931:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6611 00000100:00100000:0.0:1763343037.298940:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993600128 00000100:00100000:2.0:1763343037.298949:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+78:3660:x1848998010279680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343037.298951:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993600128 00000100:00100000:0.0:1763343037.298993:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9413 00000100:00100000:0.0:1763343037.299000:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+249:56901:x1848997993600128:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343037.299014:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.299017:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343037.299053:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7578 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9725 expref: 249 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.299075:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421600) 00010000:00010000:0.0:1763343037.299087:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343037.299105:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae759b lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9733 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343037.299201:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+79:3660:x1848998010279680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 260us (5839us total) trans 17179871633 rc 0/0 00000100:00100000:2.0:1763343037.299209:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6611 00010000:00010000:0.0:1763343037.299216:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae75a2 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.299230:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae75a2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.299241:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae75a2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.299253:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae75a9 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.299259:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae75a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00000004:00080000:2.0:1763343037.299267:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f3ad80/2, rc 0, transno 17179871633 00010000:00010000:0.0:1763343037.299269:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae75a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343037.299274:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010279680:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763343037.299748:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75b0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.299758:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75b0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.299766:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75b0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343037.299776:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e7:0x0]: returning size 0 00010000:00010000:0.0:1763343037.299807:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae75a2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.299815:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae75a2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.299822:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae75a2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.299829:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae75a2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.299835:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.299841:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae75a2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.299849:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae75a2 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.299858:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4300) 00010000:00010000:0.0:1763343037.299861:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.299865:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae75a2 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.299871:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae75a2 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:0.0:1763343037.299892:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ab6b9e8b reply state 000000001c0e70b8 transno 8589940066 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae75a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.299905:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae75a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.299911:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4f00) 00010000:00010000:0.0:1763343037.299914:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343037.299916:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343037.299947:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae759b lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9733 expref: 251 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.299965:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75b0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9733 expref: 250 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.299973:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a34037c4900) 00010000:00010000:0.0:1763343037.299975:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343037.299977:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dc200, rc 0) 00000100:00100000:0.0:1763343037.300042:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56901:x1848997993600128:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1042us (1162us total) trans 8589940066 rc 0/0 00000100:00100000:0.0:1763343037.300050:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9413 00000100:00100000:3.0:1763343037.300122:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.301545:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993600256 00000100:00100000:0.0:1763343037.301563:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993600256 00000100:00100000:0.0:1763343037.301663:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9414 00000100:00100000:0.0:1763343037.301675:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56899:x1848997993600256:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343037.301704:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.301729:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae75be lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac973a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.301796:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae75be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac973a expref: 252 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.301811:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae75be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac973a expref: 252 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.301821:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae757f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.301829:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae757f lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.301836:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae757f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.301838:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:0.0:1763343037.301841:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343037.301844:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.301844:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501481200, rc 0) 00010000:00010000:1.0:1763343037.301848:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae757f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.301856:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae757f lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.301866:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:1.0:1763343037.301869:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343037.301872:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae757f lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.301891:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae757f lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:0.0:1763343037.301925:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56899:x1848997993600256:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 252us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.301932:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9414 00000100:00100000:3.0:1763343037.304702:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.304758:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993600512 00000100:00100000:0.0:1763343037.304770:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993600512 00000100:00100000:0.0:1763343037.304843:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9415 00000100:00100000:0.0:1763343037.304854:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56901:x1848997993600512:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343037.304897:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.304931:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae75c5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9741 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.305119:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae75cc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.305139:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75b0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9733 expref: 252 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.305150:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae75cc lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.305194:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75b0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9733 expref: 252 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.305210:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75b0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9733 expref: 252 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343037.305226:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010279808:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343037.305339:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3508539e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763343037.308373:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.308515:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993600640 00000100:00100000:1.0:1763343037.308529:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993600640 00010000:00010000:1.0:1763343037.308586:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75b0 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9733 expref: 253 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:1.0:1763343037.308676:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3107 00000100:00100000:1.0:1763343037.308687:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:2429:x1848997993600640:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343037.308708:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343037.308716:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75b0 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9733 expref: 253 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343037.308729:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75b0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9733 expref: 253 pid: 6523 timeout: 1330 lvb_type: 0 00010000:00010000:1.0:1763343037.308759:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a34037c4900) 00010000:00010000:1.0:1763343037.308765:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae75cc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.308776:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae75cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.308783:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae75cc lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.308806:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343037.308867:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:2429:x1848997993600640:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 181us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.308879:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3107 00010000:00010000:0.0:1763343037.308975:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75b0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9733 expref: 252 pid: 6523 timeout: 1330 lvb_type: 0 00000100:00100000:0.0:1763343037.308993:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010279808:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343037.309021:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae75cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.309031:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae75cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.309037:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae75cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343037.309066:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e7:0x0]: returning size 0 00000004:00080000:0.0:1763343037.309486:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2af:0x0], index 0: 0 00000004:00080000:0.0:1763343037.309494:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2b1:0x0], index 1: 0 00000004:00080000:0.0:1763343037.309500:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2b2:0x0], index 1: 0 00000004:00080000:0.0:1763343037.309505:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2b0:0x0], index 0: 0 00010000:00010000:0.0:1763343037.309681:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae75cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.309692:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae75cc lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.309699:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae75cc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.309705:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.309710:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae75cc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.309718:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae75cc lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.309731:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a34037c4900) 00010000:00010000:0.0:1763343037.309734:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343037.309738:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae75cc lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.309744:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae75cc lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.309805:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae75c5 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9741 expref: 252 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.309815:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a34037c4900) 00010000:00010000:0.0:1763343037.309817:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343037.309821:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae75c5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9741 expref: 252 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.309841:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480600, rc 0) 00000100:00100000:0.0:1763343037.309911:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56901:x1848997993600512:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 5059us (5225us total) trans 8589940067 rc 301/301 00000100:00100000:0.0:1763343037.309919:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9415 00000100:00100000:1.0:1763343037.311588:0:32358:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340683b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32358:1848998010279936:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1763343037.311690:0:32358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.311741:0:32358:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343037.312279:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010279936 00000100:00100000:3.0:1763343037.312291:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010279936 00000100:00100000:3.0:1763343037.312364:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6612 00000100:00100000:3.0:1763343037.312376:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+79:32358:x1848998010279936:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1763343037.312429:0:27835:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 706 00000100:00100000:3.0:1763343037.314331:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+80:32358:x1848998010279936:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1947us (2632us total) trans 17179871634 rc 0/0 00000100:00100000:3.0:1763343037.314345:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6612 00000100:00100000:2.0:1763343037.314792:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.315736:0:32358:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340683b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32358:1848998010279936:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1763343037.315762:0:32358:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2b2:0x0]-[0x2c0000401:0x2e1:0x0] 00000100:00100000:0.0:1763343037.317797:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993600768 00000100:00100000:0.0:1763343037.317815:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993600768 00000100:00100000:0.0:1763343037.317912:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9416 00000100:00100000:0.0:1763343037.317924:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56899:x1848997993600768:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343037.317951:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.317979:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae75da lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9748 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.318074:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae75e1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.318091:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae75e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.318103:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae75e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343037.318159:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e6:0x0]: returning size 5 00000004:00200000:0.0:1763343037.318164:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343037.318190:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae75e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.318220:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae75da lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9748 expref: 253 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.318246:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae75e1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9748 expref: 252 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.318257:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:0.0:1763343037.318260:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763343037.318265:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34064dc400, rc 0) 00000100:00100000:0.0:1763343037.319122:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56899:x1848997993600768:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1196us (4329us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.319132:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9416 00000100:00100000:2.0:1763343037.319842:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.320492:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993601024 00000100:00100000:0.0:1763343037.320505:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993601024 00000100:00100000:0.0:1763343037.320582:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3215 00000100:00100000:0.0:1763343037.320593:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56901:x1848997993601024:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343037.322613:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.323114:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993601152 00000100:00100000:3.0:1763343037.323125:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993601152 00000100:00100000:3.0:1763343037.323191:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6613 00000100:00100000:3.0:1763343037.323201:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+41:2430:x1848997993601152:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343037.323219:0:15756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.323249:0:15756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae75e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac974f expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343037.323252:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56901:x1848997993601024:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 2661us (3412us total) trans 8589940068 rc 0/0 00000100:00100000:0.0:1763343037.323264:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3215 00002000:00010000:3.0:1763343037.323279:0:15756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2af:0x0] initial LVB size: 5, mtime: 0x691a7abd, atime: 0x0, ctime: 0x691a7abd, blocks: 0x8 00010000:00010000:3.0:1763343037.323300:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.323303:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.323317:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae75e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac974f expref: 42 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343037.323335:0:15756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae75e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac974f expref: 42 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343037.323350:0:15756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92a00, rc 0) 00000100:00100000:3.0:1763343037.323373:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+42:2430:x1848997993601152:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 173us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.323379:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6613 00000100:00100000:3.0:1763343037.327458:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.327658:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993601408 00000100:00100000:2.0:1763343037.327682:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993601408 00000100:00100000:2.0:1763343037.327759:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3216 00000100:00100000:2.0:1763343037.327771:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56901:x1848997993601408:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343037.328092:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56901:x1848997993601408:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 322us (648us total) trans 8589940069 rc 0/0 00000100:00100000:2.0:1763343037.328101:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3216 00000100:00100000:1.0:1763343037.341324:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.341417:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993601664 00000100:00100000:0.0:1763343037.341433:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993601664 00000100:00100000:0.0:1763343037.341522:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9417 00000100:00100000:0.0:1763343037.341535:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:55941:x1848997993601664:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343037.341571:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.341606:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae75ef lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9756 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.341848:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75f6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.341868:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75f6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.341897:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75f6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.341912:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae75fd lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.341919:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae75fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.341926:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae75fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342067:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae7604 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342077:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae7604 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342086:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae7604 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:2.0:1763343037.342099:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e7:0x0]: returning size 0 00010000:00010000:2.0:1763343037.342208:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75f6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342216:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75f6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342223:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342229:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75f6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342235:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.342240:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75f6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342248:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75f6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342347:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4900) 00010000:00010000:2.0:1763343037.342352:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.342359:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75f6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342366:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc200/0x607405d401ae75f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342383:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae75fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342390:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae75fd lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342395:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae75fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342401:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dc000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.342404:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae75fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342410:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae75fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342418:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4f00) 00010000:00010000:2.0:1763343037.342420:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.342423:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae75fd lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342429:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc000/0x607405d401ae75fd lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.342477:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc600/0x607405d401ae75ef lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9756 expref: 257 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.342499:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae7604 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9756 expref: 256 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.342505:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:2.0:1763343037.342508:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343037.342511:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c400, rc 0) 00000100:00100000:3.0:1763343037.345862:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.345989:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993601792 00000100:00100000:0.0:1763343037.346003:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993601792 00000100:00100000:0.0:1763343037.346075:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9418 00000100:00100000:0.0:1763343037.346085:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:55941:x1848997993601792:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343037.346115:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.346144:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae7612 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac975d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343037.346182:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:55941:x1848997993601664:12345-192.168.204.21@tcp:101:bash.0 Request processed in 4648us (4873us total) trans 8589940070 rc 0/0 00010000:00010000:0.0:1763343037.346189:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd000/0x607405d401ae7619 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343037.346191:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9417 00010000:00010000:0.0:1763343037.346206:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd000/0x607405d401ae7619 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.346218:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd000/0x607405d401ae7619 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.346371:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae7612 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac975d expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.346395:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd000/0x607405d401ae7619 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac975d expref: 257 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.346406:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:0.0:1763343037.346409:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343037.346414:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340c0cd000, rc 0) 00000100:00100000:0.0:1763343037.346487:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:55941:x1848997993601792:12345-192.168.204.21@tcp:101:bash.0 Request processed in 403us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.346494:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9418 00000100:00100000:3.0:1763343037.354812:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.354876:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993602048 00000100:00100000:0.0:1763343037.354898:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993602048 00000100:00100000:1.0:1763343037.355679:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9419 00000100:00100000:1.0:1763343037.355697:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:55941:x1848997993602048:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:1.0:1763343037.355784:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343037.355822:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae7604 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9756 expref: 257 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.355846:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:1.0:1763343037.355852:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343037.356135:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7620 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.356153:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7620 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.356164:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7620 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000001:00080000:1.0:1763343037.356226:0:10041:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940071 00000004:00010000:1.0:1763343037.356255:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002fce79e1 reply state 0000000047b11c07 transno 8589940072 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7620 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.357530:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7620 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.357540:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:1.0:1763343037.357543:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343037.357548:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343037.357751:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:55941:x1848997993602048:12345-192.168.204.21@tcp:36:bash.0 Request processed in 2056us (2951us total) trans 8589940072 rc 0/0 00000100:00100000:1.0:1763343037.357762:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9419 00000020:00080000:1.0:1763343037.357769:0:10041:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343037.362699:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.363460:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993602176 00000100:00100000:3.0:1763343037.363475:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993602176 00000100:00100000:3.0:1763343037.363560:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9420 00000100:00100000:3.0:1763343037.363572:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:55941:x1848997993602176:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343037.363605:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.363666:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7627 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9764 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.363744:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7627 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9764 expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.363762:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7627 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9764 expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.363785:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:3.0:1763343037.363790:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343037.363794:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:3.0:1763343037.363877:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:55941:x1848997993602176:12345-192.168.204.21@tcp:101:bash.0 Request processed in 307us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.363897:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9420 00000100:00100000:3.0:1763343037.367149:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.367291:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993602432 00000100:00100000:2.0:1763343037.367306:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993602432 00000100:00100000:2.0:1763343037.367395:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9421 00000100:00100000:2.0:1763343037.367410:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:55941:x1848997993602432:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343037.367442:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.367446:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343037.367486:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7627 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9764 expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.367512:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:2.0:1763343037.367520:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343037.367539:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae762e lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac976b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.367608:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7635 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.367701:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7635 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.367715:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7635 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:2.0:1763343037.368053:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1450, 88 off122400 00000004:00080000:2.0:1763343037.368063:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231035441345ns, next at 1231072337277ns, rc = 0 00000040:00080000:2.0:1763343037.368114:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1451, 88 off122400 00000004:00080000:2.0:1763343037.368119:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231035498552ns, next at 1231072373054ns, rc = 0 00000040:00080000:2.0:1763343037.368135:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1452, 88 off122488 00000004:00080000:2.0:1763343037.368140:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231035519775ns, next at 1231072373054ns, rc = 0 00000040:00080000:2.0:1763343037.368162:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1451, 88 off122488 00000004:00080000:2.0:1763343037.368166:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231035544975ns, next at 1231072337277ns, rc = 0 00000001:00080000:0.0:1763343037.370341:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940073 is committed 00000004:00080000:0.0:1763343037.370359:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 956 committed 00000004:00080000:0.0:1763343037.370379:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 955 committed 00000004:00080000:0.0:1763343037.370397:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 954 committed 00000004:00080000:0.0:1763343037.370400:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 955 committed 00010000:00010000:1.0:1763343037.370502:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae75a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.370517:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae75a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.370527:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae75a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.370534:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34064dce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.370540:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae75a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.370549:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae75a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.370573:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4f00) 00010000:00010000:1.0:1763343037.370576:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.370582:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae75a9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.370593:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dce00/0x607405d401ae75a9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.370676:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7620 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.370683:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7620 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.370689:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7620 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.370693:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.370696:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7620 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.370701:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7620 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.370710:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:1.0:1763343037.370712:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.370715:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7620 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343037.370721:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7620 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.375414:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7635 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e7:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac976b expref: 252 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.375436:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:2.0:1763343037.375440:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343037.375465:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae762e lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac976b expref: 252 pid: 6523 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343037.375491:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7635 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac976b expref: 251 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.375533:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:2.0:1763343037.375536:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343037.375539:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352da00, rc 0) 00000100:00100000:2.0:1763343037.375684:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:55941:x1848997993602432:12345-192.168.204.21@tcp:101:bash.0 Request processed in 8275us (8552us total) trans 8589940073 rc 0/0 00000100:00100000:2.0:1763343037.375700:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9421 00000100:00100000:1.0:1763343037.375843:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010280064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343037.375935:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.375985:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343037.375992:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010280192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343037.376017:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.376059:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010280064 00000100:00100000:1.0:1763343037.376070:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010280064 00000100:00100000:1.0:1763343037.376115:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010280192 00000100:00100000:1.0:1763343037.376118:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010280192 00000100:00100000:1.0:1763343037.376137:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6614 00000100:00100000:1.0:1763343037.376146:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3657:x1848998010280064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343037.376357:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3657:x1848998010280064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 210us (421us total) trans 21474838930 rc 0/0 00000100:00100000:1.0:1763343037.376364:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6614 00000100:00100000:1.0:1763343037.376382:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6615 00000100:00100000:1.0:1763343037.376387:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3657:x1848998010280192:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343037.376400:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7c380/2, rc 0, transno 21474838930 00000100:00100000:3.0:1763343037.376408:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010280064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343037.376487:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3657:x1848998010280192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (468us total) trans 21474838931 rc 0/0 00000100:00100000:1.0:1763343037.376494:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6615 00000004:00080000:3.0:1763343037.376512:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7ce00/2, rc 0, transno 21474838931 00000100:00100000:3.0:1763343037.376517:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010280192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343037.376523:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010280320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.376555:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.376587:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343037.376593:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010280448:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343037.376599:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010280320 00000100:00100000:3.0:1763343037.376604:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010280320 00000100:00100000:1.0:1763343037.376616:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343037.376651:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010280448 00000100:00100000:3.0:1763343037.376655:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010280448 00000100:00100000:1.0:1763343037.376663:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6616 00000100:00100000:1.0:1763343037.376669:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+81:3659:x1848998010280320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343037.376676:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6617 00000100:00100000:3.0:1763343037.376681:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+81:3659:x1848998010280448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343037.376774:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+83:3659:x1848998010280448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (157us total) trans 17179871635 rc 0/0 00000100:00100000:3.0:1763343037.376781:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6617 00000004:00080000:2.0:1763343037.377324:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c39880/2, rc 0, transno 17179871635 00000100:00100000:2.0:1763343037.377332:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010280448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.377833:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+82:3659:x1848998010280320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1161us (1276us total) trans 17179871636 rc 0/0 00000100:00100000:1.0:1763343037.377841:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6616 00000004:00080000:2.0:1763343037.377906:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c39c00/2, rc 0, transno 17179871636 00000100:00100000:2.0:1763343037.377911:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010280320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343037.379752:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.380172:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993602560 00000100:00100000:1.0:1763343037.380187:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993602560 00000100:00100000:1.0:1763343037.380423:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6618 00000100:00100000:1.0:1763343037.380438:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:55941:x1848997993602560:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343037.380465:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.380495:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae763c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9772 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343037.380527:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343037.380555:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.380558:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.380571:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae763c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9772 expref: 15 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.380592:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae763c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9772 expref: 15 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.380607:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343037.385770:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:55941:x1848997993602560:12345-192.168.204.21@tcp:101:bash.0 Request processed in 5314us (6010us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.385788:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6618 00000100:00100000:0.0:1763343037.386978:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.387514:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993602688 00000100:00100000:2.0:1763343037.387529:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993602688 00000100:00100000:1.0:1763343037.387673:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6619 00000100:00100000:1.0:1763343037.387686:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+42:55941:x1848997993602688:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343037.387710:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.387739:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae7643 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9779 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343037.387769:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343037.387797:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.387801:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.387813:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae7643 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9779 expref: 43 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.387832:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae7643 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9779 expref: 43 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.387846:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00000100:00100000:1.0:1763343037.387933:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+43:55941:x1848997993602688:12345-192.168.204.21@tcp:101:bash.0 Request processed in 249us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.387940:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6619 00000100:00100000:0.0:1763343037.388365:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.388728:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993602816 00000100:00100000:2.0:1763343037.388737:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993602816 00000100:00100000:2.0:1763343037.388781:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6620 00000100:00100000:2.0:1763343037.388790:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+43:2430:x1848997993602816:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:2.0:1763343037.388900:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+43:2430:x1848997993602816:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 110us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.388908:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6620 00000100:00100000:3.0:1763343037.393361:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.393464:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.393795:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.393878:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993602944 00000100:00100000:0.0:1763343037.393903:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993602944 00002000:00010000:0.0:1763343037.393963:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/687 (0->18446744073709551615) 00002000:00100000:0.0:1763343037.393969:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c3b480 with x1848997993602944 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343037.393985:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537c3b480. 00000100:00100000:0.0:1763343037.394023:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993603072 00000100:00100000:0.0:1763343037.394028:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993603072 00002000:00010000:0.0:1763343037.394045:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/689 (0->18446744073709551615) 00002000:00100000:0.0:1763343037.394048:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c39f80 with x1848997993603072 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343037.394056:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537c39f80. 00000100:00100000:0.0:1763343037.394078:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1610 00000100:00100000:0.0:1763343037.394089:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2431:x1848997993602944:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:2.0:1763343037.394466:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993603200 00000100:00100000:2.0:1763343037.394471:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993603200 00000100:00100000:2.0:1763343037.394506:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6621 00000100:00100000:2.0:1763343037.394515:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2430:x1848997993603200:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:2.0:1763343037.394662:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2430:x1848997993603200:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 146us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.394671:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6621 00000100:00100000:2.0:1763343037.394730:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1611 00000100:00100000:2.0:1763343037.394738:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+43:2431:x1848997993603072:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343037.394868:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343037.394874:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b1:0x0] updating lvb mtime from disk: 0 -> 1763343037 00002000:00010000:2.0:1763343037.394876:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2b1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343037.394879:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b1:0x0] updating lvb ctime from disk: 0 -> 1763343037 00002000:00010000:2.0:1763343037.394893:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343037.394917:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2431:x1848997993603072:12345-192.168.204.21@tcp:10:bash.0 Request processed in 180us (1452us total) trans 17179871637 rc 0/0 00000100:00100000:2.0:1763343037.394926:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1611 00002000:00010000:2.0:1763343037.394929:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/689 (0->18446744073709551615) 00002000:00100000:2.0:1763343037.394933:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c39f80 with x1848997993603072 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343037.394939:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537c39f80. 00002000:00010000:0.0:1763343037.395996:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2af:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343037.396005:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2af:0x0] updating lvb mtime from disk: 0 -> 1763343037 00002000:00010000:0.0:1763343037.396008:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2af:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343037.396011:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2af:0x0] updating lvb ctime from disk: 0 -> 1763343037 00002000:00010000:0.0:1763343037.396014:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2af:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343037.396081:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2431:x1848997993602944:12345-192.168.204.21@tcp:10:bash.0 Request processed in 1989us (2731us total) trans 21474838932 rc 0/0 00000100:00100000:0.0:1763343037.396091:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1610 00002000:00010000:0.0:1763343037.396096:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/687 (0->18446744073709551615) 00002000:00100000:0.0:1763343037.396099:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c3b480 with x1848997993602944 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343037.396106:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537c3b480. 00000100:00100000:3.0:1763343037.402264:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.402378:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.402900:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993603328 00000100:00100000:0.0:1763343037.402915:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993603328 00000100:00100000:0.0:1763343037.403018:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1612 00000100:00100000:0.0:1763343037.403031:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2429:x1848997993603328:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:0.0:1763343037.403086:0:28424:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a340c0cdc00/0x607405d401ae764a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.403107:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.403110:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.403119:0:28424:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340c0cdc00/0x607405d401ae764a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.403137:0:28424:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340c0cdc00/0x607405d401ae764a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.403278:0:28424:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a340c0cdc00/0x607405d401ae764a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.403289:0:28424:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340c0cdc00/0x607405d401ae764a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.403298:0:28424:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340c0cdc00/0x607405d401ae764a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.403307:0:28424:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340c0cdc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343037.403312:0:28424:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340c0cdc00/0x607405d401ae764a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.403321:0:28424:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340c0cdc00/0x607405d401ae764a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.403342:0:28424:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340c0cdc00/0x607405d401ae764a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.403350:0:28424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340c0cdc00/0x607405d401ae764a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343037.403431:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2429:x1848997993603328:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 402us (1183us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763343037.403440:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1612 00000100:00100000:1.0:1763343037.404346:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993603584 00000100:00100000:1.0:1763343037.404357:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993603584 00000100:00100000:1.0:1763343037.405276:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3217 00000100:00100000:1.0:1763343037.405288:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:55941:x1848997993603584:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:1.0:1763343037.405722:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:55941:x1848997993603584:12345-192.168.204.21@tcp:35:bash.0 Request processed in 434us (3342us total) trans 8589940074 rc 0/0 00000100:00100000:1.0:1763343037.405732:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3217 00000100:00100000:0.0:1763343037.417356:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.417459:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993603712 00000100:00100000:2.0:1763343037.417473:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993603712 00000100:00100000:2.0:1763343037.417537:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9422 00000100:00100000:2.0:1763343037.417548:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56899:x1848997993603712:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.417580:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.417609:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7651 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9780 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.417688:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae7658 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.417708:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae7658 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.417722:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae7658 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.417877:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7651 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9780 expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.417933:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c400/0x607405d401ae7658 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9780 expref: 253 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.417943:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:2.0:1763343037.417947:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343037.417952:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c400, rc 0) 00000100:00100000:2.0:1763343037.418033:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56899:x1848997993603712:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 486us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.418041:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9422 00000100:00100000:3.0:1763343037.419419:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.419505:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993603840 00000100:00100000:0.0:1763343037.419515:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993603840 00000100:00100000:0.0:1763343037.419576:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9423 00000100:00100000:0.0:1763343037.419586:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56902:x1848997993603840:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:0.0:1763343037.419607:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.419672:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd600/0x607405d401ae765f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9787 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.419779:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cc800/0x607405d401ae7666 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.419795:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cc800/0x607405d401ae7666 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.419807:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cc800/0x607405d401ae7666 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.419824:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae766d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.419831:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae766d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.419838:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae766d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.419951:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3542167a00/0x607405d401ae7674 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.419960:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3542167a00/0x607405d401ae7674 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.419967:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3542167a00/0x607405d401ae7674 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343037.420015:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e7:0x0]: returning size 5 00000004:00200000:0.0:1763343037.420020:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343037.420044:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3542167a00/0x607405d401ae7674 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420057:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3542167a00/0x607405d401ae7674 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420068:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cc800/0x607405d401ae7666 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420074:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cc800/0x607405d401ae7666 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420079:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cc800/0x607405d401ae7666 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420087:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cc800/0x607405d401ae7666 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420093:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340c0cc800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.420097:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cc800/0x607405d401ae7666 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420105:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cc800/0x607405d401ae7666 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420116:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:0.0:1763343037.420119:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.420124:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cc800/0x607405d401ae7666 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420131:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cc800/0x607405d401ae7666 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420145:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae766d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420151:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae766d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420157:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae766d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420162:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a353e6f7200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.420165:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae766d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420170:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae766d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420178:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c2d00) 00010000:00010000:0.0:1763343037.420180:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.420183:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae766d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420189:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae766d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.420224:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd600/0x607405d401ae765f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9787 expref: 255 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.420240:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3542167a00/0x607405d401ae7674 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9787 expref: 254 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.420247:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:0.0:1763343037.420250:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343037.420253:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3542167a00, rc 0) 00000100:00100000:0.0:1763343037.420323:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56902:x1848997993603840:12345-192.168.204.21@tcp:101:rm.0 Request processed in 737us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.420331:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9423 00000100:00100000:0.0:1763343037.425112:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.425205:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993604224 00000100:00100000:2.0:1763343037.425220:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993604224 00000100:00100000:2.0:1763343037.425297:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9424 00000100:00100000:2.0:1763343037.425309:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56902:x1848997993604224:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:2.0:1763343037.425384:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343037.425420:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7635 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac976b expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.425447:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3542167a00/0x607405d401ae7674 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9787 expref: 253 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.425462:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd000/0x607405d401ae7619 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac975d expref: 252 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.425474:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:2.0:1763343037.425489:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343037.425521:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae767b lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.425537:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae767b lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.425547:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae767b lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.425559:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7682 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.425564:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7682 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.425570:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7682 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.425724:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7689 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.425732:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7689 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.425739:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7689 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:2.0:1763343037.426046:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1452, 64 off122552 00000004:00080000:2.0:1763343037.426056:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231093434477ns, next at 1232093431049ns, rc = 0 00000040:00080000:2.0:1763343037.426078:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1453, 64 off122552 00000004:00080000:2.0:1763343037.426083:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231093462377ns, next at 1232093460684ns, rc = 0 00000040:00080000:2.0:1763343037.426094:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1454, 64 off122616 00000040:00080000:2.0:1763343037.426103:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1453, 64 off122616 00010000:00010000:2.0:1763343037.426165:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7690 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426179:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7690 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426187:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7690 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426193:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7690 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426200:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7690 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426205:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7690 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426237:0:6523:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343037.426260:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7689 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426264:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7689 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426270:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7689 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426276:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.426281:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7689 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426287:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7689 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426294:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343037.426297:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343037.426301:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7689 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426307:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7689 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426453:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae767b lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426460:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae767b lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426464:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae767b lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426470:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae767b lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426475:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.426477:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae767b lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426483:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae767b lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426492:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a35167a9400) 00010000:00010000:2.0:1763343037.426494:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.426498:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae767b lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426502:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae767b lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:2.0:1763343037.426515:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000093214507 reply state 000000002f878d26 transno 8589940075 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7682 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426531:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7682 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.426536:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a35167a9100) 00010000:00010000:2.0:1763343037.426538:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343037.426541:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343037.426688:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56902:x1848997993604224:12345-192.168.204.21@tcp:36:rm.0 Request processed in 1378us (1589us total) trans 8589940075 rc 0/0 00000100:00100000:2.0:1763343037.426697:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9424 00010000:00010000:3.0:1763343037.426818:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343037.426827:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7690 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.426833:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343037.426836:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7690 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.426844:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7690 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.426853:0:13198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e7:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:3.0:1763343037.426855:0:13198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343037.426858:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7690 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.426863:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7690 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1e7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.426877:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343037.426891:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343037.426893:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343037.428832:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.428931:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993603968 00000100:00100000:0.0:1763343037.428945:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993603968 00000100:00100000:0.0:1763343037.429036:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1613 00000100:00100000:0.0:1763343037.429049:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993603968:12345-192.168.204.21@tcp:4:lfs.0 00002000:00010000:0.0:1763343037.429113:0:28425:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343037.429124:0:28425:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340471ee00/0x607405d401ae7697 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.429141:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.429144:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.429150:0:28425:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340471ee00/0x607405d401ae7697 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.429165:0:28425:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340471ee00/0x607405d401ae7697 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1763343037.439546:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838933 is committed 00000001:00080000:3.0:1763343037.439573:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838931 is committed 00002000:00010000:0.0:1763343037.439922:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2ae:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763343037.439929:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2ae:0x0] updating lvb mtime from disk: 0 -> 1763343037 00002000:00010000:0.0:1763343037.439932:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2ae:0x0] updating lvb ctime from disk: 0 -> 1763343037 00002000:00010000:0.0:1763343037.439934:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2ae:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763343037.439954:0:28425:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340471ee00/0x607405d401ae7697 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.439972:0:28425:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340471ee00/0x607405d401ae7697 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.439981:0:28425:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340471ee00/0x607405d401ae7697 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.439989:0:28425:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340471ee00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343037.439993:0:28425:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340471ee00/0x607405d401ae7697 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.440003:0:28425:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340471ee00/0x607405d401ae7697 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.440026:0:28425:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340471ee00/0x607405d401ae7697 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.440033:0:28425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340471ee00/0x607405d401ae7697 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343037.440154:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2430:x1848997993603968:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 11101us (11328us total) trans 21474838933 rc 0/0 00000100:00100000:0.0:1763343037.440165:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1613 00000100:00100000:1.0:1763343037.446495:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.447661:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993604352 00000100:00100000:0.0:1763343037.447678:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993604352 00000100:00100000:0.0:1763343037.448360:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9425 00000100:00100000:0.0:1763343037.448376:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56903:x1848997993604352:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343037.448408:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.448443:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae769e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac978e expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.448541:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76a5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448558:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76a5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448572:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76a5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448587:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae76ac lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448595:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae76ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448602:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae76ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448685:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76a5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448694:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76a5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448701:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76a5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448709:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76a5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448715:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340471e400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.448720:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76a5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448729:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76a5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448744:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2c00) 00010000:00010000:0.0:1763343037.448748:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.448755:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76a5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448762:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76a5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448779:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae76ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448785:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae76ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448791:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae76ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448796:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a353e6f7200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.448799:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae76ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448805:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae76ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448813:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a35167a9100) 00010000:00010000:0.0:1763343037.448816:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.448819:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae76ac lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448825:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae76ac lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.448858:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae769e lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac978e expref: 254 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.448869:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2c00) 00010000:00010000:0.0:1763343037.448872:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.448875:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae769e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac978e expref: 254 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.448902:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340471ee00, rc 0) 00000100:00100000:0.0:1763343037.449000:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56903:x1848997993604352:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 628us (2519us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343037.449009:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9425 00000100:00100000:3.0:1763343037.455519:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.455966:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993604480 00000100:00100000:0.0:1763343037.456030:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993604480 00000100:00100000:0.0:1763343037.456207:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9426 00000100:00100000:0.0:1763343037.456221:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56903:x1848997993604480:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343037.456252:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.456410:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae76b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9795 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.456505:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae76ba lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456522:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae76ba lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456534:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae76ba lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456550:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456558:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456564:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456645:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae76ba lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456654:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae76ba lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456661:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae76ba lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456667:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae76ba lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456674:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340471ee00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.456678:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae76ba lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456686:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae76ba lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456700:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2c00) 00010000:00010000:0.0:1763343037.456704:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.456709:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae76ba lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456716:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae76ba lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456732:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456738:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76c1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456744:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456749:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340471e400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.456752:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456758:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76c1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456764:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a35167a9100) 00010000:00010000:0.0:1763343037.456767:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.456770:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76c1 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456775:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae76c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.456807:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae76b3 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9795 expref: 254 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.456818:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2c00) 00010000:00010000:0.0:1763343037.456820:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.456824:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae76b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9795 expref: 254 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.456843:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a353e6f7200, rc 0) 00000100:00100000:0.0:1763343037.456937:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56903:x1848997993604480:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 719us (1691us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343037.456945:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9426 00000100:00100000:3.0:1763343037.461384:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.461451:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993604608 00000100:00100000:0.0:1763343037.461465:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993604608 00000100:00100000:0.0:1763343037.461549:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9427 00000100:00100000:0.0:1763343037.461561:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56903:x1848997993604608:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343037.461589:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.461673:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae76c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac979c expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.461760:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae76cf lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.461779:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae76cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.461793:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae76cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343037.461849:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343037.461855:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343037.461910:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae76c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac979c expref: 255 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.461930:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae76cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac979c expref: 254 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.461945:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:0.0:1763343037.461948:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343037.461952:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403529600, rc 0) 00000100:00100000:0.0:1763343037.462031:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56903:x1848997993604608:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 473us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.462040:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9427 00000100:00100000:1.0:1763343037.469422:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.469863:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993604736 00000100:00100000:2.0:1763343037.469877:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993604736 00000100:00100000:2.0:1763343037.469967:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9428 00000100:00100000:2.0:1763343037.469978:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56903:x1848997993604736:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.470005:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.470033:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae76d6 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac97a3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.470119:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae76dd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470137:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae76dd lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470150:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae76dd lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470161:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae76e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470168:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae76e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470175:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae76e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470229:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae76dd lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470236:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae76dd lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470243:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae76dd lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470250:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae76dd lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470255:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.470260:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae76dd lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470443:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae76dd lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470462:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:2.0:1763343037.470466:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.470473:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae76dd lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470480:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae76dd lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470497:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae76e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470502:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae76e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470508:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae76e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470513:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.470515:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae76e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470520:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae76e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470527:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a35167a9100) 00010000:00010000:2.0:1763343037.470530:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.470532:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae76e4 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470538:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae76e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.470570:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae76d6 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97a3 expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.470580:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:2.0:1763343037.470583:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.470587:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae76d6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97a3 expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.470597:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:2.0:1763343037.470735:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56903:x1848997993604736:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 757us (1328us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343037.470744:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9428 00000100:00100000:3.0:1763343037.471188:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.471249:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993604992 00000100:00100000:2.0:1763343037.471261:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993604992 00000100:00100000:2.0:1763343037.471309:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9429 00000100:00100000:2.0:1763343037.471317:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56899:x1848997993604992:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:2.0:1763343037.471360:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343037.471471:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34064dc400/0x607405d401ae75e1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9748 expref: 254 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.471486:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:2.0:1763343037.471491:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343037.471568:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae76eb lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.471580:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae76eb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.471589:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae76eb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00010000:2.0:1763343037.471774:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000457f1847 reply state 000000008a3fd9c0 transno 8589940076 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae76eb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.471789:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae76eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.471795:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:2.0:1763343037.471798:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343037.471801:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343037.471893:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56899:x1848997993604992:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 565us (695us total) trans 8589940076 rc 0/0 00000100:00100000:2.0:1763343037.471900:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9429 00000100:00100000:0.0:1763343037.474402:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.474461:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.474584:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993605120 00000100:00100000:2.0:1763343037.474597:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993605120 00000100:00100000:2.0:1763343037.474680:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6622 00000100:00100000:2.0:1763343037.474692:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:56899:x1848997993605120:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.474717:0:15756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.474745:0:15756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352cc00/0x607405d401ae76f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac97aa expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343037.474775:0:15756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ae:0x0] initial LVB size: 4096, mtime: 0x691a7abd, atime: 0x0, ctime: 0x691a7abd, blocks: 0x8 00010000:00010000:2.0:1763343037.474805:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.474808:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.474818:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352cc00/0x607405d401ae76f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97aa expref: 12 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343037.474823:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993605376 00000100:00100000:3.0:1763343037.474828:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993605376 00010000:00010000:2.0:1763343037.474836:0:15756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352cc00/0x607405d401ae76f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97aa expref: 12 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.474850:0:15756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352cc00, rc 0) 00000100:00100000:3.0:1763343037.474871:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9430 00000100:00100000:3.0:1763343037.474887:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56903:x1848997993605376:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343037.474902:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.474905:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:2.0:1763343037.474926:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:56899:x1848997993605120:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 236us (540us total) trans 0 rc 0/0 00010000:00010000:3.0:1763343037.474932:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae76cf lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac979c expref: 255 pid: 10041 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343037.474934:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6622 00010000:00010000:3.0:1763343037.474960:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2f00) 00010000:00010000:3.0:1763343037.474982:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343037.474994:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae76f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac97b1 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.475124:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7700 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475137:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7700 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475147:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7700 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475159:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7707 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475166:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7707 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475171:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7707 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475816:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae770e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475829:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae770e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475837:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae770e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:3.0:1763343037.475848:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e9:0x0]: returning size 0 00010000:00010000:3.0:1763343037.475892:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7700 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475899:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7700 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475905:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7700 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475913:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7700 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475919:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343037.475923:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7700 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475931:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7700 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475940:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53a800) 00010000:00010000:3.0:1763343037.475944:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343037.475948:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7700 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475954:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7700 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:3.0:1763343037.475965:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ad32bf43 reply state 00000000e0ed8fa9 transno 8589940077 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7707 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475978:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7707 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.475984:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a35167a9100) 00010000:00010000:3.0:1763343037.475985:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343037.475989:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343037.476022:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae76f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b1 expref: 257 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.476041:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae770e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b1 expref: 256 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.476049:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a350b53a000) 00010000:00010000:3.0:1763343037.476051:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343037.476054:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343037.476119:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56903:x1848997993605376:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1239us (1656us total) trans 8589940077 rc 0/0 00000100:00100000:3.0:1763343037.476126:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9430 00000100:00100000:2.0:1763343037.478964:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.479064:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993605504 00000100:00100000:0.0:1763343037.479934:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.479941:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993605504 00000100:00100000:3.0:1763343037.480028:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6623 00000100:00100000:3.0:1763343037.480040:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:56899:x1848997993605504:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343037.480064:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.480092:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae771c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac97b8 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343037.480122:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343037.480149:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.480152:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.480161:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae771c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b8 expref: 45 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.480180:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae771c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b8 expref: 45 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.480202:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:3.0:1763343037.480284:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+45:56899:x1848997993605504:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 245us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.480291:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6623 00000100:00100000:2.0:1763343037.480361:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993605760 00000100:00100000:2.0:1763343037.480367:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993605760 00000100:00100000:2.0:1763343037.480426:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9431 00000100:00100000:2.0:1763343037.480435:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56903:x1848997993605760:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.480451:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.480467:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7723 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac97bf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.480665:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae772a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.480681:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae770e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b1 expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.480690:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae772a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.480731:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae770e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b1 expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.480746:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae770e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b1 expref: 258 pid: 6523 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343037.480763:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406ab1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010280576:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343037.480834:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726240 going to sleep for 11 seconds 00000100:00100000:2.0:1763343037.484211:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.484255:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.485753:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993605888 00000100:00100000:0.0:1763343037.485772:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993605888 00002000:00010000:0.0:1763343037.485834:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/686 (5->18446744073709551615) 00002000:00100000:0.0:1763343037.485840:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406ab0000 with x1848997993605888 ext(5->18446744073709551615) 00002000:00010000:0.0:1763343037.485857:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406ab0000. 00000100:00100000:0.0:1763343037.485930:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1614 00000100:00100000:0.0:1763343037.485946:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993605888:12345-192.168.204.21@tcp:10:lfs.0 00000100:00100000:3.0:1763343037.486685:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406ab1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010280576:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343037.486729:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae772a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:1.0:1763343037.486920:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993606144 00000100:00100000:1.0:1763343037.486930:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993606144 00010000:00010000:1.0:1763343037.486968:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae770e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b1 expref: 259 pid: 6523 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343037.487012:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3108 00000100:00100000:1.0:1763343037.487020:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:2429:x1848997993606144:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343037.487035:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343037.487042:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae770e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b1 expref: 259 pid: 6523 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343037.487055:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae770e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b1 expref: 259 pid: 6523 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343037.487082:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae770e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b1 expref: 259 pid: 6523 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343037.487101:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a350b53a000) 00010000:00010000:1.0:1763343037.487107:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae772a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.487116:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae772a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.487124:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae772a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.487151:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343037.487426:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:2429:x1848997993606144:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 217us (2981us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.487435:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3108 00010000:00010000:1.0:1763343037.487920:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae772a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.487928:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae772a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343037.487958:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e9:0x0]: returning size 0 00000100:00100000:1.0:1763343037.488168:0:32356:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:32356:1848998010280704:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1763343037.488244:0:32356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.488285:0:32356:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343037.488308:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010280704 00000100:00100000:1.0:1763343037.488314:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010280704 00000100:00100000:1.0:1763343037.488355:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6624 00002000:00010000:0.0:1763343037.489560:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2ae:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763343037.489568:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2ae:0x0] updating lvb mtime from disk: 1763343037 -> 1763343037 00002000:00010000:0.0:1763343037.489572:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2ae:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343037.489574:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2ae:0x0] updating lvb ctime from disk: 1763343037 -> 1763343037 00002000:00010000:0.0:1763343037.489577:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2ae:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343037.489682:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993605888:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 3732us (5479us total) trans 21474838934 rc 0/0 00000100:00100000:0.0:1763343037.489693:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1614 00002000:00010000:0.0:1763343037.489700:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/686 (5->18446744073709551615) 00002000:00100000:0.0:1763343037.489705:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406ab0000 with x1848997993605888 ext(5->18446744073709551615) 00002000:00010000:0.0:1763343037.489713:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406ab0000. 00000004:00080000:0.0:1763343037.490144:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2b3:0x0], index 1: 0 00000004:00080000:0.0:1763343037.490154:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2b1:0x0], index 0: 0 00000004:00080000:0.0:1763343037.490160:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2b2:0x0], index 0: 0 00000004:00080000:0.0:1763343037.490165:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2b4:0x0], index 1: 0 00010000:00010000:0.0:1763343037.490318:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae772a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.490329:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae772a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.490336:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae772a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.490342:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.490347:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae772a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.490356:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae772a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.490374:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a350b53a000) 00010000:00010000:0.0:1763343037.490377:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343037.490383:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae772a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.490389:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae772a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.490452:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7723 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97bf expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.490467:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a350b53a000) 00010000:00010000:0.0:1763343037.490470:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343037.490473:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7723 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97bf expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.490487:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:0.0:1763343037.490527:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56903:x1848997993605760:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 10094us (10599us total) trans 8589940078 rc 301/301 00000100:00100000:0.0:1763343037.490534:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9431 00000100:00100000:3.0:1763343037.492255:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.492463:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:32356:x1848998010280704:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1763343037.492530:0:15756:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 706 00000100:00100000:1.0:1763343037.494344:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:32356:x1848998010280704:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5973us (6092us total) trans 21474838935 rc 0/0 00000100:00100000:1.0:1763343037.494358:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6624 00000100:00100000:3.0:1763343037.495279:0:32356:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838931 gen 2 00000004:00080000:3.0:1763343037.495289:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7e300, transno 21474838909 00000004:00080000:3.0:1763343037.495307:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7f100, transno 21474838910 00000004:00080000:3.0:1763343037.495310:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7d500, transno 21474838911 00000100:00100000:0.0:1763343037.495311:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993606016 00000004:00080000:3.0:1763343037.495314:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062caa00, transno 21474838912 00000004:00080000:3.0:1763343037.495317:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537910380, transno 21474838913 00000004:00080000:3.0:1763343037.495320:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537913100, transno 21474838914 00000100:00100000:0.0:1763343037.495321:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993606016 00000004:00080000:3.0:1763343037.495322:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537913480, transno 21474838915 00000004:00080000:3.0:1763343037.495325:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537911f80, transno 21474838916 00000004:00080000:3.0:1763343037.495328:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad4e00, transno 21474838918 00000004:00080000:3.0:1763343037.495331:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406550380, transno 21474838919 00000004:00080000:3.0:1763343037.495333:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad6680, transno 21474838920 00000004:00080000:3.0:1763343037.495336:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad5880, transno 21474838921 00000004:00080000:3.0:1763343037.495338:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3404ba4380, transno 21474838923 00000004:00080000:3.0:1763343037.495341:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3404ba6d80, transno 21474838924 00000004:00080000:3.0:1763343037.495344:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3404ba5880, transno 21474838925 00000004:00080000:3.0:1763343037.495347:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3404ba4e00, transno 21474838926 00000004:00080000:3.0:1763343037.495351:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406839c00, transno 21474838928 00000004:00080000:3.0:1763343037.495354:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406838000, transno 21474838929 00000004:00080000:3.0:1763343037.495356:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7c380, transno 21474838930 00000004:00080000:3.0:1763343037.495358:0:32356:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7ce00, transno 21474838931 00000100:00100000:3.0:1763343037.495366:0:32356:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a340ccc0380 x1848998010280704/t21474838935(21474838935) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1763343053 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00010000:0.0:1763343037.495367:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/688 (0->18446744073709551615) 00002000:00100000:0.0:1763343037.495371:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c39500 with x1848997993606016 ext(0->18446744073709551615) 00000100:00100000:3.0:1763343037.495382:0:32356:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:32356:1848998010280704:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1763343037.495399:0:32356:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2b2:0x0]-[0x280000401:0x2e1:0x0] 00002000:00010000:0.0:1763343037.495599:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537c39500. 00000100:00100000:0.0:1763343037.495659:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1615 00000100:00100000:0.0:1763343037.495670:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+45:2430:x1848997993606016:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:0.0:1763343037.495890:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343037.495894:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b0:0x0] updating lvb mtime from disk: 0 -> 1763343037 00002000:00010000:0.0:1763343037.495896:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2b0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343037.495899:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b0:0x0] updating lvb ctime from disk: 0 -> 1763343037 00002000:00010000:0.0:1763343037.495901:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343037.495976:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+46:2430:x1848997993606016:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 307us (3735us total) trans 17179871638 rc 0/0 00000100:00100000:0.0:1763343037.495983:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1615 00002000:00010000:0.0:1763343037.495989:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/688 (0->18446744073709551615) 00002000:00100000:0.0:1763343037.495994:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c39500 with x1848997993606016 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343037.495999:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537c39500. 00000004:00080000:1.0:1763343037.496245:0:32355:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 0 in progress, 0 in flight, 20 done 00000100:00100000:3.0:1763343037.498311:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.498661:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993606400 00000100:00100000:2.0:1763343037.498674:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993606400 00000100:00100000:2.0:1763343037.498747:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3218 00000100:00100000:2.0:1763343037.498759:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56903:x1848997993606400:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343037.499026:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.499176:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993606656 00000100:00100000:0.0:1763343037.499182:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993606656 00000100:00100000:0.0:1763343037.499224:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9432 00000100:00100000:0.0:1763343037.499232:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56899:x1848997993606656:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343037.499329:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae7738 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.499352:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae7738 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.499366:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae7738 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00010000:0.0:1763343037.499491:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005adc0971 reply state 0000000062d04dd6 transno 8589940079 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae7738 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.499506:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae7738 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.499515:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:0.0:1763343037.499519:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343037.499523:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343037.499673:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56899:x1848997993606656:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 440us (645us total) trans 8589940079 rc 0/0 00000100:00100000:0.0:1763343037.499682:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9432 00000100:00100000:2.0:1763343037.499702:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56903:x1848997993606400:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 946us (1403us total) trans 8589940080 rc 0/0 00000100:00100000:2.0:1763343037.499711:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3218 00000100:00100000:3.0:1763343037.501460:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.501615:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.501734:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993606784 00000100:00100000:1.0:1763343037.501746:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993606784 00000100:00100000:1.0:1763343037.501807:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6625 00000100:00100000:1.0:1763343037.501817:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+46:56899:x1848997993606784:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343037.501839:0:15756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.501862:0:15756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae773f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac97c6 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.501906:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae75e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac974f expref: 47 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343037.501914:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.501916:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.501921:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae773f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97c6 expref: 47 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.501970:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae75e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac974f expref: 47 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343037.501986:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae75e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac974f expref: 47 pid: 15756 timeout: 1331 lvb_type: 1 00000100:00100000:1.0:1763343037.502003:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010280832:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343037.502093:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe900 going to sleep for 11 seconds 00000100:00100000:2.0:1763343037.502176:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993607040 00000100:00100000:2.0:1763343037.502181:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993607040 00000100:00100000:2.0:1763343037.502226:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3219 00000100:00100000:2.0:1763343037.502234:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56903:x1848997993607040:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343037.502470:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56903:x1848997993607040:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 236us (854us total) trans 8589940081 rc 0/0 00000100:00100000:2.0:1763343037.502478:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3219 00000100:00100000:3.0:1763343037.507443:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.507578:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993607168 00000100:00100000:0.0:1763343037.507592:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993607168 00010000:00010000:0.0:1763343037.507694:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae75e8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac974f expref: 48 pid: 15756 timeout: 1331 lvb_type: 1 00000100:00100000:0.0:1763343037.507746:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3109 00000100:00100000:0.0:1763343037.507756:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+48:2430:x1848997993607168:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343037.507776:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343037.507802:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae75e8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac974f expref: 48 pid: 15756 timeout: 1331 lvb_type: 1 00010000:00010000:0.0:1763343037.507817:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae75e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac974f expref: 48 pid: 15756 timeout: 1331 lvb_type: 1 00010000:00010000:0.0:1763343037.507850:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.507858:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.507869:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae773f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97c6 expref: 48 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.507889:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae773f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97c6 expref: 48 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.507940:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae773f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97c6 expref: 48 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343037.507956:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a351fc74000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1848998010280960:192.168.204.21@tcp:105: 00000100:00100000:0.0:1763343037.508064:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35085399c0 going to sleep for 11 seconds 00010000:00010000:1.0:1763343037.508398:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae75e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac974f expref: 48 pid: 15756 timeout: 1331 lvb_type: 1 00000100:00100000:1.0:1763343037.508415:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010280832:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343037.508445:0:15756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae773f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97c6 expref: 47 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.508457:0:15756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:3.0:1763343037.512113:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.512660:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993607424 00000100:00100000:0.0:1763343037.512674:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993607424 00000100:00100000:1.0:1763343037.512739:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+47:56899:x1848997993606784:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6692us (7057us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.512747:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9433 00000100:00100000:1.0:1763343037.512751:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6625 00000100:00100000:0.0:1763343037.512757:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:55941:x1848997993607424:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343037.512789:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.512829:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7746 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac97cd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.513067:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae774d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513084:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae774d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513097:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae774d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513110:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae7754 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513118:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae7754 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513124:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae7754 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513205:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae775b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513213:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae775b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513220:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae775b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343037.513232:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e9:0x0]: returning size 0 00010000:00010000:0.0:1763343037.513337:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae774d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513349:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae774d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513355:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae774d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513361:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae774d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513368:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.513372:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae774d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513381:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae774d lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513396:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c2c00) 00010000:00010000:0.0:1763343037.513400:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.513406:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae774d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513413:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae774d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513430:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae7754 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513435:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae7754 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513440:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae7754 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513446:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.513449:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae7754 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513454:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae7754 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513461:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a35167a9100) 00010000:00010000:0.0:1763343037.513464:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.513467:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae7754 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513472:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae7754 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.513516:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7746 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97cd expref: 264 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.513536:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae775b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97cd expref: 263 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.513543:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:0.0:1763343037.513546:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343037.513549:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403528e00, rc 0) 00000100:00100000:0.0:1763343037.513662:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:55941:x1848997993607424:12345-192.168.204.21@tcp:101:bash.0 Request processed in 905us (3132us total) trans 8589940082 rc 0/0 00000100:00100000:0.0:1763343037.513670:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9433 00000100:00100000:1.0:1763343037.514732:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.514790:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993607552 00000100:00100000:2.0:1763343037.514800:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993607552 00000100:00100000:2.0:1763343037.514848:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6626 00000100:00100000:2.0:1763343037.514857:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+47:2430:x1848997993607552:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:2.0:1763343037.515043:0:15756:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343037.515047:0:15756:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb mtime from disk: 1763343037 -> 1763343037 00002000:00010000:2.0:1763343037.515050:0:15756:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb atime from disk: 0 -> 1763343036 00002000:00010000:2.0:1763343037.515052:0:15756:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb ctime from disk: 1763343037 -> 1763343037 00002000:00010000:2.0:1763343037.515055:0:15756:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343037.515114:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+48:2430:x1848997993607552:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 257us (390us total) trans 17179871639 rc 0/0 00000100:00100000:2.0:1763343037.515122:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6626 00000100:00100000:0.0:1763343037.515396:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a351fc74000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1848998010280960:192.168.204.21@tcp:105: 00010000:00010000:0.0:1763343037.515424:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343037.515457:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+47:2430:x1848997993607168:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 7702us (8032us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.515470:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3109 00000100:00100000:2.0:1763343037.517375:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.518944:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993607680 00000100:00100000:3.0:1763343037.518961:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993607680 00000100:00100000:2.0:1763343037.518980:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.519064:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993607936 00000100:00100000:1.0:1763343037.519070:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993607936 00000100:00100000:1.0:1763343037.519142:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3220 00000100:00100000:1.0:1763343037.519155:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3509228450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56899:x1848997993607936:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:1.0:1763343037.519243:0:14879:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1e6:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7532 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9710 expref: 264 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.519321:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.519340:0:14879:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae75be lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac973a expref: 264 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.519351:0:14879:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.519402:0:14879:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae75be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac973a expref: 264 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.519418:0:14879:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae75be lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac973a expref: 264 pid: 6523 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343037.519438:0:14879:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010281088:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343037.519548:0:14879:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe900 going to sleep for 11 seconds 00000100:00100000:3.0:1763343037.519653:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9434 00000100:00100000:3.0:1763343037.519662:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993607680:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343037.519673:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.519687:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7770 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac97d4 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.519718:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7777 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343037.519730:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7777 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343037.519742:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7777 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343037.519871:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7770 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97d4 expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.519954:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7777 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97d4 expref: 265 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.519965:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:3.0:1763343037.519978:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343037.519983:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:3.0:1763343037.520040:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993607680:12345-192.168.204.21@tcp:101:bash.0 Request processed in 378us (2674us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.520048:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9434 00000100:00100000:2.0:1763343037.523257:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.523400:0:14879:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010281088:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343037.523438:0:14879:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00000100:00100000:0.0:1763343037.523535:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993608192 00000100:00100000:0.0:1763343037.523546:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993608192 00000100:00100000:2.0:1763343037.523548:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.523592:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993608320 00000100:00100000:3.0:1763343037.523597:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993608320 00010000:00010000:3.0:1763343037.523672:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae75be lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac973a expref: 266 pid: 6523 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1763343037.523704:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3110 00000100:00100000:0.0:1763343037.523704:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9435 00000100:00100000:3.0:1763343037.523714:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:2429:x1848997993608320:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1763343037.523715:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:55941:x1848997993608192:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:3.0:1763343037.523732:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343037.523739:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae75be lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac973a expref: 266 pid: 6523 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343037.523751:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae75be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac973a expref: 266 pid: 6523 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.523772:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343037.523776:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae75be lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac973a expref: 266 pid: 6523 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.523784:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae775b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97cd expref: 266 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.523795:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:0.0:1763343037.523795:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:0.0:1763343037.523800:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343037.523801:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343037.523812:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343037.523819:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343037.523839:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343037.523911:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:2429:x1848997993608320:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 197us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.523919:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3110 00010000:00010000:1.0:1763343037.523996:0:14879:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.524003:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343037.524063:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae777e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.524075:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae777e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.524083:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae777e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:1.0:1763343037.524217:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1455, 88 off122704 00000004:00080000:1.0:1763343037.524226:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231191604553ns, next at 1232093460684ns, rc = 0 00000040:00080000:1.0:1763343037.524272:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1454, 88 off122704 00000004:00080000:1.0:1763343037.524278:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231191657307ns, next at 1232093431049ns, rc = 0 00000040:00080000:1.0:1763343037.524577:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1455, 88 off122792 00000004:00080000:1.0:1763343037.524583:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231191962073ns, next at 1232093431049ns, rc = 0 00000001:00080000:0.0:1763343037.524584:0:6523:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940083 00000004:00010000:0.0:1763343037.524614:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e58529ad reply state 00000000bb00d45d transno 8589940084 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae777e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.524666:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae777e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.524673:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:0.0:1763343037.524676:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343037.524733:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343037.524818:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:55941:x1848997993608192:12345-192.168.204.21@tcp:36:bash.0 Request processed in 1104us (1574us total) trans 8589940084 rc 0/0 00000040:00080000:1.0:1763343037.524822:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1456, 88 off122792 00000100:00100000:0.0:1763343037.524826:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9435 00000004:00080000:1.0:1763343037.524827:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231192205802ns, next at 1232093460684ns, rc = 0 00000020:00080000:0.0:1763343037.524831:0:6523:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343037.527387:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.527654:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993608448 00000100:00100000:3.0:1763343037.527669:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993608448 00000100:00100000:3.0:1763343037.527742:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9436 00000100:00100000:3.0:1763343037.527753:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:55941:x1848997993608448:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343037.527780:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.527807:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7785 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac97db expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.527891:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7785 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97db expref: 268 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.527911:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7785 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97db expref: 268 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.527940:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:3.0:1763343037.527945:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343037.527949:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343037.528015:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:55941:x1848997993608448:12345-192.168.204.21@tcp:101:bash.0 Request processed in 264us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.528023:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9436 00000001:00080000:0.0:1763343037.528549:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940085 is committed 00000004:00080000:0.0:1763343037.528559:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 958 committed 00000004:00080000:0.0:1763343037.528573:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 959 committed 00000004:00080000:0.0:1763343037.528587:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 958 committed 00000004:00080000:0.0:1763343037.528590:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 957 committed 00000004:00080000:0.0:1763343037.528643:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 956 committed 00000004:00080000:0.0:1763343037.528646:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 957 committed 00000100:00100000:0.0:1763343037.528802:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010281216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343037.528864:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343037.528915:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343037.528922:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010281344:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343037.528945:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343037.529024:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7682 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529036:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7682 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529045:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7682 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529052:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.529058:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7682 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529068:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7682 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529084:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a35167a9100) 00010000:00010000:1.0:1763343037.529087:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.529091:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7682 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529098:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7682 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529121:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae76eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529127:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae76eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529134:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae76eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529139:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.529142:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae76eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529148:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae76eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529155:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:1.0:1763343037.529158:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.529161:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae76eb lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529167:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae76eb lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529177:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7707 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529183:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7707 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529189:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7707 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529200:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.529202:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7707 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529208:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7707 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529215:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a35167a9100) 00010000:00010000:1.0:1763343037.529217:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.529220:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7707 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529225:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7707 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529242:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae7738 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529249:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae7738 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529255:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae7738 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529260:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.529275:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae7738 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529281:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae7738 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529288:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:1.0:1763343037.529291:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.529294:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae7738 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529299:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae7738 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529309:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae777e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529315:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae777e lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529320:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae777e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529326:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340471ee00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.529329:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae777e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529334:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae777e lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529342:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:1.0:1763343037.529345:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.529348:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae777e lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.529354:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471ee00/0x607405d401ae777e lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:1.0:1763343037.529410:0:14879:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000058c4b4ea reply state 000000008e5e0ce5 transno 8589940085 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.529423:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.529431:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:1.0:1763343037.529434:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763343037.529437:0:14879:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343037.529444:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:1.0:1763343037.529447:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343037.529453:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7532 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9710 expref: 250 pid: 6523 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1763343037.529548:0:14879:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763343037.529573:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3509228450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56899:x1848997993607936:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 10420us (10594us total) trans 8589940085 rc 0/0 00000100:00100000:1.0:1763343037.529583:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3220 00000100:00100000:3.0:1763343037.529876:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010281216 00000100:00100000:2.0:1763343037.530328:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010281472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343037.530374:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343037.530417:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010281984:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343037.530439:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343037.530458:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1763343037.530464:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3503523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010281600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343037.530482:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343037.530498:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010282112:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343037.530517:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343037.530565:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010281344 00000100:00100000:2.0:1763343037.530574:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010281344 00000100:00100000:2.0:1763343037.530611:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010281472 00000100:00100000:2.0:1763343037.530614:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010281472 00000100:00100000:2.0:1763343037.530666:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010281984 00000100:00100000:2.0:1763343037.530670:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010281984 00000100:00100000:2.0:1763343037.530695:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010281600 00000100:00100000:2.0:1763343037.530698:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010281600 00000100:00100000:2.0:1763343037.530712:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010282112 00000100:00100000:2.0:1763343037.530714:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010282112 00000100:00100000:2.0:1763343037.530759:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6627 00000100:00100000:2.0:1763343037.530766:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3657:x1848998010281344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343037.530798:0:10294:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:688 count 1 00002000:00010000:2.0:1763343037.530839:0:10294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343037.530849:0:10294:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae778c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.530867:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.530869:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.530876:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae778c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.530903:0:10294:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae778c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.530913:0:10294:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae778c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.530920:0:10294:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae778c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.530941:0:10294:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343037.531213:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010281344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 445us (2265us total) trans 21474838936 rc 0/0 00000100:00100000:2.0:1763343037.531221:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6627 00000100:00100000:2.0:1763343037.531245:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6628 00000100:00100000:2.0:1763343037.531252:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3659:x1848998010281472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763343037.531350:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2ad:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343037.531353:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2ad:0x0] updating lvb mtime from disk: 1763343037 -> 1763343037 00002000:00010000:2.0:1763343037.531355:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2ad:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343037.531357:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2ad:0x0] updating lvb ctime from disk: 1763343037 -> 1763343037 00002000:00010000:2.0:1763343037.531359:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2ad:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343037.531390:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3659:x1848998010281472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 139us (1016us total) trans 21474838937 rc 0/0 00000100:00100000:2.0:1763343037.531396:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6628 00000100:00100000:2.0:1763343037.531409:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6629 00000100:00100000:2.0:1763343037.531416:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+83:3659:x1848998010281984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763343037.531489:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343037.531492:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb mtime from disk: 1763343037 -> 1763343037 00002000:00010000:2.0:1763343037.531494:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb atime from disk: 1763343036 -> 1763343036 00002000:00010000:2.0:1763343037.531497:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb ctime from disk: 1763343037 -> 1763343037 00002000:00010000:2.0:1763343037.531499:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2af:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343037.531524:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+84:3659:x1848998010281984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (1084us total) trans 17179871640 rc 0/0 00000100:00100000:2.0:1763343037.531531:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6629 00000100:00100000:2.0:1763343037.531544:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6630 00000100:00100000:2.0:1763343037.531551:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3659:x1848998010281600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763343037.531595:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2ae:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343037.531598:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2ae:0x0] updating lvb mtime from disk: 1763343037 -> 1763343037 00002000:00010000:2.0:1763343037.531600:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2ae:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343037.531601:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2ae:0x0] updating lvb ctime from disk: 1763343037 -> 1763343037 00002000:00010000:2.0:1763343037.531603:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2ae:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343037.531654:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3659:x1848998010281600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (1169us total) trans 21474838938 rc 0/0 00000100:00100000:2.0:1763343037.531660:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6630 00000100:00100000:2.0:1763343037.531672:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6631 00000100:00100000:2.0:1763343037.531679:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+83:3659:x1848998010282112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763343037.531734:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343037.531737:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b0:0x0] updating lvb mtime from disk: 1763343037 -> 1763343037 00002000:00010000:2.0:1763343037.531739:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2b0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343037.531741:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b0:0x0] updating lvb ctime from disk: 1763343037 -> 1763343037 00002000:00010000:2.0:1763343037.531744:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343037.531767:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+84:3659:x1848998010282112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (1249us total) trans 17179871641 rc 0/0 00000100:00100000:2.0:1763343037.531773:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6631 00010000:00010000:2.0:1763343037.531833:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343037.531841:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae778c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.531850:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343037.531856:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae778c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.531866:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae778c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.531901:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae778c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.531910:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae778c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.531929:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343037.531932:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343037.531933:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763343037.531982:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3503523480/2, rc 0, transno 21474838938 00000100:00100000:2.0:1763343037.531990:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010281600:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763343037.532006:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c3bdc00/2, rc 0, transno 17179871641 00000100:00100000:2.0:1763343037.532010:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010282112:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343037.532019:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3503522a00/2, rc 0, transno 21474838937 00000100:00100000:2.0:1763343037.532022:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3503522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010281472:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763343037.532029:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c3bdf80/2, rc 0, transno 17179871640 00000100:00100000:2.0:1763343037.532033:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010281984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343037.532993:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010281216 00000100:00100000:3.0:1763343037.533057:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6632 00000100:00100000:3.0:1763343037.533067:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010281216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343037.533093:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:687 count 1 00010000:00010000:3.0:1763343037.533117:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7793 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.533138:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae763c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9772 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.533146:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343037.533148:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343037.533152:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7793 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.533199:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae763c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9772 expref: 12 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.533215:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae763c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9772 expref: 12 pid: 8408 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1763343037.533237:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1848998010282240:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343037.533345:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133ca80 going to sleep for 11 seconds 00010000:00010000:0.0:1763343037.533470:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343037.533479:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343037.533486:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343037.533491:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.533495:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343037.533502:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343037.533520:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:0.0:1763343037.533523:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343037.533528:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343037.533534:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7769 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00000100:00100000:1.0:1763343037.534136:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010281856:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.534190:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.534237:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343037.534244:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010281728:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.534267:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763343037.534331:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34034f3800/2, rc 0, transno 21474838936 00000100:00100000:1.0:1763343037.534337:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010281344:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343037.538886:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010281856 00000100:00100000:3.0:1763343037.538910:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010281856 00000100:00100000:3.0:1763343037.538986:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010281728 00000100:00100000:3.0:1763343037.538990:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010281728 00000100:00100000:3.0:1763343037.539023:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6633 00000100:00100000:3.0:1763343037.539033:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3658:x1848998010281856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343037.539073:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:690 count 1 00002000:00010000:3.0:1763343037.539118:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343037.539127:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae779a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.539145:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.539147:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.539154:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae779a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.539169:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae779a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.539178:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae779a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.539186:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae779a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.539218:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343037.539552:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:3658:x1848998010281856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 520us (5361us total) trans 17179871642 rc 0/0 00000100:00100000:3.0:1763343037.539561:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6633 00000100:00100000:3.0:1763343037.539582:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6634 00000100:00100000:3.0:1763343037.539588:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3658:x1848998010281728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343037.539600:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:689 count 1 00010000:00010000:3.0:1763343037.539613:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae77a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.539658:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae7643 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9779 expref: 46 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.539665:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343037.539667:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343037.539670:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae77a1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.539711:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae7643 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9779 expref: 46 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.539725:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae7643 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9779 expref: 46 pid: 8408 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1763343037.539742:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010282368:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343037.539835:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1763343037.539857:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343037.539865:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae779a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.539872:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343037.539887:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae779a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.539897:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae779a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.539917:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae779a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.539924:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae779a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.539942:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343037.539944:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343037.539946:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343037.540500:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c3bf800/2, rc 0, transno 17179871642 00000100:00100000:1.0:1763343037.540509:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010281856:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343037.543285:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.543329:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.543452:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993608704 00000100:00100000:0.0:1763343037.543465:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993608704 00000100:00100000:0.0:1763343037.543538:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993608832 00000100:00100000:0.0:1763343037.543543:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993608832 00000100:00100000:0.0:1763343037.543566:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9437 00000100:00100000:0.0:1763343037.543575:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:55941:x1848997993608704:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343037.543601:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.543605:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343037.543670:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7785 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97db expref: 250 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.543691:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:0.0:1763343037.543697:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343037.543716:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae77a8 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac97e2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.543784:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae77af lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.543804:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae77af lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.543818:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae77af lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:0.0:1763343037.544218:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1457, 88 off122880 00000004:00080000:0.0:1763343037.544228:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231211606303ns, next at 1232093460684ns, rc = 0 00000100:00100000:2.0:1763343037.544655:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.544686:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993608960 00000100:00100000:2.0:1763343037.544693:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993608960 00010000:00010000:2.0:1763343037.544726:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae763c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9772 expref: 13 pid: 8408 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343037.544756:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3111 00000100:00100000:2.0:1763343037.544764:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993608960:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343037.544778:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343037.544783:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae763c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9772 expref: 13 pid: 8408 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.544797:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae763c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9772 expref: 13 pid: 8408 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.544821:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.544824:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.544829:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.544839:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7793 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.544859:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343037.545072:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9438 00000100:00100000:3.0:1763343037.545083:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+250:56899:x1848997993608832:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343037.545103:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.545120:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae77b6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac97e9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.545167:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae77b6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97e9 expref: 251 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.545185:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a353e6f7200/0x607405d401ae77b6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97e9 expref: 251 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.545201:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:3.0:1763343037.545204:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343037.545207:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a353e6f7200, rc 0) 00000100:00100000:3.0:1763343037.545239:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56899:x1848997993608832:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 160us (1910us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.545246:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9438 00000040:00080000:0.0:1763343037.545461:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1456, 88 off122880 00000004:00080000:0.0:1763343037.545472:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231212850601ns, next at 1232093431049ns, rc = 0 00000040:00080000:0.0:1763343037.545689:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1457, 88 off122968 00000004:00080000:0.0:1763343037.545696:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231213075121ns, next at 1232093431049ns, rc = 0 00000040:00080000:0.0:1763343037.545728:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1458, 88 off122968 00000004:00080000:0.0:1763343037.545733:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231213112192ns, next at 1232093460684ns, rc = 0 00000100:00100000:2.0:1763343037.546735:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993608960:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 170us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.546758:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3111 00010000:00010000:1.0:1763343037.547348:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae763c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9772 expref: 12 pid: 8408 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343037.547369:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1848998010282240:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343037.547408:0:8408:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.547512:0:8408:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.547522:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.547534:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.547543:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7793 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.547575:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343037.549152:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343037.549170:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7793 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.549182:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343037.549187:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7793 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.549198:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7793 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.549224:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7793 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.549231:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7793 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.549257:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343037.549260:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343037.549581:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343037.550409:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34034f1180/2, rc 0, transno 21474838939 00000100:00100000:1.0:1763343037.550445:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010281216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343037.550567:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3657:x1848998010281216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17499us (21700us total) trans 21474838939 rc 0/0 00000100:00100000:0.0:1763343037.550582:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6632 00000100:00100000:3.0:1763343037.552006:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.552044:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993609088 00000100:00100000:3.0:1763343037.552054:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993609088 00010000:00010000:3.0:1763343037.552104:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae7643 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9779 expref: 47 pid: 8408 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1763343037.552143:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3112 00000100:00100000:3.0:1763343037.552155:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+47:2430:x1848997993609088:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763343037.552257:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010282368:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343037.552298:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae77a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.553914:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343037.553936:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae7643 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9779 expref: 47 pid: 8408 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343037.553954:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae7643 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9779 expref: 47 pid: 8408 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343037.553984:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177000/0x607405d401ae7643 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9779 expref: 47 pid: 8408 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343037.554004:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.554007:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.554013:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae77a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.554026:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae77a1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.554075:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343037.554165:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+46:2430:x1848997993609088:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 2010us (2166us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.554177:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3112 00010000:00010000:1.0:1763343037.554702:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae77a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.554713:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae77a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.554725:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae77a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.554734:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae77a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.554758:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343037.555078:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:3658:x1848998010281728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15487us (20807us total) trans 17179871643 rc 0/0 00000100:00100000:1.0:1763343037.555086:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6634 00010000:00010000:1.0:1763343037.555117:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343037.555125:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae77a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.555134:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343037.555139:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae77a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.555149:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae77a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.555167:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae77a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.555175:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae77a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.555195:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343037.555197:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343037.555199:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343037.555248:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c3bca80/2, rc 0, transno 17179871643 00000100:00100000:3.0:1763343037.558790:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.559221:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010281728:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.559281:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993609344 00000100:00100000:1.0:1763343037.559293:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993609344 00000100:00100000:1.0:1763343037.559382:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3221 00000100:00100000:1.0:1763343037.559393:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+252:56899:x1848997993609344:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:1.0:1763343037.559949:0:14879:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1e6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1763343037.560026:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1459, 64 off123032 00000040:00080000:1.0:1763343037.560057:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1458, 64 off123032 00000040:00080000:1.0:1763343037.560069:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1459, 64 off123096 00000040:00080000:1.0:1763343037.560079:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1460, 64 off123096 00010000:00010000:1.0:1763343037.560163:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae77bd lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.560186:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae77bd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.560200:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae77bd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.560210:0:14879:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae77bd lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.560217:0:14879:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae77bd lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.560224:0:14879:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae77bd lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.560249:0:14879:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343037.560497:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56899:x1848997993609344:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1102us (1719us total) trans 8589940087 rc 0/0 00000100:00100000:1.0:1763343037.560506:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3221 00010000:00010000:1.0:1763343037.560547:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343037.560554:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae77bd lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.560562:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343037.560566:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae77bd lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.560575:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae77bd lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.560589:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e6:0x0].0x0 (ffff9a3510289c00) 00010000:00010000:1.0:1763343037.560593:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343037.560598:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae77bd lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.560604:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae77bd lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1e6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343037.560615:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343037.560617:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343037.560643:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1763343037.562235:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940086 is committed 00000004:00080000:2.0:1763343037.563355:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 960 committed 00010000:00010000:0.0:1763343037.563438:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae77af lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97e2 expref: 252 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.563455:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:0.0:1763343037.563458:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343037.563481:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae77a8 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97e2 expref: 252 pid: 6523 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343037.563502:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae77af lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97e2 expref: 251 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.563543:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:0.0:1763343037.563545:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343037.563548:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403528c00, rc 0) 00000100:00100000:0.0:1763343037.563666:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:55941:x1848997993608704:12345-192.168.204.21@tcp:101:bash.0 Request processed in 20090us (20408us total) trans 8589940086 rc 0/0 00000100:00100000:0.0:1763343037.563677:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9437 00000100:00100000:3.0:1763343037.564291:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.564359:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993609600 00000100:00100000:0.0:1763343037.564369:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993609600 00000100:00100000:0.0:1763343037.564424:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9439 00000100:00100000:0.0:1763343037.564435:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56899:x1848997993609600:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343037.564458:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.564485:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae77c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac97f0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.564576:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae77cb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.564590:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae77cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.564604:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae77cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.564674:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae77d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.564684:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae77d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.564691:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae77d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.564867:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae77d9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.564890:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae77d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.564898:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae77d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343037.564910:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e9:0x0]: returning size 2 00010000:00010000:0.0:1763343037.565021:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae77cb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.565029:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae77cb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.565035:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae77cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.565042:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae77cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.565048:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.565053:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae77cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.565061:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae77cb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.565074:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:0.0:1763343037.565077:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.565082:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae77cb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.565089:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae77cb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.565101:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae77d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.565106:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae77d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.565112:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae77d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.565116:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.565119:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae77d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.565126:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae77d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.565133:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:0.0:1763343037.565136:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.565138:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae77d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.565148:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae77d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343037.565192:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae77c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f0 expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.565207:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae77d9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f0 expref: 253 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.565215:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:0.0:1763343037.565218:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343037.565220:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340683ce00, rc 0) 00000100:00100000:0.0:1763343037.565278:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56899:x1848997993609600:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 844us (988us total) trans 8589940088 rc 0/0 00000100:00100000:0.0:1763343037.565285:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9439 00000004:00080000:2.0:1763343037.566052:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 961 committed 00000004:00080000:2.0:1763343037.566078:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 960 committed 00000004:00080000:2.0:1763343037.566081:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 959 committed 00000100:00100000:3.0:1763343037.566312:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010282624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343037.566401:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343037.566501:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343037.566509:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010282496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343037.566535:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343037.566600:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010282624 00000100:00100000:0.0:1763343037.566609:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010282624 00000100:00100000:0.0:1763343037.566685:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010282496 00000100:00100000:0.0:1763343037.566689:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010282496 00000100:00100000:0.0:1763343037.566710:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6635 00000100:00100000:0.0:1763343037.566719:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e9ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3658:x1848998010282624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343037.566930:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e9ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3658:x1848998010282624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 211us (528us total) trans 21474838940 rc 0/0 00000100:00100000:0.0:1763343037.566937:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6635 00000100:00100000:0.0:1763343037.567083:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6636 00000100:00100000:0.0:1763343037.567090:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3658:x1848998010282496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343037.567165:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3658:x1848998010282496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (629us total) trans 21474838941 rc 0/0 00000100:00100000:0.0:1763343037.567172:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6636 00000004:00080000:3.0:1763343037.567329:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b9c00/2, rc 0, transno 21474838941 00000100:00100000:3.0:1763343037.567349:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010282496:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343037.567361:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095ba300/2, rc 0, transno 21474838940 00000100:00100000:3.0:1763343037.567365:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010282624:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343037.567746:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010282752:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343037.567782:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343037.567815:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343037.567821:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010282880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343037.567842:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343037.567868:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010282752 00000100:00100000:2.0:1763343037.567872:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010282752 00000100:00100000:2.0:1763343037.567907:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010282880 00000100:00100000:2.0:1763343037.567910:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010282880 00000100:00100000:2.0:1763343037.567927:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6637 00000100:00100000:2.0:1763343037.567933:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+87:3659:x1848998010282752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343037.568044:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+88:3659:x1848998010282752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (260us total) trans 17179871644 rc 0/0 00000100:00100000:2.0:1763343037.568051:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6637 00000100:00100000:2.0:1763343037.568067:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6638 00000100:00100000:2.0:1763343037.568073:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+87:3659:x1848998010282880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343037.568140:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+88:3659:x1848998010282880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (296us total) trans 17179871645 rc 0/0 00000100:00100000:2.0:1763343037.568146:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6638 00000004:00080000:2.0:1763343037.568173:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340ccc1880/2, rc 0, transno 17179871645 00000100:00100000:2.0:1763343037.568183:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010282880:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343037.568193:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340ccc3b80/2, rc 0, transno 17179871644 00000100:00100000:2.0:1763343037.568196:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010282752:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343037.569254:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.569942:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993609728 00000100:00100000:1.0:1763343037.569955:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993609728 00000100:00100000:1.0:1763343037.571772:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6639 00000100:00100000:1.0:1763343037.571801:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+46:55941:x1848997993609728:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343037.571830:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.571863:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae77e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac97f7 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343037.571904:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343037.571934:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.571937:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.571950:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae77e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f7 expref: 47 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.571967:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae77e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f7 expref: 47 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.571982:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:1.0:1763343037.572074:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+47:55941:x1848997993609728:12345-192.168.204.21@tcp:101:bash.0 Request processed in 286us (2828us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.572082:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6639 00000100:00100000:0.0:1763343037.576844:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.577071:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993609984 00000100:00100000:1.0:1763343037.577085:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993609984 00000100:00100000:1.0:1763343037.577206:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6640 00000100:00100000:1.0:1763343037.577220:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+47:2430:x1848997993609984:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343037.577245:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763343037.577257:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:1.0:1763343037.577269:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae77ee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac97fe expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343037.577353:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010283008:192.168.204.21@tcp:106: 00000100:00100000:2.0:1763343037.577569:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993609856 00000100:00100000:2.0:1763343037.577573:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993609856 00000100:00100000:2.0:1763343037.577646:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6641 00000100:00100000:2.0:1763343037.577654:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:55941:x1848997993609856:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343037.577662:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.577679:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae77f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9805 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343037.577707:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343037.577725:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.577727:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.577739:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae77f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9805 expref: 13 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.577756:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae77f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9805 expref: 13 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343037.577902:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340680af00 going to sleep for 11 seconds 00010000:00010000:2.0:1763343037.577983:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c200, rc 0) 00000100:00100000:2.0:1763343037.578206:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:55941:x1848997993609856:12345-192.168.204.21@tcp:101:bash.0 Request processed in 551us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.578215:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6641 00002000:00010000:1.0:1763343037.580607:0:28996:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x2b3:0x0] updating lvb mtime: 0 -> 1763343037 00002000:00010000:1.0:1763343037.580652:0:28996:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x2b3:0x0] updating lvb atime: 0 -> 1763343037 00002000:00010000:1.0:1763343037.580655:0:28996:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x2b3:0x0] updating lvb ctime: 0 -> 1763343037 00000100:00100000:1.0:1763343037.580685:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010283008:192.168.204.21@tcp:106: 00010000:00010000:1.0:1763343037.580741:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae77ee lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97fe expref: 48 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343037.580842:0:28996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae77ee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97fe expref: 48 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343037.580858:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343037.580922:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+47:2430:x1848997993609984:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3705us (4092us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343037.580936:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6640 00000100:00100000:3.0:1763343037.582285:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.582350:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993610112 00000100:00100000:0.0:1763343037.582363:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993610112 00000100:00100000:3.0:1763343037.582364:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00002000:00010000:0.0:1763343037.582414:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/691 (0->18446744073709551615) 00002000:00100000:0.0:1763343037.582420:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340c3bc380 with x1848997993610112 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343037.582433:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340c3bc380. 00000100:00100000:2.0:1763343037.582656:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993610240 00000100:00100000:2.0:1763343037.582661:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993610240 00002000:00010000:2.0:1763343037.582682:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/689 (0->18446744073709551615) 00002000:00100000:2.0:1763343037.582687:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340465ea00 with x1848997993610240 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343037.582695:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340465ea00. 00000100:00100000:0.0:1763343037.582714:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1616 00000100:00100000:2.0:1763343037.583453:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1617 00000100:00100000:2.0:1763343037.583466:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993610240:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:0.0:1763343037.583684:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+47:2430:x1848997993610112:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343037.583741:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343037.583744:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2b1:0x0] updating lvb mtime from disk: 0 -> 1763343037 00002000:00010000:2.0:1763343037.583747:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2b1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343037.583749:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2b1:0x0] updating lvb ctime from disk: 0 -> 1763343037 00002000:00010000:2.0:1763343037.583752:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b1:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763343037.583795:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343037.583798:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b3:0x0] updating lvb mtime from disk: 1763343037 -> 1763343037 00002000:00010000:0.0:1763343037.583800:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2b3:0x0] updating lvb atime from disk: 1763343037 -> 0 00002000:00010000:0.0:1763343037.583802:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b3:0x0] updating lvb ctime from disk: 1763343037 -> 1763343037 00002000:00010000:0.0:1763343037.583804:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343037.583824:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993610240:12345-192.168.204.21@tcp:10:bash.0 Request processed in 362us (1458us total) trans 21474838942 rc 0/0 00000100:00100000:0.0:1763343037.583824:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+48:2430:x1848997993610112:12345-192.168.204.21@tcp:10:bash.0 Request processed in 146us (1547us total) trans 17179871646 rc 0/0 00000100:00100000:2.0:1763343037.583833:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1617 00002000:00010000:2.0:1763343037.583837:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/689 (0->18446744073709551615) 00002000:00100000:2.0:1763343037.583841:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340465ea00 with x1848997993610240 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343037.583845:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340465ea00. 00000100:00100000:0.0:1763343037.584475:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1616 00002000:00010000:0.0:1763343037.584480:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/691 (0->18446744073709551615) 00002000:00100000:0.0:1763343037.584484:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340c3bc380 with x1848997993610112 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343037.584492:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340c3bc380. 00000100:00100000:0.0:1763343037.585501:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.585593:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993610496 00000100:00100000:3.0:1763343037.585605:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993610496 00000100:00100000:3.0:1763343037.585677:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3222 00000100:00100000:3.0:1763343037.585689:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56899:x1848997993610496:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343037.585992:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56899:x1848997993610496:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 304us (495us total) trans 8589940089 rc 0/0 00000100:00100000:3.0:1763343037.586000:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3222 00000100:00100000:0.0:1763343037.588044:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.588141:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993610752 00000100:00100000:3.0:1763343037.588154:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993610752 00000100:00100000:3.0:1763343037.588224:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3223 00000100:00100000:3.0:1763343037.588235:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:55941:x1848997993610752:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343037.588365:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.588766:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993611008 00000100:00100000:2.0:1763343037.588772:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993611008 00000100:00100000:2.0:1763343037.588821:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9440 00000100:00100000:2.0:1763343037.588830:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56899:x1848997993611008:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.588845:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.588872:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae77fc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac980c expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.588991:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.589014:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae77d9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f0 expref: 257 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.589025:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.589075:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae77d9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f0 expref: 257 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.589091:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae77d9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f0 expref: 257 pid: 6523 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343037.589107:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a354134c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010283136:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343037.589193:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726540 going to sleep for 11 seconds 00000100:00100000:3.0:1763343037.589429:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:55941:x1848997993610752:12345-192.168.204.21@tcp:35:bash.0 Request processed in 418us (621us total) trans 8589940090 rc 0/0 00000100:00100000:3.0:1763343037.589439:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3223 00000100:00100000:0.0:1763343037.591547:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.591701:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993611136 00000100:00100000:3.0:1763343037.591712:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993611136 00010000:00010000:3.0:1763343037.591757:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae77d9 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f0 expref: 257 pid: 6523 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343037.592561:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a354134c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010283136:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343037.592598:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:2.0:1763343037.592868:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3113 00000100:00100000:2.0:1763343037.592902:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35188bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:2429:x1848997993611136:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343037.592923:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343037.592933:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae77d9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f0 expref: 257 pid: 6523 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.592946:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae77d9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f0 expref: 257 pid: 6523 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.592979:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae77d9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f0 expref: 257 pid: 6523 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.592997:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:2.0:1763343037.593003:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.593016:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.593025:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.593053:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343037.593430:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343037.593438:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343037.593470:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e9:0x0]: returning size 5 00010000:00010000:3.0:1763343037.593670:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae77fc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac980c expref: 258 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.593689:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac980c expref: 257 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.593696:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:3.0:1763343037.593699:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1763343037.593702:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352dc00, rc 0) 00000100:00100000:2.0:1763343037.594057:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35188bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:2429:x1848997993611136:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1176us (2521us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.594068:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3113 00000100:00100000:3.0:1763343037.596103:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56899:x1848997993611008:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6781us (7244us total) trans 8589940091 rc 0/0 00000100:00100000:3.0:1763343037.596119:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9440 00000100:00100000:0.0:1763343037.596288:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.596492:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993611264 00000100:00100000:2.0:1763343037.596504:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993611264 00000100:00100000:2.0:1763343037.596563:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9441 00000100:00100000:2.0:1763343037.596574:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56904:x1848997993611264:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:2.0:1763343037.596605:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.596654:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7811 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9813 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.596741:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7818 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.596758:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7818 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.596771:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7818 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.596784:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae781f lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.596791:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae781f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.596797:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae781f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.596903:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7826 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.596915:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac980c expref: 257 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.596923:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7826 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.596961:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac980c expref: 257 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.596975:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac980c expref: 257 pid: 10041 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343037.596990:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a354134df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010283264:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343037.597082:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726d80 going to sleep for 11 seconds 00000100:00100000:1.0:1763343037.599050:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.599091:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a354134df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010283264:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343037.599129:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7826 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343037.599288:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993611392 00000100:00100000:3.0:1763343037.599298:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993611392 00000100:00100000:3.0:1763343037.599362:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3224 00000100:00100000:3.0:1763343037.599411:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56899:x1848997993611392:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:0.0:1763343037.599497:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.599542:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993611520 00000100:00100000:2.0:1763343037.599547:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993611520 00010000:00010000:2.0:1763343037.599570:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac980c expref: 259 pid: 10041 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343037.599604:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3114 00000100:00100000:2.0:1763343037.599612:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:2429:x1848997993611520:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343037.599641:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343037.599649:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac980c expref: 259 pid: 10041 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.599661:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac980c expref: 259 pid: 10041 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.599686:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7803 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1e9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac980c expref: 259 pid: 10041 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.599704:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:2.0:1763343037.599709:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7826 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.599720:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7826 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.599728:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7826 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.599761:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343037.599798:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7826 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.599806:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7826 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:2.0:1763343037.599832:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:2429:x1848997993611520:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 220us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.599840:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3114 00000100:00100000:3.0:1763343037.600288:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56899:x1848997993611392:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 915us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.600296:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3224 00000004:00200000:0.0:1763343037.600574:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e9:0x0]: returning size 5 00000004:00200000:0.0:1763343037.600580:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343037.600601:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7826 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600615:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7826 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600666:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7818 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600673:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7818 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600680:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7818 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600687:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7818 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600693:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.600697:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7818 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600705:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7818 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600723:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3503a3a700) 00010000:00010000:0.0:1763343037.600726:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.600731:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7818 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600737:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7818 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600752:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae781f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600758:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae781f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600764:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae781f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600770:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.600773:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae781f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600780:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae781f lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600789:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3503a3a500) 00010000:00010000:0.0:1763343037.600791:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.600794:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae781f lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600800:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae781f lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.600835:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae7811 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9813 expref: 257 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.600854:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7826 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9813 expref: 256 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.600860:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:0.0:1763343037.600863:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343037.600866:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352da00, rc 0) 00000100:00100000:0.0:1763343037.600919:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56904:x1848997993611264:12345-192.168.204.21@tcp:101:rm.0 Request processed in 4346us (4635us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.600929:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9441 00000100:00100000:1.0:1763343037.602501:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.602592:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993611776 00000100:00100000:0.0:1763343037.602604:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993611776 00000100:00100000:0.0:1763343037.602685:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9442 00000100:00100000:0.0:1763343037.602696:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56899:x1848997993611776:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343037.602720:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.602742:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae782d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac981a expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.602861:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae7834 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.602888:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae7834 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.602902:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae7834 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343037.602917:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e9:0x0]: returning size 5 00010000:00010000:0.0:1763343037.603056:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae782d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac981a expref: 259 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.603076:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae7834 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac981a expref: 258 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.603084:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:0.0:1763343037.603088:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343037.603091:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340683c200, rc 0) 00000100:00100000:0.0:1763343037.603164:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56899:x1848997993611776:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 469us (673us total) trans 8589940092 rc 0/0 00000100:00100000:0.0:1763343037.603172:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9442 00000100:00100000:3.0:1763343037.603943:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.604072:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993612032 00000100:00100000:1.0:1763343037.604081:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993612032 00000100:00100000:1.0:1763343037.604128:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9443 00000100:00100000:1.0:1763343037.604137:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56904:x1848997993612032:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:1.0:1763343037.604185:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343037.604209:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae77af lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97e2 expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.604228:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7826 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9813 expref: 257 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.604244:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7777 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97d4 expref: 256 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.604254:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:1.0:1763343037.604258:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343037.604286:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae7842 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604296:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae7842 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604304:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae7842 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604316:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7849 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604325:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7849 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604331:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7849 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604437:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7850 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604447:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7850 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604453:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7850 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00080000:1.0:1763343037.604760:0:6523:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1e9:0x0] is inserted into orphan list, open count = 2 00010000:00010000:1.0:1763343037.604864:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7850 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604873:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7850 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604894:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7850 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604901:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.604906:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7850 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604914:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7850 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604923:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:1.0:1763343037.604927:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343037.604931:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7850 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604937:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7850 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604952:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae7842 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604958:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae7842 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604964:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae7842 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604969:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae7842 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604974:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.604977:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae7842 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604982:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae7842 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.604989:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421500) 00010000:00010000:1.0:1763343037.604992:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.604995:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae7842 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.605000:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae7842 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:1.0:1763343037.605014:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ac7a717e reply state 00000000fde878c2 transno 8589940093 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7849 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.605027:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7849 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.605033:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:1.0:1763343037.605036:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343037.605039:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343037.605074:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.605117:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56904:x1848997993612032:12345-192.168.204.21@tcp:36:rm.0 Request processed in 981us (1177us total) trans 8589940093 rc 0/0 00000100:00100000:1.0:1763343037.605125:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9443 00000100:00100000:2.0:1763343037.606029:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993612288 00000100:00100000:2.0:1763343037.606039:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993612288 00000100:00100000:2.0:1763343037.606261:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3225 00000100:00100000:2.0:1763343037.606270:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350922b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56899:x1848997993612288:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:2.0:1763343037.606342:0:6527:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1e9:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae7834 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac981a expref: 257 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.606380:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7857 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343037.606391:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7857 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343037.606400:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7857 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00000004:00020000:2.0:1763343037.606557:0:6527:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0000-mdtlov: can not set all stale mirrors for [0x200000405:0x1e9:0x0]: rc = -1 00010000:00010000:2.0:1763343037.606592:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7857 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343037.606599:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7857 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343037.606604:0:6527:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7857 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343037.606614:0:6527:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.606858:0:6527:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7857 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343037.606866:0:6527:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7857 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343037.606887:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:2.0:1763343037.606891:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763343037.606896:0:6527:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7857 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343037.606902:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7857 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1e9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343037.606914:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a34037c2d00) 00010000:00010000:2.0:1763343037.606917:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343037.606921:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae7834 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac981a expref: 257 pid: 10041 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343037.607598:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350922b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56899:x1848997993612288:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1325us (2521us total) trans 8589940094 rc -1/-1 00000100:00100000:2.0:1763343037.607611:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3225 00000100:00100000:0.0:1763343037.610681:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.610783:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993612416 00000100:00100000:1.0:1763343037.610798:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993612416 00000100:00100000:1.0:1763343037.610888:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9444 00000100:00100000:1.0:1763343037.610901:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56899:x1848997993612416:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343037.610936:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.610968:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae785e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9821 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.611052:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae785e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9821 expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.611071:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177000/0x607405d401ae785e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9821 expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.611096:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a3404421500) 00010000:00010000:1.0:1763343037.611100:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343037.611105:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177000, rc 0) 00000100:00100000:1.0:1763343037.611188:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56899:x1848997993612416:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 289us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.611201:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9444 00000100:00100000:3.0:1763343037.613979:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.614043:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.614376:0:32345:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993612544 00000100:00100000:0.0:1763343037.614390:0:32345:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993612544 00000100:00100000:0.0:1763343037.614474:0:32345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 153 00000100:00100000:0.0:1763343037.614485:0:32345:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b3ae62-6386-4093-b1cf-f8b7be7393a5+9:2430:x1848997993612544:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:0.0:1763343037.614587:0:32345:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b3ae62-6386-4093-b1cf-f8b7be7393a5+9:2430:x1848997993612544:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 103us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.614596:0:32345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 153 00000100:00100000:2.0:1763343037.614952:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993612672 00000100:00100000:2.0:1763343037.614958:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993612672 00000100:00100000:2.0:1763343037.615017:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1473 00000100:00100000:2.0:1763343037.615025:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993612672:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1763343037.615065:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993612672:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 42us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.615076:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1473 00000100:00080000:0.0:1763343037.615671:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1763343037.616087:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.616317:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.616404:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993612800 00000100:00100000:2.0:1763343037.616413:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993612800 00000100:00100000:2.0:1763343037.616469:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9445 00000100:00100000:2.0:1763343037.616479:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56905:x1848997993612800:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.616500:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.616530:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7865 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9828 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343037.616736:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993613056 00000100:00100000:0.0:1763343037.616742:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993613056 00010000:00010000:2.0:1763343037.616818:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae786c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343037.616835:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3226 00010000:00010000:2.0:1763343037.616838:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae786c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343037.616843:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56899:x1848997993613056:12345-192.168.204.21@tcp:35:lfs.0 00010000:00010000:2.0:1763343037.616852:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae786c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.616865:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7873 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.616873:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7873 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.616892:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7873 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.616935:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae786c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.616942:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae786c lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.616949:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae786c lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.616955:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.616960:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae786c lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.616968:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae786c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.616982:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:2.0:1763343037.616985:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.616991:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae786c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.616996:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae786c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.617010:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7873 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.617016:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7873 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.617022:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7873 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.617026:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.617028:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7873 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.617034:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7873 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.617044:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:2.0:1763343037.617046:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.617048:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7873 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.617053:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7873 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.617082:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7865 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9828 expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.617094:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:2.0:1763343037.617096:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.617099:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7865 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9828 expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.617111:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352de00, rc 0) 00000004:00080000:1.0:1763343037.617148:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1e9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1763343037.617173:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56905:x1848997993612800:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 695us (1088us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343037.617180:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9445 00000040:00080000:1.0:1763343037.617215:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1461, 64 off123160 00000040:00080000:1.0:1763343037.617245:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1460, 64 off123160 00000040:00080000:1.0:1763343037.617256:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1461, 64 off123224 00000040:00080000:1.0:1763343037.617264:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1462, 64 off123224 00010000:00010000:1.0:1763343037.617324:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae787a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343037.617333:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae787a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343037.617341:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae787a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343037.617348:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae787a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343037.617353:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae787a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343037.617359:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae787a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343037.617387:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343037.617558:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56899:x1848997993613056:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 714us (1240us total) trans 8589940095 rc 0/0 00000100:00100000:1.0:1763343037.617565:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3226 00010000:00010000:2.0:1763343037.618032:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343037.618040:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae787a lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343037.618047:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343037.618052:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae787a lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343037.618058:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae787a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343037.618072:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e9:0x0].0x0 (ffff9a3404421500) 00010000:00010000:2.0:1763343037.618075:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343037.618079:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae787a lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343037.618085:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae787a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343037.618097:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343037.618098:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343037.618100:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343037.619905:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.620184:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993613184 00000100:00100000:2.0:1763343037.620198:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993613184 00000100:00100000:2.0:1763343037.620285:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9446 00000100:00100000:2.0:1763343037.620296:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56905:x1848997993613184:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.620322:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.620352:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7881 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac982f expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.620470:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7888 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620486:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7888 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620499:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7888 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620509:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae788f lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620517:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae788f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620525:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae788f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620572:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7888 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620578:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7888 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620584:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7888 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620591:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7888 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620597:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.620603:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7888 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620611:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7888 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620666:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3503a3aa00) 00010000:00010000:2.0:1763343037.620670:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.620676:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7888 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620684:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7888 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620701:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae788f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620706:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae788f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620712:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae788f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620717:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.620719:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae788f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620724:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae788f lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620730:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:2.0:1763343037.620732:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.620735:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae788f lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620740:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae788f lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.620770:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7881 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac982f expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.620781:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3503a3aa00) 00010000:00010000:2.0:1763343037.620783:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.620786:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7881 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac982f expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.620800:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c600, rc 0) 00000100:00100000:2.0:1763343037.620870:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56905:x1848997993613184:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 577us (1005us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343037.620892:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9446 00000100:00100000:0.0:1763343037.624985:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.625233:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993613312 00000100:00100000:3.0:1763343037.625247:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993613312 00000100:00100000:3.0:1763343037.625315:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9447 00000100:00100000:3.0:1763343037.625327:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56905:x1848997993613312:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343037.625358:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.625390:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cc800/0x607405d401ae7896 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9836 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.625468:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd600/0x607405d401ae789d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.625484:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd600/0x607405d401ae789d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.625497:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd600/0x607405d401ae789d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343037.625552:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343037.625557:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343037.625597:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cc800/0x607405d401ae7896 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9836 expref: 261 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.625616:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd600/0x607405d401ae789d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9836 expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.625662:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53a800) 00010000:00010000:3.0:1763343037.625665:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343037.625669:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340c0cd600, rc 0) 00000100:00100000:3.0:1763343037.625736:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56905:x1848997993613312:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 411us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.625744:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9447 00000100:00100000:0.0:1763343037.632061:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.632336:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993613440 00000100:00100000:2.0:1763343037.632351:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993613440 00000100:00100000:2.0:1763343037.632435:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9448 00000100:00100000:2.0:1763343037.632449:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56905:x1848997993613440:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.632479:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.632507:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae78a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac983d expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.632599:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae78ab lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632615:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae78ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632656:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae78ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632668:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae78b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632675:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae78b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632680:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae78b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632729:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae78ab lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632736:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae78ab lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632741:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae78ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632748:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae78ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632754:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.632759:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae78ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632767:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae78ab lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632780:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53a800) 00010000:00010000:2.0:1763343037.632783:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.632789:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae78ab lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632795:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae78ab lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632808:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae78b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632814:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae78b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632819:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae78b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632824:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.632826:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae78b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632832:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae78b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632844:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:2.0:1763343037.632846:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.632849:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae78b2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632855:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae78b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343037.632896:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae78a4 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac983d expref: 261 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.632907:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53a800) 00010000:00010000:2.0:1763343037.632910:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.632913:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae78a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac983d expref: 261 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.632922:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352de00, rc 0) 00000100:00100000:2.0:1763343037.632993:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56905:x1848997993613440:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 547us (947us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343037.633001:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9448 00000100:00100000:0.0:1763343037.644043:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.644199:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993613696 00000100:00100000:3.0:1763343037.644214:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993613696 00000100:00100000:3.0:1763343037.644301:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9449 00000100:00100000:3.0:1763343037.644314:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56905:x1848997993613696:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343037.644343:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.644347:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343037.644385:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd600/0x607405d401ae789d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9836 expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.644409:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53a800) 00010000:00010000:3.0:1763343037.644422:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343037.644443:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cc800/0x607405d401ae78b9 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9844 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.644572:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd000/0x607405d401ae78c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.644589:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd000/0x607405d401ae78c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.644600:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd000/0x607405d401ae78c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.644612:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cdc00/0x607405d401ae78c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.644662:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cdc00/0x607405d401ae78c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.644670:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cdc00/0x607405d401ae78c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.645202:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae78ce lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.645215:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae78ce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.645223:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae78ce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343037.645233:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1eb:0x0]: returning size 0 00010000:00010000:3.0:1763343037.645266:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd000/0x607405d401ae78c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.645277:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd000/0x607405d401ae78c0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.645283:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd000/0x607405d401ae78c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.645289:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340c0cd000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343037.645294:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd000/0x607405d401ae78c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.645302:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd000/0x607405d401ae78c0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.645311:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a350b53a100) 00010000:00010000:3.0:1763343037.645313:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343037.645317:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd000/0x607405d401ae78c0 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.645323:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cd000/0x607405d401ae78c0 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:3.0:1763343037.645333:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000021cbbad9 reply state 000000009fbeefba transno 8589940096 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cdc00/0x607405d401ae78c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.645347:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cdc00/0x607405d401ae78c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.645352:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:3.0:1763343037.645355:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343037.645357:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343037.645393:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cc800/0x607405d401ae78b9 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9844 expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.645417:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae78ce lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9844 expref: 261 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.645424:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a350b53ad00) 00010000:00010000:3.0:1763343037.645427:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343037.645430:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501481200, rc 0) 00000100:00100000:3.0:1763343037.645534:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56905:x1848997993613696:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1222us (1506us total) trans 8589940096 rc 0/0 00000100:00100000:3.0:1763343037.645544:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9449 00000100:00100000:0.0:1763343037.651553:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.651666:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993613952 00000100:00100000:0.0:1763343037.651670:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.651680:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993613952 00000100:00100000:2.0:1763343037.651799:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993614208 00000100:00100000:2.0:1763343037.651804:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993614208 00000100:00100000:1.0:1763343037.651845:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9450 00000100:00100000:1.0:1763343037.651860:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56905:x1848997993613952:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343037.651905:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.651938:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae78dc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac984b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.652108:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae78e3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.652129:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae78ce lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9844 expref: 264 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.652145:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae78e3 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.652192:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae78ce lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9844 expref: 264 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.652209:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae78ce lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9844 expref: 264 pid: 28422 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343037.652230:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010283392:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343037.652331:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340680af00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343037.653296:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9451 00000100:00100000:3.0:1763343037.653315:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56908:x1848997993614208:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343037.653338:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.653357:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae78ea lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9852 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.653499:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae78f1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.653515:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae78f1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.653534:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae78f1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343037.653548:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1eb:0x0]: returning size 0 00010000:00010000:2.0:1763343037.654276:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae78f1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.654288:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae78f1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.654298:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae78f1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.654305:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.654310:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae78f1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.654318:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae78f1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.654334:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a350b53ad00) 00010000:00010000:2.0:1763343037.654337:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763343037.654343:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae78f1 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.654349:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae78f1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.654406:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae78ea lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9852 expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.654418:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a350b53ad00) 00010000:00010000:2.0:1763343037.654421:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343037.654425:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae78ea lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9852 expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.654435:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480600, rc 0) 00000100:00100000:2.0:1763343037.654530:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56908:x1848997993614208:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1221us (2859us total) trans 8589940097 rc 301/301 00000100:00100000:2.0:1763343037.654540:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9451 00000100:00100000:0.0:1763343037.659246:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.659531:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993614336 00000100:00100000:2.0:1763343037.659544:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993614336 00010000:00010000:2.0:1763343037.659600:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae78ce lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9844 expref: 265 pid: 28422 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343037.659688:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3115 00000100:00100000:2.0:1763343037.659701:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:2430:x1848997993614336:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343037.659724:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343037.659733:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae78ce lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9844 expref: 265 pid: 28422 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.659749:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae78ce lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9844 expref: 265 pid: 28422 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.659781:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a350b53ad00) 00010000:00010000:2.0:1763343037.659788:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae78e3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.659800:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae78e3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.659809:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae78e3 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.659832:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343037.659924:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:2430:x1848997993614336:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 224us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.659932:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3115 00000100:00100000:0.0:1763343037.660105:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.660136:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993614592 00000100:00100000:0.0:1763343037.660140:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993614592 00000100:00100000:0.0:1763343037.660171:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3227 00000100:00100000:0.0:1763343037.660178:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56908:x1848997993614592:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343037.660449:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56908:x1848997993614592:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 270us (344us total) trans 8589940098 rc 0/0 00000100:00100000:0.0:1763343037.660456:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3227 00010000:00010000:2.0:1763343037.661755:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae78ce lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9844 expref: 265 pid: 28422 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343037.661787:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010283392:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343037.661817:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae78e3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.661827:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae78e3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.661832:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae78e3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343037.661860:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1eb:0x0]: returning size 0 00000004:00080000:2.0:1763343037.662117:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2b3:0x0], index 0: 0 00000004:00080000:2.0:1763343037.662124:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2b5:0x0], index 1: 0 00000004:00080000:2.0:1763343037.662129:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2b6:0x0], index 1: 0 00000004:00080000:2.0:1763343037.662134:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2b4:0x0], index 0: 0 00010000:00010000:2.0:1763343037.662260:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae78e3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.662282:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae78e3 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.662289:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae78e3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.662295:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.662300:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae78e3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.662308:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae78e3 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.662330:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a350b53ad00) 00010000:00010000:2.0:1763343037.662334:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343037.662339:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae78e3 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.662345:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae78e3 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.662402:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae78dc lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac984b expref: 265 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.662415:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a350b53ad00) 00010000:00010000:2.0:1763343037.662417:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343037.662421:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae78dc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac984b expref: 265 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.662438:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:2.0:1763343037.662530:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56905:x1848997993613952:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 10673us (10992us total) trans 8589940099 rc 301/301 00000100:00100000:2.0:1763343037.662541:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9450 00000100:00100000:0.0:1763343037.665974:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.666031:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993614848 00000100:00100000:2.0:1763343037.666045:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993614848 00000100:00100000:2.0:1763343037.666129:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9452 00000100:00100000:2.0:1763343037.666141:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56908:x1848997993614848:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.666171:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.666202:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7906 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9859 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.666326:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae790d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.666349:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae790d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.666364:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae790d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.666376:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7914 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.666383:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7914 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.666389:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7914 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667136:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae791b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667150:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae791b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667159:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae791b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667293:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae790d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667302:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae790d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667308:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae790d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667317:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae790d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667323:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.667329:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae790d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667336:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae790d lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667350:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3503a3aa00) 00010000:00010000:2.0:1763343037.667353:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.667359:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae790d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667364:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae790d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667382:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7914 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667387:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7914 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667392:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7914 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667396:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.667399:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7914 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667404:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7914 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667415:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:2.0:1763343037.667417:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.667420:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7914 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667425:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7914 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343037.667478:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7906 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9859 expref: 267 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.667500:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae791b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9859 expref: 266 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.667508:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:2.0:1763343037.667511:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343037.667513:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c600, rc 0) 00000100:00100000:1.0:1763343037.668506:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56908:x1848997993614848:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2357us (2538us total) trans 8589940100 rc 0/0 00000100:00100000:1.0:1763343037.668518:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9452 00000100:00100000:0.0:1763343037.671069:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.671161:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993615104 00000100:00100000:1.0:1763343037.671176:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993615104 00000100:00100000:1.0:1763343037.671285:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3228 00000100:00100000:1.0:1763343037.671299:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56905:x1848997993615104:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343037.672258:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56905:x1848997993615104:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 956us (1197us total) trans 8589940101 rc 0/0 00000100:00100000:1.0:1763343037.672270:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3228 00000100:00100000:0.0:1763343037.675011:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.675128:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993615232 00000100:00100000:1.0:1763343037.675140:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993615232 00000100:00100000:1.0:1763343037.675215:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6642 00000100:00100000:1.0:1763343037.675228:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+48:2429:x1848997993615232:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343037.675252:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.675282:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae7929 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9860 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343037.675314:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343037.675340:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.675344:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.675355:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae7929 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9860 expref: 49 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343037.675376:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae7929 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9860 expref: 49 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343037.675392:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00000100:00100000:1.0:1763343037.675455:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+49:2429:x1848997993615232:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 230us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.675463:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6642 00000100:00100000:0.0:1763343037.683354:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.684208:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993615360 00000100:00100000:2.0:1763343037.684224:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993615360 00000100:00100000:1.0:1763343037.686001:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6643 00000100:00100000:1.0:1763343037.686028:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993615360:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343037.686057:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.686089:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae7930 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9867 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343037.686121:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343037.686149:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.686151:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.686163:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae7930 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9867 expref: 15 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343037.686181:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae7930 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9867 expref: 15 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343037.686197:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:1.0:1763343037.686288:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993615360:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 270us (2950us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.686297:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6643 00000100:00100000:2.0:1763343037.688809:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.689507:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993615616 00000100:00100000:1.0:1763343037.689524:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993615616 00000100:00100000:1.0:1763343037.689598:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3229 00000100:00100000:1.0:1763343037.689609:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56905:x1848997993615616:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343037.689958:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56905:x1848997993615616:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 349us (1162us total) trans 8589940102 rc 0/0 00000100:00100000:1.0:1763343037.689968:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3229 00000100:00100000:0.0:1763343037.692321:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.692395:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993615872 00000100:00100000:2.0:1763343037.692408:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993615872 00000100:00100000:2.0:1763343037.692475:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3230 00000100:00100000:2.0:1763343037.692486:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56908:x1848997993615872:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343037.692803:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56908:x1848997993615872:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 319us (497us total) trans 8589940103 rc 0/0 00000100:00100000:2.0:1763343037.692811:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3230 00000100:00100000:2.0:1763343037.696543:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.697695:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.699412:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993616128 00000100:00100000:1.0:1763343037.699431:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993616128 00000100:00100000:0.0:1763343037.700952:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993616384 00000100:00100000:0.0:1763343037.700969:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993616384 00000100:00100000:0.0:1763343037.701066:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9453 00000100:00100000:0.0:1763343037.701079:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56908:x1848997993616128:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343037.701109:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.701137:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae7937 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac986e expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.701297:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae793e lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.701314:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae791b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9859 expref: 271 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.701323:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae793e lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.701394:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae791b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9859 expref: 271 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.701411:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae791b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9859 expref: 271 pid: 6523 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1763343037.701427:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010283520:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343037.701561:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3508539e40 going to sleep for 11 seconds 00000100:00100000:1.0:1763343037.701645:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9454 00000100:00100000:1.0:1763343037.701659:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:55941:x1848997993616384:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343037.701672:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.701675:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343037.701688:0:6523:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae791b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9859 expref: 271 pid: 6523 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343037.701711:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:1.0:1763343037.701717:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae793e lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.701726:0:6523:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae793e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.701734:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae793e lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.701752:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343037.701761:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7945 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9875 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.701817:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae794c lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.701827:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae794c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343037.701835:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae794c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343037.701851:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1eb:0x0]: returning size 0 00010000:00010000:1.0:1763343037.702008:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7945 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9875 expref: 274 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.702031:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae794c lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9875 expref: 273 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.702038:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:1.0:1763343037.702041:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1763343037.702044:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343037.702114:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:55941:x1848997993616384:12345-192.168.204.21@tcp:101:bash.0 Request processed in 459us (4425us total) trans 8589940104 rc 0/0 00000100:00100000:1.0:1763343037.702122:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9454 00010000:00010000:0.0:1763343037.708178:0:28422:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@00000000825f903c x1848998010283520) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae791b lrc: 1/0,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9859 expref: 272 pid: 6523 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.708212:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae791b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9859 expref: 272 pid: 6523 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1763343037.708233:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010283520:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343037.708277:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:0.0:1763343037.708288:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae793e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.708297:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae793e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.708303:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae793e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343037.708339:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1eb:0x0]: returning size 0 00010000:00010000:0.0:1763343037.708526:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae7937 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac986e expref: 273 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.708551:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae793e lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac986e expref: 272 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.708559:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:0.0:1763343037.708562:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763343037.708565:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340683d400, rc 0) 00000100:00100000:0.0:1763343037.708689:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56908:x1848997993616128:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 7611us (12161us total) trans 8589940105 rc 0/0 00000100:00100000:0.0:1763343037.708700:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9453 00000100:00100000:2.0:1763343037.712157:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.712900:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993616512 00000100:00100000:0.0:1763343037.712917:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993616512 00000100:00100000:0.0:1763343037.713000:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9455 00000100:00100000:0.0:1763343037.713012:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:55941:x1848997993616512:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343037.713041:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.713073:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae7961 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac987c expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.713124:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7968 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.713143:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7968 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.713157:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7968 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.713303:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae7961 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac987c expref: 274 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.713328:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7968 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac987c expref: 273 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.713338:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:0.0:1763343037.713341:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343037.713345:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403528c00, rc 0) 00000100:00100000:0.0:1763343037.713422:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:55941:x1848997993616512:12345-192.168.204.21@tcp:101:bash.0 Request processed in 412us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.713430:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9455 00000100:00100000:2.0:1763343037.715854:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.715921:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.715991:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993616896 00000100:00100000:3.0:1763343037.716009:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993616896 00000100:00100000:0.0:1763343037.716563:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993616768 00000100:00100000:0.0:1763343037.716570:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993616768 00000100:00100000:3.0:1763343037.716712:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 410 00000100:00100000:3.0:1763343037.716729:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:2430:x1848997993616896:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343037.716751:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343037.716843:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae793e lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac986e expref: 274 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.716867:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:3.0:1763343037.716873:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343037.716955:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:2430:x1848997993616896:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 229us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.716962:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 410 00000100:00100000:0.0:1763343037.717149:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3231 00000100:00100000:0.0:1763343037.717160:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3509229450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56908:x1848997993616768:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343037.718296:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3509229450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56908:x1848997993616768:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1130us (2449us total) trans 8589940106 rc 0/0 00000100:00100000:1.0:1763343037.718308:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3231 00000100:00100000:2.0:1763343037.724849:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.724910:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.725058:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993617280 00000100:00100000:0.0:1763343037.725073:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993617280 00000100:00100000:0.0:1763343037.725154:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9456 00000100:00100000:0.0:1763343037.725168:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:55941:x1848997993617280:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343037.725257:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343037.725308:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae794c lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9875 expref: 273 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.725331:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:0.0:1763343037.725336:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343037.725587:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae796f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.725609:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae796f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.725679:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae796f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000001:00080000:0.0:1763343037.725740:0:28422:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940107 00000004:00010000:0.0:1763343037.725766:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002afc79a2 reply state 00000000df403c65 transno 8589940108 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae796f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.725780:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae796f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.725787:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:0.0:1763343037.725790:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343037.725794:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343037.725918:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:55941:x1848997993617280:12345-192.168.204.21@tcp:36:bash.0 Request processed in 750us (1004us total) trans 8589940108 rc 0/0 00000100:00100000:0.0:1763343037.725926:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9456 00000020:00080000:0.0:1763343037.725933:0:28422:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343037.726026:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993617024 00000100:00100000:1.0:1763343037.726033:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993617024 00000100:00100000:1.0:1763343037.726081:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3232 00000100:00100000:1.0:1763343037.726090:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:56908:x1848997993617024:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:1.0:1763343037.726184:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:56908:x1848997993617024:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 95us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.726195:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3232 00000100:00100000:2.0:1763343037.732139:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.732544:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993617408 00000100:00100000:0.0:1763343037.732559:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993617408 00000100:00100000:0.0:1763343037.732667:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9457 00000100:00100000:0.0:1763343037.732687:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:55941:x1848997993617408:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343037.732720:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.733019:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7976 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9883 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.733103:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7976 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9883 expref: 276 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.733126:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7976 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9883 expref: 276 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.733147:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:1.0:1763343037.733151:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343037.733157:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343037.733242:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:55941:x1848997993617408:12345-192.168.204.21@tcp:101:bash.0 Request processed in 556us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.733249:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9457 00000100:00100000:3.0:1763343037.735996:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.738376:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993617664 00000100:00100000:1.0:1763343037.738398:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993617664 00000100:00100000:1.0:1763343037.738500:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9458 00000100:00100000:1.0:1763343037.738513:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:55941:x1848997993617664:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343037.738546:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.738550:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343037.738587:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7976 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9883 expref: 276 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.738611:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:1.0:1763343037.738617:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343037.738715:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae797d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac988a expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.738782:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae7984 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.738801:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae7984 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.738812:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae7984 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:1.0:1763343037.739127:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1462, 88 off123312 00000004:00080000:1.0:1763343037.739139:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231406517210ns, next at 1232093431049ns, rc = 0 00000040:00080000:1.0:1763343037.739162:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1463, 88 off123312 00000004:00080000:1.0:1763343037.739167:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231406545767ns, next at 1232093460684ns, rc = 0 00000040:00080000:1.0:1763343037.739208:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1464, 88 off123400 00000004:00080000:1.0:1763343037.739213:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231406591872ns, next at 1232093460684ns, rc = 0 00000040:00080000:1.0:1763343037.739231:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1463, 88 off123400 00000004:00080000:1.0:1763343037.739235:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231406614282ns, next at 1232093431049ns, rc = 0 00000001:00080000:2.0:1763343037.741743:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940109 is committed 00000004:00080000:2.0:1763343037.741765:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 963 committed 00000004:00080000:2.0:1763343037.742570:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 962 committed 00000004:00080000:2.0:1763343037.742788:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 961 committed 00010000:00010000:3.0:1763343037.742918:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7849 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.742933:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7849 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.742942:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7849 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.742949:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343037.742955:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7849 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.742964:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7849 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00000100:00100000:1.0:1763343037.742974:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010283904:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763343037.742984:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:3.0:1763343037.742988:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343037.742993:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7849 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.743001:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7849 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343037.743024:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cdc00/0x607405d401ae78c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.743029:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cdc00/0x607405d401ae78c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.743034:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cdc00/0x607405d401ae78c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.743039:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340c0cdc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343037.743042:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cdc00/0x607405d401ae78c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.743047:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cdc00/0x607405d401ae78c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.743053:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:3.0:1763343037.743055:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343037.743057:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cdc00/0x607405d401ae78c7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.743062:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340c0cdc00/0x607405d401ae78c7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343037.743064:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343037.743082:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae796f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.743088:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae796f lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.743097:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae796f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.743101:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343037.743103:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae796f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343037.743107:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010284416:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763343037.743109:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae796f lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.743117:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:3.0:1763343037.743119:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343037.743122:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae796f lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343037.743126:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343037.743128:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae796f lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343037.743148:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010283776:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.743148:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343037.743153:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010284032:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.743170:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343037.743188:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343037.743205:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010284288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.743212:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010283904 00000100:00100000:1.0:1763343037.743221:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010283904 00000100:00100000:3.0:1763343037.743224:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343037.743240:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1763343037.743246:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010283648:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343037.743268:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763343037.743415:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 962 committed 00000100:00100000:0.0:1763343037.744378:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010284672:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343037.745536:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010284416 00000100:00100000:1.0:1763343037.745547:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010284032 00000100:00100000:1.0:1763343037.745555:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010284032 00000100:00100000:0.0:1763343037.745555:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010284416 00000100:00100000:1.0:1763343037.745610:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010283776 00000100:00100000:1.0:1763343037.745614:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010283776 00000100:00100000:0.0:1763343037.745637:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010284288 00000100:00100000:0.0:1763343037.745642:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010284288 00000100:00100000:1.0:1763343037.745652:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010283648 00000100:00100000:1.0:1763343037.745655:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010283648 00000100:00100000:0.0:1763343037.745668:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6644 00000100:00100000:3.0:1763343037.745783:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010284160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343037.745837:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343037.745865:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010284800:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343037.745903:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343037.745937:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010284160 00000100:00100000:3.0:1763343037.745941:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010284160 00000100:00100000:0.0:1763343037.746024:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+93:3659:x1848998010283904:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343037.746025:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010284800 00000100:00100000:2.0:1763343037.746028:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010284800 00002000:00080000:0.0:1763343037.746062:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:688 count 1 00000100:00100000:1.0:1763343037.746071:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6645 00000100:00100000:1.0:1763343037.746078:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+93:3659:x1848998010284032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763343037.746090:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:691 count 1 00010000:00010000:0.0:1763343037.746099:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae798b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.746102:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340471ee00/0x607405d401ae7992 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.746125:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae77e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f7 expref: 48 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.746125:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae771c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b8 expref: 48 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.746135:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343037.746135:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343037.746138:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343037.746138:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343037.746143:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340471ee00/0x607405d401ae7992 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.746143:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae798b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.746181:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae77e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f7 expref: 48 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.746181:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae771c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b8 expref: 48 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.746199:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae771c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b8 expref: 48 pid: 8408 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1763343037.746213:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406553800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010285184:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343037.746291:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3508539e40 going to sleep for 11 seconds 00000100:00100000:0.0:1763343037.746311:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6646 00000100:00100000:0.0:1763343037.746318:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+93:3659:x1848998010284416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343037.746495:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343037.746498:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343037.746502:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343037.746504:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343037.746506:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343037.746548:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+94:3659:x1848998010284416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 230us (3420us total) trans 17179871647 rc 0/0 00000100:00100000:0.0:1763343037.746555:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6646 00000100:00100000:0.0:1763343037.746575:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6647 00000100:00100000:0.0:1763343037.746580:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+93:3658:x1848998010283776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343037.746590:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:687 count 1 00010000:00010000:0.0:1763343037.746600:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae7999 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.746611:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae773f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97c6 expref: 48 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.746618:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343037.746639:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343037.746642:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae7999 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.746660:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae773f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97c6 expref: 48 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.746773:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae77e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f7 expref: 48 pid: 28996 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343037.746786:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010285312:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343037.746826:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b540 going to sleep for 11 seconds 00000100:00100000:1.0:1763343037.746848:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6648 00000100:00100000:1.0:1763343037.746856:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+93:3658:x1848998010284288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.746977:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+94:3658:x1848998010284288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (3750us total) trans 17179871648 rc 0/0 00000100:00100000:1.0:1763343037.746983:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6648 00000100:00100000:1.0:1763343037.746995:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6649 00000100:00100000:1.0:1763343037.747001:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3658:x1848998010283648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343037.747013:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:685 count 1 00010000:00010000:1.0:1763343037.747029:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae79a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.747040:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae74c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96f4 expref: 14 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.747047:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343037.747050:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343037.747052:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae79a0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.747074:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae74c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96f4 expref: 14 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.747083:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae74c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96f4 expref: 14 pid: 28648 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343037.747095:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406ab2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010285568:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343037.747121:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1763343037.747206:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae7984 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac988a expref: 252 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.747218:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:1.0:1763343037.747221:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343037.747236:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae797d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac988a expref: 252 pid: 28422 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343037.747261:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae7984 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac988a expref: 251 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.747309:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:1.0:1763343037.747313:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343037.747315:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340471e400, rc 0) 00000100:00100000:1.0:1763343037.747344:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:55941:x1848997993617664:12345-192.168.204.21@tcp:101:bash.0 Request processed in 8834us (11364us total) trans 8589940109 rc 0/0 00000100:00100000:1.0:1763343037.747351:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9458 00000100:00100000:1.0:1763343037.747422:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010284544:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343037.747458:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.747481:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010285056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343037.747500:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.747519:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343037.747525:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010284928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343037.747544:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.747564:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010284544 00000100:00100000:1.0:1763343037.747570:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010284544 00000100:00100000:1.0:1763343037.747592:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010285056 00000100:00100000:1.0:1763343037.747595:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010285056 00000100:00100000:1.0:1763343037.747604:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010284928 00000100:00100000:1.0:1763343037.747606:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010284928 00000100:00100000:1.0:1763343037.747649:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6650 00000100:00100000:1.0:1763343037.747658:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3660:x1848998010284544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343037.747683:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:686 count 1 00010000:00010000:1.0:1763343037.747699:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae79a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.747713:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352cc00/0x607405d401ae76f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97aa expref: 14 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.747720:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343037.747721:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343037.747724:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae79a7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.747743:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352cc00/0x607405d401ae76f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97aa expref: 14 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.747753:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340352cc00/0x607405d401ae76f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97aa expref: 14 pid: 15756 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343037.747763:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010285696:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343037.747799:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343037.747816:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6651 00000100:00100000:1.0:1763343037.747823:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3660:x1848998010285056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763343037.747937:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343037.747941:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343037.747943:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343037.747945:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343037.747948:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343037.747984:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3660:x1848998010285056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 161us (481us total) trans 21474838943 rc 0/0 00000100:00100000:1.0:1763343037.747994:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6651 00000100:00100000:1.0:1763343037.748009:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6652 00000100:00100000:1.0:1763343037.748015:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3660:x1848998010284928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343037.748084:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3660:x1848998010284928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (538us total) trans 21474838944 rc 0/0 00000100:00100000:1.0:1763343037.748090:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6652 00000004:00080000:1.0:1763343037.748133:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406552680/2, rc 0, transno 21474838944 00000100:00100000:1.0:1763343037.748140:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010284928:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343037.748157:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406550700/2, rc 0, transno 21474838943 00000100:00100000:1.0:1763343037.748161:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010285056:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343037.748190:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340ccc0e00/2, rc 0, transno 17179871647 00000100:00100000:1.0:1763343037.748195:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010284416:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.748351:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.748390:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010284672 00000100:00100000:1.0:1763343037.748396:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010284672 00000100:00100000:1.0:1763343037.748420:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6653 00000100:00100000:1.0:1763343037.748426:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3657:x1848998010284672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343037.748439:0:10294:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:689 count 1 00010000:00010000:1.0:1763343037.748453:0:10294:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae79ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.748467:0:10294:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae77f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9805 expref: 14 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.748474:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343037.748476:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343037.748479:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae79ae lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.748504:0:10294:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae77f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9805 expref: 14 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.748513:0:10294:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae77f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9805 expref: 14 pid: 8408 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343037.748524:0:10294:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10294:1848998010285824:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343037.748537:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae773f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97c6 expref: 48 pid: 15756 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1763343037.748551:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406550380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1848998010285440:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343037.748552:0:10294:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b600 going to sleep for 11 seconds 00000100:00100000:0.0:1763343037.748577:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35085399c0 going to sleep for 11 seconds 00000004:00080000:1.0:1763343037.748837:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340ccc2680/2, rc 0, transno 17179871648 00000100:00100000:1.0:1763343037.748843:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010284288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343037.749255:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6654 00000100:00100000:3.0:1763343037.749270:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+93:3658:x1848998010284160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343037.749291:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:692 count 1 00002000:00010000:3.0:1763343037.749323:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343037.749330:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae79b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.749340:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.749342:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.749348:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae79b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.749362:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae79b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.749372:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae79b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.749380:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae79b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.749401:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343037.749640:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.749662:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+94:3658:x1848998010284160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 397us (3824us total) trans 17179871649 rc 0/0 00000100:00100000:0.0:1763343037.749668:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993617920 00000100:00100000:3.0:1763343037.749670:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6654 00000100:00100000:0.0:1763343037.749674:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993617920 00010000:00010000:3.0:1763343037.749694:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343037.749701:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae79b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.749710:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501481200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343037.749715:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae79b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343037.749718:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9459 00000100:00100000:0.0:1763343037.749724:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+251:56909:x1848997993617920:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343037.749727:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae79b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.749738:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.749745:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae79b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.749752:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3501481200/0x607405d401ae79b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.749756:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae79bc lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9891 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.749772:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343037.749774:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343037.749775:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343037.749797:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340ccc3800/2, rc 0, transno 17179871649 00000100:00100000:3.0:1763343037.749802:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010284160:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343037.751191:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6655 00000100:00100000:2.0:1763343037.751219:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010284800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343037.751257:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:690 count 1 00002000:00010000:2.0:1763343037.751295:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343037.751303:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d200/0x607405d401ae79c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.751319:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.751321:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.751328:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d200/0x607405d401ae79c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.751343:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352d200/0x607405d401ae79c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.751360:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d200/0x607405d401ae79c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.751369:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d200/0x607405d401ae79c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.751398:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343037.751418:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343037.751425:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352d200/0x607405d401ae79c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.751432:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343037.751437:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d200/0x607405d401ae79c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.751445:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d200/0x607405d401ae79c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.751460:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352d200/0x607405d401ae79c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.751467:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d200/0x607405d401ae79c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.751486:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343037.751488:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343037.751491:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343037.751816:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3658:x1848998010284800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 610us (5910us total) trans 21474838945 rc 0/0 00000100:00100000:2.0:1763343037.751825:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6655 00000004:00080000:3.0:1763343037.752037:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035ea300/2, rc 0, transno 21474838945 00000100:00100000:3.0:1763343037.752046:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010284800:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1763343037.752830:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae79ca lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.752853:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae79ca lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.752867:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae79ca lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.752893:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae79d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.752901:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae79d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.752907:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae79d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753043:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae79d8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753053:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae79d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753059:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae79d8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343037.753072:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1eb:0x0]: returning size 2 00010000:00010000:0.0:1763343037.753184:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae79ca lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753191:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae79ca lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753196:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae79ca lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753202:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae79ca lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753208:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.753213:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae79ca lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753219:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae79ca lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753231:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:0.0:1763343037.753235:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.753240:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae79ca lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753246:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae79ca lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753258:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae79d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753264:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae79d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753273:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae79d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753278:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dcc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.753280:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae79d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753286:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae79d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753293:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:0.0:1763343037.753295:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.753298:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae79d1 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753303:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae79d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.753362:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae79bc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9891 expref: 254 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.753379:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae79d8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9891 expref: 253 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.753386:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:0.0:1763343037.753389:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343037.753391:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dda00, rc 0) 00000100:00100000:0.0:1763343037.753477:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56909:x1848997993617920:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3752us (3855us total) trans 8589940110 rc 0/0 00000100:00100000:0.0:1763343037.753485:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9459 00000100:00100000:2.0:1763343037.753901:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406553800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010285184:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343037.753933:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae798b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343037.753963:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406ab2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010285568:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343037.753984:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae79a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343037.754310:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010285696:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343037.754343:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae79a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343037.754549:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010285312:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343037.754564:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340471ee00/0x607405d401ae7992 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343037.758428:0:10294:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10294:1848998010285824:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343037.758428:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:1.0:1763343037.758469:0:10294:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae79ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343037.758473:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.758511:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993618176 00000100:00100000:0.0:1763343037.758520:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993618176 00000100:00100000:1.0:1763343037.758530:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.758552:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.758572:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:0.0:1763343037.758575:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae77e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f7 expref: 49 pid: 28996 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343037.758587:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.758604:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993618048 00000100:00100000:1.0:1763343037.758608:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.758608:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993618048 00000100:00100000:1.0:1763343037.758652:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993618816 00010000:00010000:0.0:1763343037.758653:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae771c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b8 expref: 50 pid: 8408 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343037.758656:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993618816 00000100:00100000:0.0:1763343037.758665:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993618304 00000100:00100000:0.0:1763343037.758668:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993618304 00010000:00010000:0.0:1763343037.758680:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae74c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96f4 expref: 16 pid: 28648 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1763343037.758691:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993618560 00000100:00100000:0.0:1763343037.758693:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993618560 00000100:00100000:1.0:1763343037.758699:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6656 00010000:00010000:0.0:1763343037.758703:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae77f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9805 expref: 17 pid: 8408 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343037.758709:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993618816:12345-192.168.204.21@tcp:101:bash.0 00000100:00100000:0.0:1763343037.758713:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993618432 00000100:00100000:0.0:1763343037.758714:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993618432 00010000:00010000:0.0:1763343037.758725:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352cc00/0x607405d401ae76f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97aa expref: 18 pid: 15756 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343037.758729:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763343037.758735:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993618688 00000100:00100000:0.0:1763343037.758737:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993618688 00010000:00010000:0.0:1763343037.758746:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae773f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97c6 expref: 51 pid: 15756 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343037.758757:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae79e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9898 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343037.758757:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3116 00000100:00100000:0.0:1763343037.758763:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+51:2429:x1848997993618176:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343037.758778:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343037.758783:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae77e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f7 expref: 51 pid: 28996 timeout: 1331 lvb_type: 0 00002000:00010000:1.0:1763343037.758784:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343037.758795:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae77e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f7 expref: 51 pid: 28996 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343037.758806:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.758808:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.758819:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae79e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9898 expref: 19 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.758820:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae77e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97f7 expref: 51 pid: 28996 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343037.758834:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae79e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9898 expref: 19 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.758849:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00010000:00010000:0.0:1763343037.758850:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.758851:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.758855:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340471ee00/0x607405d401ae7992 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.758862:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340471ee00/0x607405d401ae7992 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.758895:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343037.758952:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+50:2429:x1848997993618176:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 188us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.758961:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3116 00000100:00100000:0.0:1763343037.758983:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3117 00000100:00100000:0.0:1763343037.758990:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+49:2430:x1848997993618048:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343037.758998:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343037.759003:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae771c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b8 expref: 49 pid: 8408 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.759014:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae771c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b8 expref: 49 pid: 8408 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.759026:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92600/0x607405d401ae771c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97b8 expref: 49 pid: 8408 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.759035:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.759037:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.759041:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae798b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.759048:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae798b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.759067:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343037.759088:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+48:2430:x1848997993618048:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 98us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.759095:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3117 00000100:00100000:0.0:1763343037.759110:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3118 00000100:00100000:0.0:1763343037.759117:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993618304:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343037.759126:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343037.759130:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae74c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96f4 expref: 19 pid: 28648 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.759140:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae74c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96f4 expref: 19 pid: 28648 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.759153:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177800/0x607405d401ae74c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac96f4 expref: 19 pid: 28648 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.759163:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.759164:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.759168:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae79a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.759175:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae79a0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.759194:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343037.759213:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993618304:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 97us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.759220:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3118 00000100:00100000:0.0:1763343037.759234:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3119 00000100:00100000:0.0:1763343037.759241:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35188b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993618560:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343037.759249:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343037.759254:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae77f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9805 expref: 17 pid: 8408 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.759263:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae77f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9805 expref: 17 pid: 8408 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.759275:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae77f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9805 expref: 17 pid: 8408 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.759283:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.759285:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.759288:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae79ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.759295:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae79ae lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.759311:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343037.759331:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35188b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993618560:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 90us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.759338:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3119 00000100:00100000:0.0:1763343037.759385:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3120 00000100:00100000:0.0:1763343037.759391:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993618432:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343037.759399:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343037.759404:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340352cc00/0x607405d401ae76f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97aa expref: 15 pid: 15756 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.759412:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340352cc00/0x607405d401ae76f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97aa expref: 15 pid: 15756 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.759423:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352cc00/0x607405d401ae76f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97aa expref: 15 pid: 15756 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.759433:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.759434:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.759437:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae79a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.759444:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae79a7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.759464:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343037.759482:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993618432:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 91us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.759489:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3120 00000100:00100000:0.0:1763343037.759503:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3121 00000100:00100000:0.0:1763343037.759509:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+47:2429:x1848997993618688:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343037.759517:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343037.759522:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae773f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97c6 expref: 47 pid: 15756 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.759531:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae773f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97c6 expref: 47 pid: 15756 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343037.759542:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.759543:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343037.759547:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae7999 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.759553:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae7999 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.759564:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343037.759581:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+47:2429:x1848997993618688:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 72us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.759587:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3121 00010000:00010000:0.0:1763343037.759653:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae79a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.759663:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae79a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.759673:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae79a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.759682:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae79a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.759703:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343037.760020:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3658:x1848998010283648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13017us (16748us total) trans 21474838946 rc 0/0 00000100:00100000:0.0:1763343037.760028:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6649 00010000:00010000:0.0:1763343037.760055:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343037.760063:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae79a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760072:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343037.760077:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae79a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760087:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae79a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760100:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae79a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760108:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae79a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760126:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343037.760129:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343037.760131:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343037.760142:0:10294:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae79ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760151:0:10294:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae79ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760159:0:10294:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae79ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760165:0:10294:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae79ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760183:0:10294:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343037.760296:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3657:x1848998010284672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11869us (11944us total) trans 21474838947 rc 0/0 00000100:00100000:0.0:1763343037.760304:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6653 00010000:00010000:0.0:1763343037.760322:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343037.760327:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae79ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760335:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343037.760338:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae79ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760345:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae79ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760356:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae79ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760363:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae79ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760376:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343037.760378:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343037.760380:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343037.760422:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035e9180/2, rc 0, transno 21474838947 00000100:00100000:0.0:1763343037.760431:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010284672:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1763343037.760458:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae79a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760465:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae79a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760473:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae79a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760481:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae79a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760494:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343037.760656:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:55941:x1848997993618816:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1945us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.760663:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6656 00000100:00100000:0.0:1763343037.760757:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3660:x1848998010284544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13099us (13297us total) trans 21474838948 rc 0/0 00000100:00100000:0.0:1763343037.760764:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6650 00000004:00080000:0.0:1763343037.760799:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035ead80/2, rc 0, transno 21474838948 00000100:00100000:0.0:1763343037.760804:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010284544:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1763343037.760823:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae798b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760832:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae798b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760840:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae798b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760851:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae798b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.760865:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1763343037.760928:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340471ee00/0x607405d401ae7992 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.760938:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340471ee00/0x607405d401ae7992 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.760950:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340471ee00/0x607405d401ae7992 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.760957:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340471ee00/0x607405d401ae7992 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.760971:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1763343037.761025:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+95:3659:x1848998010283904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15004us (17960us total) trans 17179871650 rc 0/0 00000100:00100000:0.0:1763343037.761032:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6644 00000004:00080000:0.0:1763343037.761067:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340ccc2300/2, rc 0, transno 17179871650 00000100:00100000:0.0:1763343037.761072:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010283904:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.761078:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+94:3659:x1848998010284032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15000us (17906us total) trans 17179871651 rc 0/0 00000004:00080000:0.0:1763343037.761082:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340ccc3480/2, rc 0, transno 17179871651 00000100:00100000:1.0:1763343037.761085:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6645 00000100:00100000:0.0:1763343037.761085:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010284032:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763343037.761097:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1763343037.761102:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae79a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.761111:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343037.761114:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae79a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.761121:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae79a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.761136:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae79a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.761149:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae79a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761304:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343037.761312:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae798b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761319:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343037.761322:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae798b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761329:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae798b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761341:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae798b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761348:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae798b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761365:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343037.761369:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340471ee00/0x607405d401ae7992 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761375:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340471ee00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343037.761378:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340471ee00/0x607405d401ae7992 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761385:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340471ee00/0x607405d401ae7992 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761393:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340471ee00/0x607405d401ae7992 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761400:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340471ee00/0x607405d401ae7992 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761413:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343037.761414:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343037.761416:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343037.761448:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae773f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac97c6 expref: 46 pid: 15756 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343037.761459:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406550380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1848998010285440:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343037.761484:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae7999 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761498:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae7999 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761504:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae7999 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761512:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae7999 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761518:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae7999 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761535:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343037.761768:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+94:3658:x1848998010283776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15185us (18577us total) trans 17179871652 rc 0/0 00000100:00100000:2.0:1763343037.761774:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6647 00010000:00010000:2.0:1763343037.761793:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343037.761798:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae7999 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761804:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343037.761807:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae7999 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761814:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae7999 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761830:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae7999 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761836:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae7999 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.761849:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343037.761851:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343037.761852:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343037.762032:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343037.762069:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035e9f80/2, rc 0, transno 21474838946 00000100:00100000:3.0:1763343037.762076:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010283648:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763343037.762091:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340ccc0700/2, rc 0, transno 17179871652 00000100:00100000:3.0:1763343037.762095:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010283776:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763343037.763136:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343037.763143:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343037.763146:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343037.766973:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.767049:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.768514:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993619072 00000100:00100000:2.0:1763343037.768535:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993619072 00000100:00100000:2.0:1763343037.768613:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993618944 00000100:00100000:2.0:1763343037.768616:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993618944 00000100:00100000:2.0:1763343037.768665:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6657 00000100:00100000:2.0:1763343037.768678:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+46:55941:x1848997993619072:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343037.768704:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.768734:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae79ed lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac98a6 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343037.768767:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343037.768797:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.768800:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.768812:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae79ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98a6 expref: 47 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.768847:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae79ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98a6 expref: 47 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.768868:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d200, rc 0) 00000100:00100000:2.0:1763343037.768952:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+47:55941:x1848997993619072:12345-192.168.204.21@tcp:101:bash.0 Request processed in 276us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.768959:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6657 00000100:00100000:2.0:1763343037.768983:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6658 00000100:00100000:2.0:1763343037.768991:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993618944:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.768999:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.769012:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae79f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac989f expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343037.769073:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a354134c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1848998010285952:192.168.204.21@tcp:106: 00000100:00100000:2.0:1763343037.769144:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726600 going to sleep for 11 seconds 00000100:00100000:1.0:1763343037.773662:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.773774:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993619328 00000100:00100000:0.0:1763343037.773786:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993619328 00000100:00100000:1.0:1763343037.773817:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00002000:00010000:0.0:1763343037.773840:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/693 (0->18446744073709551615) 00002000:00100000:0.0:1763343037.773845:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3511f39c00 with x1848997993619328 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343037.773860:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3511f39c00. 00000100:00100000:0.0:1763343037.773904:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993619200 00000100:00100000:0.0:1763343037.773908:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993619200 00000100:00100000:3.0:1763343037.773913:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1618 00002000:00010000:0.0:1763343037.773923:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/691 (0->18446744073709551615) 00000100:00100000:3.0:1763343037.773926:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+47:2430:x1848997993619328:12345-192.168.204.21@tcp:10:bash.0 00002000:00100000:0.0:1763343037.773926:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406ab0700 with x1848997993619200 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343037.773933:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406ab0700. 00000100:00100000:0.0:1763343037.773959:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1619 00000100:00100000:0.0:1763343037.773966:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993619200:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343037.774140:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343037.774140:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343037.774145:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b5:0x0] updating lvb mtime from disk: 0 -> 1763343037 00002000:00010000:0.0:1763343037.774145:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb mtime from disk: 0 -> 1763343037 00002000:00010000:3.0:1763343037.774148:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2b5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343037.774148:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343037.774151:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b5:0x0] updating lvb ctime from disk: 0 -> 1763343037 00002000:00010000:0.0:1763343037.774151:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb ctime from disk: 0 -> 1763343037 00002000:00010000:3.0:1763343037.774154:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b5:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763343037.774154:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343037.774224:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993619200:12345-192.168.204.21@tcp:10:bash.0 Request processed in 257us (406us total) trans 21474838949 rc 0/0 00000100:00100000:0.0:1763343037.774232:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1619 00002000:00010000:0.0:1763343037.774237:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/691 (0->18446744073709551615) 00002000:00100000:0.0:1763343037.774240:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406ab0700 with x1848997993619200 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343037.774245:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406ab0700. 00002000:00010000:2.0:1763343037.774342:0:8407:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb atime: 0 -> 1763343037 00000100:00100000:2.0:1763343037.774356:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a354134c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1848998010285952:192.168.204.21@tcp:106: 00010000:00010000:2.0:1763343037.774401:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae79f4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac989f expref: 15 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343037.774429:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae79f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac989f expref: 15 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343037.774444:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352da00, rc 0) 00000100:00100000:2.0:1763343037.774827:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993618944:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 5834us (7775us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343037.774828:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+48:2430:x1848997993619328:12345-192.168.204.21@tcp:10:bash.0 Request processed in 902us (1205us total) trans 17179871653 rc 0/0 00000100:00100000:3.0:1763343037.774836:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1618 00000100:00100000:2.0:1763343037.774836:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6658 00002000:00010000:3.0:1763343037.774840:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/693 (0->18446744073709551615) 00002000:00100000:3.0:1763343037.774843:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3511f39c00 with x1848997993619328 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343037.774849:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3511f39c00. 00000100:00100000:1.0:1763343037.779213:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.779272:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.779354:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993619584 00000100:00100000:2.0:1763343037.779369:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993619584 00000100:00100000:2.0:1763343037.779445:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993619840 00000100:00100000:2.0:1763343037.779449:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993619840 00000100:00100000:2.0:1763343037.779469:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3233 00000100:00100000:2.0:1763343037.779482:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:55941:x1848997993619584:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343037.779543:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3234 00000100:00100000:0.0:1763343037.779555:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56909:x1848997993619840:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343037.780522:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:55941:x1848997993619584:12345-192.168.204.21@tcp:35:bash.0 Request processed in 1033us (1316us total) trans 8589940111 rc 0/0 00000100:00100000:0.0:1763343037.780522:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56909:x1848997993619840:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 961us (1239us total) trans 8589940112 rc 0/0 00000100:00100000:2.0:1763343037.780533:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3233 00000100:00100000:0.0:1763343037.780536:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3234 00000100:00100000:0.0:1763343037.792048:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.792175:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993620096 00000100:00100000:3.0:1763343037.792189:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993620096 00000100:00100000:3.0:1763343037.792280:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9460 00000100:00100000:3.0:1763343037.792292:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56909:x1848997993620096:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343037.792324:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.792353:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae79fb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac98ad expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.792521:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343037.792539:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae79d8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9891 expref: 256 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.792549:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343037.792592:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae79d8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9891 expref: 256 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.792607:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae79d8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9891 expref: 256 pid: 6525 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1763343037.792653:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010286080:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343037.794290:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c540 going to sleep for 11 seconds 00000100:00100000:1.0:1763343037.796062:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.796363:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993620352 00000100:00100000:2.0:1763343037.796377:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993620352 00010000:00010000:3.0:1763343037.796535:0:6525:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@000000007156d7a0 x1848998010286080) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae79d8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9891 expref: 257 pid: 6525 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343037.796562:0:6525:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae79d8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9891 expref: 257 pid: 6525 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343037.796595:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae79d8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9891 expref: 257 pid: 6525 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1763343037.796614:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010286080:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343037.796912:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9461 00000100:00100000:0.0:1763343037.796928:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56910:x1848997993620352:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:0.0:1763343037.797012:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763343037.797029:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340471e400/0x607405d401ae7984 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac988a expref: 256 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.797041:0:28422:0:(ldlm_lockd.c:1753:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 607405d401ae79d8) 00010000:00010000:0.0:1763343037.797048:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7968 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac987c expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.797060:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:0.0:1763343037.797066:0:28422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.797077:0:28422:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.797085:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.797109:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343037.797145:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7a09 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.797156:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7a09 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.797164:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7a09 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.797178:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7a10 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.797184:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7a10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.797190:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7a10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.797485:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:3.0:1763343037.797490:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.799368:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.799388:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343037.799425:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1eb:0x0]: returning size 5 00010000:00010000:2.0:1763343037.799651:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae79fb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ad expref: 256 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.799829:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a1e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.799847:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ad expref: 256 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.799855:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a1e lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.799918:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ad expref: 256 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.799937:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ad expref: 256 pid: 6525 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1763343037.799956:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406552d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010286208:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343037.800205:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 6/0,0 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ad expref: 255 pid: 6525 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.800214:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 6/0,0 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ad expref: 255 pid: 6525 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.800221:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480a00, rc 0) 00000100:00100000:0.0:1763343037.800892:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe900 going to sleep for 11 seconds 00000100:00100000:2.0:1763343037.800972:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56909:x1848997993620096:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8679us (8937us total) trans 8589940113 rc 0/0 00000100:00100000:2.0:1763343037.800987:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9460 00000100:00100000:1.0:1763343037.806040:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.806160:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406552d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010286208:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343037.806195:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a1e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343037.806270:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993620480 00000100:00100000:3.0:1763343037.806279:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993620480 00010000:00010000:3.0:1763343037.806395:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ad expref: 255 pid: 6525 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1763343037.806442:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3122 00000100:00100000:3.0:1763343037.806452:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:2429:x1848997993620480:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343037.806470:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343037.806477:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ad expref: 255 pid: 6525 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343037.806490:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ad expref: 255 pid: 6525 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343037.806519:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a02 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1eb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ad expref: 255 pid: 6525 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343037.806538:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:3.0:1763343037.806543:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a1e lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.806554:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a1e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.806562:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a1e lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.806591:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343037.806699:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:2429:x1848997993620480:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 246us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343037.806707:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3122 00010000:00010000:0.0:1763343037.806914:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a1e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.806921:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a1e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00080000:0.0:1763343037.807252:0:28422:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1eb:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763343037.807363:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a1e lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.807371:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a1e lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.807378:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a1e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.807385:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058ddc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.807389:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a1e lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.807397:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a1e lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.807408:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a3503a3ac00) 00010000:00010000:0.0:1763343037.807411:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343037.807415:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a1e lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.807427:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a1e lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.807449:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7a09 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.807455:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7a09 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.807460:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7a09 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.807464:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.807467:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7a09 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.807472:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7a09 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.807478:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:0.0:1763343037.807481:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.807483:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7a09 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.807488:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7a09 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343037.807499:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e0c6726a reply state 000000009d8b765f transno 8589940114 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7a10 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.807513:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7a10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.807519:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:0.0:1763343037.807522:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343037.807525:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343037.807581:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56910:x1848997993620352:12345-192.168.204.21@tcp:36:rm.0 Request processed in 10657us (11531us total) trans 8589940114 rc 0/0 00000100:00100000:0.0:1763343037.807589:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9461 00000100:00100000:1.0:1763343037.812885:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.813012:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993620608 00000100:00100000:0.0:1763343037.813026:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993620608 00000100:00100000:0.0:1763343037.813108:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9462 00000100:00100000:0.0:1763343037.813120:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56909:x1848997993620608:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343037.813153:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.813181:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7a25 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac98b4 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.813277:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a2c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.813294:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a2c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.813308:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a2c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343037.813367:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1eb:0x0]: returning size 5 00000004:00200000:0.0:1763343037.813372:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343037.813396:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a2c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.813426:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7a25 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98b4 expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.813446:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a2c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98b4 expref: 256 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.813456:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:0.0:1763343037.813461:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763343037.813465:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058ddc00, rc 0) 00000100:00100000:0.0:1763343037.815279:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56909:x1848997993620608:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2148us (2406us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.815293:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9462 00000100:00100000:0.0:1763343037.820416:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.825082:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993620864 00000100:00100000:1.0:1763343037.825105:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993620864 00000100:00100000:1.0:1763343037.825214:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9463 00000100:00100000:1.0:1763343037.825228:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56909:x1848997993620864:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343037.825274:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.825304:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a33 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac98bb expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.825486:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7a3a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.825506:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7a3a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.825519:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7a3a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343037.825533:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1eb:0x0]: returning size 5 00010000:00010000:1.0:1763343037.825725:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a33 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98bb expref: 259 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.825747:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7a3a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98bb expref: 258 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.825757:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:1.0:1763343037.825761:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343037.825766:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92a00, rc 0) 00000100:00100000:1.0:1763343037.825858:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56909:x1848997993620864:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 633us (5459us total) trans 8589940115 rc 0/0 00000100:00100000:1.0:1763343037.825867:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9463 00000100:00100000:1.0:1763343037.827500:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.827559:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993620992 00000100:00100000:2.0:1763343037.827572:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993620992 00000100:00100000:2.0:1763343037.827669:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9464 00000100:00100000:2.0:1763343037.827681:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56911:x1848997993620992:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.827707:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.827736:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7a48 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac98c2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.827824:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7a4f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.827838:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7a4f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.827851:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7a4f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.827860:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7a56 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.827867:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7a56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.827887:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7a56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.827943:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7a4f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.827951:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7a4f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.827958:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7a4f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.827964:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7a4f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.827969:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.827974:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7a4f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.827981:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7a4f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.827994:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289100) 00010000:00010000:2.0:1763343037.827997:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.828002:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7a4f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.828008:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7a4f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.828023:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7a56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.828028:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7a56 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.828033:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7a56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.828038:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.828040:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7a56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.828049:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7a56 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.828056:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:2.0:1763343037.828058:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.828061:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7a56 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.828066:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7a56 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.828094:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7a48 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98c2 expref: 259 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.828104:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289100) 00010000:00010000:2.0:1763343037.828106:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343037.828109:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7a48 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98c2 expref: 259 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.828122:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352da00, rc 0) 00000100:00100000:2.0:1763343037.828194:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56911:x1848997993620992:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 516us (706us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343037.828202:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9464 00000100:00100000:0.0:1763343037.832914:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.833014:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993621120 00000100:00100000:2.0:1763343037.833027:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993621120 00000100:00100000:1.0:1763343037.833216:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6659 00000100:00100000:1.0:1763343037.833230:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2431:x1848997993621120:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:1.0:1763343037.833298:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.833327:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae79e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9898 expref: 14 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.833337:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343037.833339:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343037.833344:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a5d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.833392:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae79e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9898 expref: 14 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.833408:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae79e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9898 expref: 14 pid: 28648 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343037.833425:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010286336:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343037.833577:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1763343037.836913:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.837069:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.837819:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993621248 00000100:00100000:1.0:1763343037.837834:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993621248 00000100:00100000:3.0:1763343037.837900:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993621376 00000100:00100000:3.0:1763343037.837906:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993621376 00000100:00100000:1.0:1763343037.837934:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9465 00000100:00100000:1.0:1763343037.837947:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56911:x1848997993621248:12345-192.168.204.21@tcp:101:lfs.0 00002000:00100000:3.0:1763343037.837957:0:24021:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x2b3:0x0] (0->4) req@ffff9a3406550380 x1848997993621376/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:533/0 lens 496/0 e 0 to 0 dl 1763343048 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343037.837969:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406550380 with x1848997993621376 ext(0->4) 00010000:00010000:1.0:1763343037.837974:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.837982:0:24021:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae79e6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9898 expref: 15 pid: 28648 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343037.838001:0:24021:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae79e6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9898 expref: 15 pid: 28648 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343037.838005:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7a64 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac98c9 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343037.838016:0:24021:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a3406550380 00000100:00100000:3.0:1763343037.838044:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 108 00000100:00100000:3.0:1763343037.838052:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993621376:12345-192.168.204.21@tcp:4:bash.0 00010000:00010000:1.0:1763343037.838103:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7a6b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838127:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7a6b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838141:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7a6b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838155:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7a72 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838163:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7a72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838170:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7a72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838223:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7a6b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838231:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7a6b lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838239:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7a6b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838246:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.838252:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7a6b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838261:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7a6b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838276:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421200) 00010000:00010000:1.0:1763343037.838279:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.838286:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7a6b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838293:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7a6b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838310:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7a72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838316:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7a72 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838321:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7a72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838325:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.838327:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7a72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838334:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7a72 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838342:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:1.0:1763343037.838346:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.838350:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7a72 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838356:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7a72 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.838404:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7a64 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98c9 expref: 259 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343037.838414:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010286336:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343037.838419:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421200) 00010000:00010000:1.0:1763343037.838424:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.838430:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7a64 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98c9 expref: 259 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.838449:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00010000:00010000:2.0:1763343037.838452:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343037.838529:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56911:x1848997993621248:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 584us (1632us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343037.838541:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9465 00000100:00100000:2.0:1763343037.842695:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993621376:12345-192.168.204.21@tcp:4:bash.0 Request processed in 4626us (5607us total) trans 21474838950 rc 0/0 00000100:00100000:2.0:1763343037.842713:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 108 00002000:00100000:2.0:1763343037.842732:0:24021:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x2b3:0x0] (0->4) req@ffff9a3406550380 x1848997993621376/t21474838950(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:533/0 lens 496/448 e 0 to 0 dl 1763343048 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343037.842743:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406550380 with x1848997993621376 ext(0->4) 00010000:00010000:2.0:1763343037.842754:0:24021:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae79e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9898 expref: 17 pid: 28648 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.842775:0:24021:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae79e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9898 expref: 17 pid: 28648 timeout: 1331 lvb_type: 0 00002000:00010000:2.0:1763343037.842784:0:24021:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a3406550380 00000100:00100000:0.0:1763343037.845110:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.845498:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993621504 00000100:00100000:2.0:1763343037.845512:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993621504 00000100:00100000:2.0:1763343037.847250:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9466 00000100:00100000:2.0:1763343037.847387:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56911:x1848997993621504:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.847419:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.847452:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7a79 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac98d0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.847566:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7a80 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.847582:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7a80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343037.847597:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7a80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343037.847687:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343037.847694:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343037.847741:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7a79 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98d0 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.847764:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7a80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98d0 expref: 259 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.847780:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289100) 00010000:00010000:2.0:1763343037.847783:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343037.847786:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c800, rc 0) 00000100:00100000:2.0:1763343037.847861:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56911:x1848997993621504:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 599us (2766us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.847869:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9466 00010000:00010000:2.0:1763343037.853388:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343037.855342:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.855468:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993621632 00000100:00100000:2.0:1763343037.855482:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993621632 00010000:00010000:2.0:1763343037.855546:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae79e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9898 expref: 17 pid: 28648 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343037.855604:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3123 00000100:00100000:2.0:1763343037.855636:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993621632:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343037.855660:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763343037.855686:0:6509:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763343037.855691:0:6509:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343037.855698:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae79e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9898 expref: 17 pid: 28648 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.855715:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae79e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9898 expref: 17 pid: 28648 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.855747:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae79e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9898 expref: 17 pid: 28648 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343037.855767:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.855769:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.855776:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.855789:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a5d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.855834:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343037.855913:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993621632:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 296us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.855921:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3123 00010000:00010000:1.0:1763343037.855954:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.855966:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.855994:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.856004:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.856013:0:28996:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.856022:0:28996:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343037.856027:0:28996:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.856036:0:28996:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.856131:0:28996:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a5d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.856142:0:28996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92200/0x607405d401ae7a5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343037.856207:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2431:x1848997993621120:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 22980us (23307us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.856217:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6659 00000100:00100000:0.0:1763343037.856317:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.856388:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993621760 00000100:00100000:3.0:1763343037.856395:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993621760 00000100:00100000:3.0:1763343037.856451:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9467 00000100:00100000:3.0:1763343037.856460:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56911:x1848997993621760:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343037.856481:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.856505:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a87 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac98d7 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.856903:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7a8e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.856919:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7a8e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.856930:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7a8e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.856941:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7a95 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.856948:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7a95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.856954:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7a95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.857004:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7a8e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.857010:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7a8e lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.857016:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7a8e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.857021:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343037.857026:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7a8e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.857032:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7a8e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.857048:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289100) 00010000:00010000:3.0:1763343037.857052:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343037.857056:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7a8e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.857062:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7a8e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.857074:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7a95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.857080:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7a95 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.857085:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7a95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.857090:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343037.857093:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7a95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.857099:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7a95 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.857106:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:3.0:1763343037.857108:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343037.857112:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7a95 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.857117:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7a95 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343037.857145:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a87 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98d7 expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.857156:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289100) 00010000:00010000:3.0:1763343037.857159:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343037.857163:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7a87 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98d7 expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.857172:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480a00, rc 0) 00000100:00100000:3.0:1763343037.857227:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56911:x1848997993621760:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 767us (910us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343037.857233:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9467 00000100:00100000:0.0:1763343037.862052:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.862513:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993622272 00000100:00100000:3.0:1763343037.862529:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993622272 00000100:00100000:0.0:1763343037.863590:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9468 00000100:00100000:0.0:1763343037.863612:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56909:x1848997993622272:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343037.863708:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343037.863757:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7a2c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98b4 expref: 259 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.863786:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:0.0:1763343037.863793:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343037.863843:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7a9c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.863861:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7a9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.863884:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7a9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:0.0:1763343037.864193:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1464, 88 off123488 00000004:00080000:0.0:1763343037.864203:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231531581751ns, next at 1232093431049ns, rc = 0 00000040:00080000:0.0:1763343037.864258:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1465, 88 off123488 00000004:00080000:0.0:1763343037.864263:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231531642379ns, next at 1232093460684ns, rc = 0 00000040:00080000:0.0:1763343037.864290:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1466, 88 off123576 00000004:00080000:0.0:1763343037.864295:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231531674614ns, next at 1232093460684ns, rc = 0 00000040:00080000:0.0:1763343037.864305:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1465, 88 off123576 00000004:00080000:0.0:1763343037.864308:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231531687592ns, next at 1232093431049ns, rc = 0 00000100:00100000:0.0:1763343037.866178:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.867605:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993622016 00000100:00100000:2.0:1763343037.867696:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993622016 00000100:00100000:1.0:1763343037.869040:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9469 00000100:00100000:0.0:1763343037.869312:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56911:x1848997993622016:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343037.869344:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.869347:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343037.869386:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7a80 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98d0 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.869411:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289100) 00010000:00010000:0.0:1763343037.869425:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343037.869451:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7aa3 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac98de expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.869592:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7aaa lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.869608:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7aaa lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.870170:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7aaa lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.870189:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ab1 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.870198:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.870206:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.870826:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae7ab8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.870841:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae7ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.870849:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae7ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343037.870862:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ec:0x0]: returning size 0 00010000:00010000:0.0:1763343037.870912:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7aaa lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.870920:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7aaa lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.870926:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7aaa lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.870933:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7aaa lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.870939:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.870945:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7aaa lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.870953:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7aaa lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.870965:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343037.870969:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.870974:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7aaa lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.870981:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7aaa lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00010000:0.0:1763343037.870995:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009e9b709a reply state 0000000080c86dec transno 8589940117 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.871007:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ab1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.871013:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:0.0:1763343037.871016:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343037.871019:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343037.871060:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7aa3 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98de expref: 262 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.871083:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae7ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98de expref: 261 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.871090:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a34037c4d00) 00010000:00010000:0.0:1763343037.871093:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343037.871096:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd000, rc 0) 00000100:00100000:0.0:1763343037.871204:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56911:x1848997993622016:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2149us (5038us total) trans 8589940117 rc 0/0 00000100:00100000:0.0:1763343037.871215:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9469 00000001:00080000:3.0:1763343037.872287:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940116 is committed 00000004:00080000:3.0:1763343037.872300:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 965 committed 00000004:00080000:3.0:1763343037.872317:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 964 committed 00000004:00080000:3.0:1763343037.872330:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 963 committed 00000004:00080000:3.0:1763343037.872333:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 964 committed 00000100:00100000:2.0:1763343037.872601:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a354134df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010286848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343037.872704:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343037.872747:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343037.872752:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a354134c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010286720:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343037.872776:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343037.872811:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010286848 00000100:00100000:2.0:1763343037.872821:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010286848 00000100:00100000:2.0:1763343037.872866:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010286720 00000100:00100000:2.0:1763343037.872869:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010286720 00000100:00100000:2.0:1763343037.872899:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6660 00000100:00100000:2.0:1763343037.872909:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3660:x1848998010286848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763343037.873084:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343037.873088:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343037.873091:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343037.873093:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343037.873096:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343037.873138:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3660:x1848998010286848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 229us (434us total) trans 21474838951 rc 0/0 00000100:00100000:2.0:1763343037.873145:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6660 00000004:00080000:2.0:1763343037.873193:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a354134df80/2, rc 0, transno 21474838951 00000100:00100000:2.0:1763343037.873200:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a354134df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010286848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343037.873214:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6661 00000100:00100000:2.0:1763343037.873220:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3660:x1848998010286720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343037.873298:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3660:x1848998010286720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (520us total) trans 21474838952 rc 0/0 00000100:00100000:2.0:1763343037.873305:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6661 00000004:00080000:2.0:1763343037.873329:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a354134c000/2, rc 0, transno 21474838952 00000100:00100000:2.0:1763343037.873333:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a354134c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010286720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343037.873491:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010286464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343037.873528:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343037.873564:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343037.873570:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010286592:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343037.873596:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343037.873655:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010286464 00000100:00100000:3.0:1763343037.873659:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010286464 00000100:00100000:3.0:1763343037.873691:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010286592 00000100:00100000:3.0:1763343037.873694:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010286592 00000100:00100000:3.0:1763343037.873711:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6662 00000100:00100000:3.0:1763343037.873717:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+95:3657:x1848998010286464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343037.873808:0:28994:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343037.873812:0:28994:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b5:0x0] updating lvb mtime from disk: 1763343037 -> 1763343037 00002000:00010000:3.0:1763343037.873815:0:28994:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2b5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343037.873817:0:28994:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b5:0x0] updating lvb ctime from disk: 1763343037 -> 1763343037 00002000:00010000:3.0:1763343037.873819:0:28994:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343037.873853:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+96:3657:x1848998010286464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (324us total) trans 17179871654 rc 0/0 00000100:00100000:3.0:1763343037.873860:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6662 00000100:00100000:3.0:1763343037.873885:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6663 00000100:00100000:3.0:1763343037.873892:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+95:3657:x1848998010286592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343037.873951:0:28994:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343037.873954:0:28994:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343037.873956:0:28994:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343037.873958:0:28994:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343037.873959:0:28994:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343037.873984:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+96:3657:x1848998010286592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (387us total) trans 17179871655 rc 0/0 00000100:00100000:3.0:1763343037.873990:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6663 00000004:00080000:3.0:1763343037.874025:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537912d80/2, rc 0, transno 17179871655 00000100:00100000:3.0:1763343037.874030:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010286592:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343037.874038:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c3b100/2, rc 0, transno 17179871654 00000100:00100000:3.0:1763343037.874041:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010286464:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763343037.874392:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7a10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.874405:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7a10 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.874412:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7a10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.874418:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.874423:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7a10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.874431:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7a10 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.874450:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:0.0:1763343037.874453:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.874460:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7a10 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.874465:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7a10 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343037.874536:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000006db5c54 reply state 00000000a01999b1 transno 8589940116 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7a9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.874553:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7a9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.874560:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:0.0:1763343037.874564:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343037.874566:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1763343037.874703:0:28422:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343037.874723:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56909:x1848997993622272:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 11118us (12684us total) trans 8589940116 rc 0/0 00000100:00100000:0.0:1763343037.874732:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9468 00010000:00010000:0.0:1763343037.874756:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7a9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.874764:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7a9c lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.874770:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7a9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.874775:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dcc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.874778:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7a9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.874785:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7a9c lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.874793:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:0.0:1763343037.874796:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343037.874799:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7a9c lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343037.874805:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7a9c lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:0.0:1763343037.878147:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.878419:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993622528 00000100:00100000:2.0:1763343037.878433:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993622528 00000100:00100000:2.0:1763343037.878511:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9470 00000100:00100000:2.0:1763343037.878521:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56911:x1848997993622528:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.878552:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.878581:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7ac6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac98e5 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.879762:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7acd lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.879790:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae7ab8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98de expref: 254 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.879800:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7acd lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.879847:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae7ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98de expref: 254 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.879865:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae7ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98de expref: 254 pid: 10041 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343037.879893:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010286976:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343037.880016:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726d80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343037.882082:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.882201:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993622656 00000100:00100000:0.0:1763343037.882214:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993622656 00000100:00100000:0.0:1763343037.882303:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9471 00000100:00100000:0.0:1763343037.882316:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56909:x1848997993622656:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343037.882350:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343037.882377:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7ad4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac98ec expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.882457:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ec expref: 256 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.882477:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ec expref: 256 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343037.882500:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:0.0:1763343037.882504:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343037.882508:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd200, rc 0) 00000100:00100000:0.0:1763343037.882594:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56909:x1848997993622656:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 281us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.882603:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9471 00000100:00100000:3.0:1763343037.885837:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.885981:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010286976:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343037.886023:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7acd lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343037.887985:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993622784 00000100:00100000:1.0:1763343037.888006:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993622784 00010000:00010000:1.0:1763343037.888070:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae7ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98de expref: 256 pid: 10041 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343037.888127:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3124 00000100:00100000:1.0:1763343037.888139:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:2430:x1848997993622784:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343037.888161:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343037.888168:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae7ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98de expref: 256 pid: 10041 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343037.888182:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae7ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98de expref: 256 pid: 10041 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343037.888210:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae7ab8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98de expref: 256 pid: 10041 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343037.888238:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a34037c4d00) 00010000:00010000:1.0:1763343037.888245:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7acd lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.888255:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7acd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.888277:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7acd lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343037.888307:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343037.888394:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:2430:x1848997993622784:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 257us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.888403:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3124 00010000:00010000:2.0:1763343037.889071:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7acd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.889086:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7acd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343037.889117:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ec:0x0]: returning size 0 00000004:00080000:2.0:1763343037.889390:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2b7:0x0], index 1: 0 00000004:00080000:2.0:1763343037.889399:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2b5:0x0], index 0: 0 00000004:00080000:2.0:1763343037.889404:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2b6:0x0], index 0: 0 00000004:00080000:2.0:1763343037.889408:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2b8:0x0], index 1: 0 00010000:00010000:2.0:1763343037.889554:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7acd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.889562:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7acd lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.889569:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7acd lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.889575:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343037.889579:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7acd lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.889587:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7acd lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.889601:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a34037c4d00) 00010000:00010000:2.0:1763343037.889605:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343037.889609:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7acd lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.889614:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7acd lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.889740:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7ac6 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98e5 expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.889752:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a34037c4d00) 00010000:00010000:2.0:1763343037.889755:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343037.889759:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7ac6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98e5 expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.889775:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d800, rc 0) 00000100:00100000:2.0:1763343037.889845:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56911:x1848997993622528:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 11325us (11714us total) trans 8589940118 rc 301/301 00000100:00100000:2.0:1763343037.889855:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9470 00000100:00100000:3.0:1763343037.890891:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.893051:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993622912 00000100:00100000:2.0:1763343037.893071:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993622912 00000100:00100000:3.0:1763343037.893935:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.893990:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993623168 00000100:00100000:0.0:1763343037.893998:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993623168 00000100:00100000:0.0:1763343037.894047:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3235 00000100:00100000:0.0:1763343037.894059:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56911:x1848997993623168:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343037.894407:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9472 00000100:00100000:2.0:1763343037.894418:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56909:x1848997993622912:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.894433:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.894460:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7ae2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac98f3 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.894541:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7ae9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.894560:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.894573:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343037.894611:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1eb:0x0]: returning size 5 00000004:00200000:2.0:1763343037.894617:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343037.894672:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343037.894702:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7ae2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98f3 expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.894723:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98f3 expref: 256 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.894732:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:2.0:1763343037.894735:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763343037.894739:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:2.0:1763343037.894815:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56909:x1848997993622912:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 399us (3940us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.894823:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9472 00000100:00100000:0.0:1763343037.895048:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56911:x1848997993623168:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 991us (1122us total) trans 8589940119 rc 0/0 00000100:00100000:0.0:1763343037.895057:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3235 00000100:00100000:3.0:1763343037.902261:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.902313:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.902606:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993623552 00000100:00100000:0.0:1763343037.902786:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993623552 00000100:00100000:2.0:1763343037.903533:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993623296 00000100:00100000:2.0:1763343037.903543:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993623296 00000100:00100000:2.0:1763343037.903651:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6664 00000100:00100000:2.0:1763343037.903662:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993623296:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343037.903688:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.903717:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae7af0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac98fa expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343037.903748:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b3:0x0] initial LVB size: 5, mtime: 0x691a7abd, atime: 0x691a7abd, ctime: 0x691a7abd, blocks: 0x8 00010000:00010000:2.0:1763343037.903773:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.903777:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343037.903790:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae7af0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98fa expref: 16 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343037.903808:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae7af0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98fa expref: 16 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343037.903825:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d800, rc 0) 00000100:00100000:2.0:1763343037.903920:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993623296:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 259us (1676us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.903929:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6664 00000100:00100000:1.0:1763343037.904682:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3236 00000100:00100000:1.0:1763343037.904695:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56911:x1848997993623552:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343037.904999:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56911:x1848997993623552:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 306us (2684us total) trans 8589940120 rc 0/0 00000100:00100000:1.0:1763343037.905007:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3236 00000100:00100000:3.0:1763343037.914111:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.914538:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993623808 00000100:00100000:2.0:1763343037.914556:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993623808 00000100:00100000:1.0:1763343037.914682:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9473 00000100:00100000:1.0:1763343037.914702:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:55941:x1848997993623808:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343037.914733:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.914764:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7af7 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9901 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.914956:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7afe lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.914975:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7afe lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.914989:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7afe lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915000:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b05 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915007:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915012:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915099:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7b0c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915108:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7b0c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915115:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7b0c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343037.915127:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ec:0x0]: returning size 0 00010000:00010000:1.0:1763343037.915237:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7afe lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915244:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7afe lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915250:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7afe lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915256:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7afe lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915263:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.915268:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7afe lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915275:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7afe lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915288:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421600) 00010000:00010000:1.0:1763343037.915291:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.915295:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7afe lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915301:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7afe lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915315:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915320:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915325:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915329:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343037.915331:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915336:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b05 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915341:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:1.0:1763343037.915343:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343037.915346:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b05 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915366:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b05 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.915408:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7af7 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9901 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.915426:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7b0c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9901 expref: 259 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.915433:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a3404421700) 00010000:00010000:1.0:1763343037.915436:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343037.915438:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:1.0:1763343037.915518:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:55941:x1848997993623808:12345-192.168.204.21@tcp:101:bash.0 Request processed in 821us (1423us total) trans 8589940121 rc 0/0 00000100:00100000:1.0:1763343037.915527:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9473 00000100:00100000:3.0:1763343037.918753:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.918849:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993623936 00000100:00100000:1.0:1763343037.918862:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993623936 00000100:00100000:1.0:1763343037.918950:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9474 00000100:00100000:1.0:1763343037.918962:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:55941:x1848997993623936:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343037.918991:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.919021:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7b1a lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9908 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.919067:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7b21 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.919084:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7b21 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.919099:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7b21 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.919251:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7b1a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9908 expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.920521:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7b21 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9908 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.920536:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a3404421700) 00010000:00010000:1.0:1763343037.920540:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343037.920544:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:1.0:1763343037.920660:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:55941:x1848997993623936:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1699us (1922us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.920670:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9474 00000100:00100000:3.0:1763343037.927853:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.928192:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993624192 00000100:00100000:1.0:1763343037.928206:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993624192 00000100:00100000:1.0:1763343037.928295:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9475 00000100:00100000:1.0:1763343037.928307:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:55941:x1848997993624192:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:1.0:1763343037.928387:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343037.928424:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7b0c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9901 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.928444:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a3404421700) 00010000:00010000:1.0:1763343037.928451:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343037.928752:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b28 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.928774:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b28 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.928785:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b28 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:1.0:1763343037.928841:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940122 00000004:00010000:1.0:1763343037.928865:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000780244d reply state 0000000072ba733f transno 8589940123 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b28 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.928892:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.928899:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a3404421700) 00010000:00010000:1.0:1763343037.928902:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343037.928905:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343037.929031:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993624192:12345-192.168.204.21@tcp:36:bash.0 Request processed in 726us (1193us total) trans 8589940123 rc 0/0 00000100:00100000:1.0:1763343037.929041:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9475 00000020:00080000:1.0:1763343037.929048:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343037.931793:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.932249:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993624320 00000100:00100000:2.0:1763343037.932349:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993624320 00000100:00100000:2.0:1763343037.932437:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9476 00000100:00100000:2.0:1763343037.932449:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993624320:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343037.932481:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343037.932508:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7b2f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac990f expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.932581:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7b2f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac990f expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.932598:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7b2f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac990f expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343037.932651:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a3404421700) 00010000:00010000:2.0:1763343037.932655:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343037.932661:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352cc00, rc 0) 00000100:00100000:2.0:1763343037.932742:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:55941:x1848997993624320:12345-192.168.204.21@tcp:101:bash.0 Request processed in 294us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.932751:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9476 00000100:00100000:3.0:1763343037.935849:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.936093:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993624576 00000100:00100000:1.0:1763343037.936109:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993624576 00000100:00100000:1.0:1763343037.936193:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9477 00000100:00100000:1.0:1763343037.936205:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:55941:x1848997993624576:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343037.936233:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.936237:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343037.936286:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7b2f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac990f expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.936312:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a3404421700) 00010000:00010000:1.0:1763343037.936320:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343037.936337:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7b36 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9916 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.936399:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b3d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.936415:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b3d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.936425:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b3d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000040:00080000:1.0:1763343037.936763:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1467, 88 off123664 00000004:00080000:1.0:1763343037.936773:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231604151460ns, next at 1232093460684ns, rc = 0 00000040:00080000:1.0:1763343037.936825:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1466, 88 off123664 00000004:00080000:1.0:1763343037.936832:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231604210970ns, next at 1232093431049ns, rc = 0 00000040:00080000:1.0:1763343037.936864:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1467, 88 off123752 00000004:00080000:1.0:1763343037.936881:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231604260140ns, next at 1232093431049ns, rc = 0 00000040:00080000:1.0:1763343037.936895:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1468, 88 off123752 00000004:00080000:1.0:1763343037.936900:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231604279381ns, next at 1232093460684ns, rc = 0 00000001:00080000:3.0:1763343037.943587:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940124 is committed 00000004:00080000:3.0:1763343037.943609:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 966 committed 00010000:00010000:0.0:1763343037.943656:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ab1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00000004:00080000:3.0:1763343037.943664:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 967 committed 00000004:00080000:3.0:1763343037.943673:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 966 committed 00010000:00010000:0.0:1763343037.943673:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ab1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00000004:00080000:3.0:1763343037.943676:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 965 committed 00010000:00010000:0.0:1763343037.943683:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ab1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.943689:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.943695:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ab1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.943702:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ab1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.943728:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:0.0:1763343037.943732:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.943738:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ab1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.943745:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ab1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343037.943777:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.943784:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b28 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.943789:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.943794:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343037.943796:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.943803:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b28 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.943810:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a3404421700) 00010000:00010000:0.0:1763343037.943812:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343037.943815:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b28 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343037.943820:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b28 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1ec:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343037.943977:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010287488:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1763343037.943989:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b3d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ec:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9916 expref: 255 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.943998:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a3404421700) 00010000:00010000:1.0:1763343037.944000:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343037.944018:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7b36 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9916 expref: 255 pid: 6525 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343037.944032:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b3d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9916 expref: 254 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343037.944064:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343037.944070:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a3404421700) 00010000:00010000:1.0:1763343037.944073:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343037.944076:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:2.0:1763343037.944111:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343037.944117:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010287360:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343037.944136:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343037.944141:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:55941:x1848997993624576:12345-192.168.204.21@tcp:101:bash.0 Request processed in 7938us (8305us total) trans 8589940124 rc 0/0 00000100:00100000:1.0:1763343037.944151:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9477 00000100:00100000:2.0:1763343037.944165:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010287488 00000100:00100000:2.0:1763343037.944175:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010287488 00000100:00100000:2.0:1763343037.944225:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010287360 00000100:00100000:2.0:1763343037.944228:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010287360 00000100:00100000:1.0:1763343037.944237:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6665 00000100:00100000:1.0:1763343037.944246:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+97:3660:x1848998010287488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343037.944286:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010287104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343037.944318:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343037.944338:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343037.944343:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010287232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343037.944362:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343037.944387:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010287104 00000100:00100000:3.0:1763343037.944391:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010287104 00000100:00100000:2.0:1763343037.944448:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010287232 00000100:00100000:2.0:1763343037.944452:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010287232 00000100:00100000:1.0:1763343037.944468:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+98:3660:x1848998010287488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 223us (403us total) trans 17179871656 rc 0/0 00000100:00100000:2.0:1763343037.944472:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6666 00000100:00100000:1.0:1763343037.944475:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6665 00000100:00100000:2.0:1763343037.944477:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+98:3660:x1848998010287360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343037.944488:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6667 00000100:00100000:1.0:1763343037.944494:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3657:x1848998010287232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343037.944558:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+98:3660:x1848998010287360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (420us total) trans 17179871657 rc 0/0 00000100:00100000:2.0:1763343037.944564:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6666 00000100:00100000:1.0:1763343037.944580:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3657:x1848998010287232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (216us total) trans 21474838953 rc 0/0 00000100:00100000:1.0:1763343037.944587:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6667 00000004:00080000:2.0:1763343037.944613:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478d180/2, rc 0, transno 17179871657 00000004:00080000:1.0:1763343037.944613:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478f800/2, rc 0, transno 21474838953 00000100:00100000:1.0:1763343037.944653:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010287232:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343037.944695:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010287360:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343037.944710:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478d880/2, rc 0, transno 17179871656 00000100:00100000:2.0:1763343037.944713:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010287488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343037.944981:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6668 00000100:00100000:3.0:1763343037.944990:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3657:x1848998010287104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343037.945119:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3657:x1848998010287104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (799us total) trans 21474838954 rc 0/0 00000004:00080000:0.0:1763343037.945136:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c3bce00/2, rc 0, transno 21474838954 00000100:00100000:0.0:1763343037.945142:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010287104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343037.945219:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6668 00000100:00100000:3.0:1763343037.957324:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.959401:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993624704 00000100:00100000:0.0:1763343037.959423:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993624704 00000100:00100000:1.0:1763343037.960376:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6669 00000100:00100000:1.0:1763343037.960395:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+48:55941:x1848997993624704:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343037.960423:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.960458:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae7b44 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac991d expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343037.960497:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343037.960531:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.960534:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343037.960546:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae7b44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac991d expref: 49 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.960565:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae7b44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac991d expref: 49 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.960581:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:1.0:1763343037.960676:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+49:55941:x1848997993624704:12345-192.168.204.21@tcp:101:bash.0 Request processed in 287us (3411us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.960684:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6669 00000100:00100000:1.0:1763343037.962357:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343037.962479:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993624832 00000100:00100000:0.0:1763343037.962493:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993624832 00000100:00100000:0.0:1763343037.962556:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6670 00000100:00100000:0.0:1763343037.962567:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993624832:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:0.0:1763343037.962724:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993624832:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 158us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.962733:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6670 00000100:00100000:1.0:1763343037.965960:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.966118:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993624960 00000100:00100000:3.0:1763343037.966134:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993624960 00000100:00100000:3.0:1763343037.966216:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6671 00000100:00100000:3.0:1763343037.966228:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e9cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:55941:x1848997993624960:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343037.966256:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343037.966525:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3501480a00/0x607405d401ae7b4b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9924 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343037.966558:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343037.966591:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.966594:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.966607:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501480a00/0x607405d401ae7b4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9924 expref: 17 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.966772:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3501480a00/0x607405d401ae7b4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9924 expref: 17 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.966790:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480a00, rc 0) 00000100:00100000:2.0:1763343037.967103:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e9cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993624960:12345-192.168.204.21@tcp:101:bash.0 Request processed in 874us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343037.967113:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6671 00000100:00100000:2.0:1763343037.970373:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.970430:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.970533:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993625088 00000100:00100000:1.0:1763343037.970547:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993625088 00002000:00010000:1.0:1763343037.970598:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/695 (0->18446744073709551615) 00002000:00100000:1.0:1763343037.970604:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478ce00 with x1848997993625088 ext(0->18446744073709551615) 00000100:00100000:3.0:1763343037.970713:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993625216 00000100:00100000:3.0:1763343037.970718:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993625216 00002000:00010000:3.0:1763343037.970737:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/693 (0->18446744073709551615) 00002000:00100000:3.0:1763343037.970741:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478ea00 with x1848997993625216 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343037.970751:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340478ea00. 00000100:00100000:3.0:1763343037.970794:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1620 00000100:00100000:3.0:1763343037.970806:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993625216:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343037.971058:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343037.971063:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2b5:0x0] updating lvb mtime from disk: 0 -> 1763343037 00002000:00010000:3.0:1763343037.971065:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2b5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343037.971068:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2b5:0x0] updating lvb ctime from disk: 0 -> 1763343037 00002000:00010000:3.0:1763343037.971071:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343037.971163:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993625216:12345-192.168.204.21@tcp:10:bash.0 Request processed in 358us (731us total) trans 21474838955 rc 0/0 00000100:00100000:3.0:1763343037.971172:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1620 00002000:00010000:3.0:1763343037.971178:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/693 (0->18446744073709551615) 00002000:00100000:3.0:1763343037.971181:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478ea00 with x1848997993625216 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343037.971185:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340478ea00. 00002000:00010000:1.0:1763343037.971286:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340478ce00. 00000100:00100000:1.0:1763343037.971307:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1621 00000100:00100000:1.0:1763343037.971316:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+49:2429:x1848997993625088:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:1.0:1763343037.971432:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343037.971435:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b7:0x0] updating lvb mtime from disk: 0 -> 1763343037 00002000:00010000:1.0:1763343037.971438:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2b7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343037.971441:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b7:0x0] updating lvb ctime from disk: 0 -> 1763343037 00002000:00010000:1.0:1763343037.971443:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343037.971470:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+50:2429:x1848997993625088:12345-192.168.204.21@tcp:10:bash.0 Request processed in 156us (1220us total) trans 17179871658 rc 0/0 00000100:00100000:1.0:1763343037.971478:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1621 00002000:00010000:1.0:1763343037.971481:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/695 (0->18446744073709551615) 00002000:00100000:1.0:1763343037.971484:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478ce00 with x1848997993625088 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343037.971488:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340478ce00. 00000100:00100000:0.0:1763343037.977920:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343037.978035:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993625344 00000100:00100000:2.0:1763343037.978048:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993625344 00000100:00100000:3.0:1763343037.979382:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.979850:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993625600 00000100:00100000:1.0:1763343037.979862:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993625600 00000100:00100000:1.0:1763343037.979943:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3237 00000100:00100000:1.0:1763343037.979955:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3509229050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:55941:x1848997993625600:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343037.980493:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6672 00000100:00100000:0.0:1763343037.980508:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2431:x1848997993625344:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:0.0:1763343037.980667:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2431:x1848997993625344:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 162us (2761us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343037.980681:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6672 00000100:00100000:1.0:1763343037.980806:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3509229050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:55941:x1848997993625600:12345-192.168.204.21@tcp:35:bash.0 Request processed in 853us (1432us total) trans 8589940125 rc 0/0 00000100:00100000:1.0:1763343037.980814:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3237 00000100:00100000:0.0:1763343037.986088:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343037.986544:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993625728 00000100:00100000:3.0:1763343037.986558:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993625728 00000100:00100000:3.0:1763343037.986689:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1622 00000100:00100000:3.0:1763343037.986701:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2432:x1848997993625728:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:3.0:1763343037.986751:0:28425:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7b52 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.986771:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.986774:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343037.986780:0:28425:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7b52 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.986796:0:28425:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7b52 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.986973:0:28425:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7b52 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.986984:0:28425:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7b52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.986999:0:28425:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7b52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.987006:0:28425:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343037.987011:0:28425:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7b52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.987022:0:28425:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7b52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.987042:0:28425:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7b52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343037.987051:0:28425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7b52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343037.987154:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2432:x1848997993625728:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 455us (1082us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763343037.987163:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1622 00000100:00100000:3.0:1763343037.998026:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343037.998171:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993625856 00000100:00100000:1.0:1763343037.998186:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993625856 00000100:00100000:1.0:1763343037.998273:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9478 00000100:00100000:1.0:1763343037.998284:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56909:x1848997993625856:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343037.998315:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343037.998355:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7b59 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac992b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.998408:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b60 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.998428:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b60 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.998441:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b60 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343037.998575:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7b59 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac992b expref: 257 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.998595:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93600/0x607405d401ae7b60 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac992b expref: 256 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343037.998605:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:1.0:1763343037.998608:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343037.998613:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93600, rc 0) 00000100:00100000:1.0:1763343037.998733:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56909:x1848997993625856:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 449us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343037.998741:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9478 00000100:00100000:1.0:1763343038.001582:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.002063:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993625984 00000100:00100000:2.0:1763343038.002078:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993625984 00000100:00100000:2.0:1763343038.002159:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9479 00000100:00100000:2.0:1763343038.002170:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56912:x1848997993625984:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:2.0:1763343038.002198:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.002231:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7b67 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9932 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.002320:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b6e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002336:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002348:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002360:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b75 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002366:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002372:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002470:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7b7c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002484:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7b7c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002491:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7b7c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343038.002541:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ec:0x0]: returning size 5 00000004:00200000:2.0:1763343038.002546:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343038.002569:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7b7c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002581:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7b7c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002590:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002596:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b6e lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002602:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002608:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.002613:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002667:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b6e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002683:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289700) 00010000:00010000:2.0:1763343038.002687:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.002692:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b6e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002699:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b6e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002714:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002720:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b75 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002725:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002730:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.002733:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002738:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b75 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002745:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289000) 00010000:00010000:2.0:1763343038.002747:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.002749:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b75 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002754:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b75 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.002787:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7b67 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9932 expref: 258 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.002803:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7b7c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9932 expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.002816:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a3404421700) 00010000:00010000:2.0:1763343038.002819:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343038.002822:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d400, rc 0) 00000100:00100000:2.0:1763343038.004181:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56912:x1848997993625984:12345-192.168.204.21@tcp:101:rm.0 Request processed in 1996us (2595us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.004196:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9479 00000100:00100000:0.0:1763343038.005862:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.007459:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993626112 00000100:00100000:1.0:1763343038.007478:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993626112 00000100:00100000:1.0:1763343038.007567:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1623 00000100:00100000:1.0:1763343038.007577:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+50:2431:x1848997993626112:12345-192.168.204.21@tcp:4:lfs.0 00010000:00010000:1.0:1763343038.007647:0:8415:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae7b83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.007670:0:8415:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae7929 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9860 expref: 50 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343038.007679:0:8415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.007682:0:8415:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.007687:0:8415:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae7b83 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.007728:0:8415:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae7929 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9860 expref: 50 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343038.007742:0:8415:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae7929 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9860 expref: 50 pid: 28996 timeout: 1331 lvb_type: 1 00000100:00100000:1.0:1763343038.007760:0:8415:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537913480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8415:1848998010287616:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343038.007884:0:8415:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343038.012148:0:8415:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537913480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8415:1848998010287616:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343038.012190:0:8415:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae7b83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343038.013514:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.013737:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.013823:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993626368 00000100:00100000:2.0:1763343038.013836:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993626368 00000100:00100000:2.0:1763343038.013938:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9480 00000100:00100000:2.0:1763343038.013949:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56912:x1848997993626368:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:2.0:1763343038.014021:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343038.014150:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7b3d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ec:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9916 expref: 257 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.014178:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7b7c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9932 expref: 256 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.014192:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7b21 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ec:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9908 expref: 255 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.014202:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a3404421700) 00010000:00010000:2.0:1763343038.014218:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343038.014254:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7b8a lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.014270:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7b8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.014285:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7b8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.014299:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b91 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.014306:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.014311:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016119:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b98 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016144:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b98 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016156:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b98 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:2.0:1763343038.016498:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1469, 64 off123816 00000040:00080000:2.0:1763343038.016530:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1468, 64 off123816 00000040:00080000:2.0:1763343038.016542:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1469, 64 off123880 00000040:00080000:2.0:1763343038.016550:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1470, 64 off123880 00010000:00010000:2.0:1763343038.016615:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7b9f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016667:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7b9f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016675:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7b9f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016686:0:28422:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7b9f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016691:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7b9f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016697:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7b9f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016716:0:28422:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343038.016744:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b98 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016750:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b98 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016757:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b98 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016763:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.016767:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b98 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016776:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b98 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016788:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a3510289300) 00010000:00010000:2.0:1763343038.016792:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343038.016796:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b98 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016802:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7b98 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016970:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7b8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016978:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7b8a lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016984:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7b8a lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016988:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.016992:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7b8a lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.016997:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7b8a lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.017006:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289700) 00010000:00010000:2.0:1763343038.017008:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.017011:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7b8a lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.017017:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7b8a lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:2.0:1763343038.017034:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000027eeaab1 reply state 00000000f0e95bc7 transno 8589940126 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.017046:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.017052:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289000) 00010000:00010000:2.0:1763343038.017055:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343038.017059:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343038.017176:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56912:x1848997993626368:12345-192.168.204.21@tcp:36:rm.0 Request processed in 3223us (3670us total) trans 8589940126 rc 0/0 00000100:00100000:2.0:1763343038.017187:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9480 00010000:00010000:3.0:1763343038.017701:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343038.017710:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7b9f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.017717:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343038.017720:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7b9f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.017730:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7b9f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.017740:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ec:0x0].0x0 (ffff9a3510289300) 00010000:00010000:3.0:1763343038.017743:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343038.017746:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7b9f lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.017752:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7b9f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.017768:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343038.017770:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343038.017772:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343038.018259:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993626496 00000100:00100000:1.0:1763343038.018275:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993626496 00010000:00010000:1.0:1763343038.018335:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae7929 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9860 expref: 51 pid: 28996 timeout: 1331 lvb_type: 1 00000100:00100000:1.0:1763343038.018389:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3125 00000100:00100000:1.0:1763343038.018402:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+51:2431:x1848997993626496:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343038.018420:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343038.018441:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae7929 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9860 expref: 51 pid: 28996 timeout: 1331 lvb_type: 1 00010000:00010000:1.0:1763343038.018462:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae7929 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9860 expref: 51 pid: 28996 timeout: 1331 lvb_type: 1 00010000:00010000:1.0:1763343038.018486:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176000/0x607405d401ae7929 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9860 expref: 51 pid: 28996 timeout: 1331 lvb_type: 1 00010000:00010000:1.0:1763343038.018504:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.018506:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.018512:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae7b83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.018522:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae7b83 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.018559:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343038.018646:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+50:2431:x1848997993626496:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 246us (4908us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.018661:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3125 00010000:00010000:0.0:1763343038.018669:0:8415:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae7b83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.018684:0:8415:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae7b83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1763343038.032441:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871659 is committed 00000001:00080000:0.0:1763343038.032465:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871657 is committed 00002000:00010000:2.0:1763343038.033746:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:2.0:1763343038.033759:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb mtime from disk: 0 -> 1763343037 00002000:00010000:2.0:1763343038.033762:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb ctime from disk: 0 -> 1763343037 00002000:00010000:2.0:1763343038.033765:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343038.033784:0:8415:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae7b83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.033799:0:8415:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae7b83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.033809:0:8415:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae7b83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.033816:0:8415:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343038.033822:0:8415:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae7b83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.033832:0:8415:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae7b83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.033857:0:8415:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae7b83 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.033865:0:8415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae7b83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8415 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343038.034018:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2431:x1848997993626112:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 26433us (28161us total) trans 17179871659 rc 0/0 00000100:00100000:2.0:1763343038.034031:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1623 00000100:00100000:2.0:1763343038.040562:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.040689:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993626624 00000100:00100000:0.0:1763343038.040704:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993626624 00000100:00100000:0.0:1763343038.040783:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9481 00000100:00100000:0.0:1763343038.040796:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56913:x1848997993626624:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.040836:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.040881:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7ba6 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9939 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.040970:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7bad lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041049:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7bad lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041067:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7bad lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041084:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7bb4 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041091:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041098:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041149:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7bad lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041157:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7bad lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041164:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7bad lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041171:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dda00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.041176:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7bad lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041184:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7bad lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041198:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4500) 00010000:00010000:0.0:1763343038.041202:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.041206:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7bad lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041213:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7bad lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041228:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041235:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7bb4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041240:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041246:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.041248:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041254:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041260:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289000) 00010000:00010000:0.0:1763343038.041263:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.041265:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7bb4 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041271:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7bb4 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.041734:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7ba6 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9939 expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.041748:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4500) 00010000:00010000:0.0:1763343038.041750:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.041754:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7ba6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9939 expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.041769:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc000, rc 0) 00000100:00100000:0.0:1763343038.041856:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56913:x1848997993626624:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1061us (1308us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343038.041865:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9481 00000100:00100000:0.0:1763343038.053716:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.053812:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993626752 00000100:00100000:2.0:1763343038.053824:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993626752 00000100:00100000:2.0:1763343038.053902:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9482 00000100:00100000:2.0:1763343038.053913:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56913:x1848997993626752:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343038.053938:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.053966:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7bbb lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9940 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.054171:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7bc2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054187:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054200:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054210:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7bc9 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054216:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054221:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054279:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054286:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7bc2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054293:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054299:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.054304:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054312:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7bc2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054326:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289700) 00010000:00010000:2.0:1763343038.054330:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.054336:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7bc2 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054343:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7bc2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054358:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054363:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054368:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054373:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.054376:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054382:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054388:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289000) 00010000:00010000:2.0:1763343038.054390:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.054392:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7bc9 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054397:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae7bc9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.054425:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7bbb lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9940 expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.054436:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289700) 00010000:00010000:2.0:1763343038.054438:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.054441:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae7bbb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9940 expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.054454:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c600, rc 0) 00000100:00100000:2.0:1763343038.054530:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56913:x1848997993626752:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 618us (830us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343038.054538:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9482 00000100:00100000:3.0:1763343038.057734:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.057850:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993626880 00000100:00100000:2.0:1763343038.057864:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993626880 00000100:00100000:2.0:1763343038.057950:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9483 00000100:00100000:2.0:1763343038.057962:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56913:x1848997993626880:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343038.057994:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.058029:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7bd0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9947 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.058115:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7bd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.058132:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.058146:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343038.058213:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343038.058221:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343038.058273:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae7bd0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9947 expref: 258 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.058297:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9947 expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.058309:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289300) 00010000:00010000:2.0:1763343038.058313:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343038.058317:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352da00, rc 0) 00000100:00100000:2.0:1763343038.058398:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56913:x1848997993626880:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 438us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.058407:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9483 00000100:00100000:3.0:1763343038.061235:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.061364:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993627136 00000100:00100000:1.0:1763343038.061380:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993627136 00000100:00100000:1.0:1763343038.061450:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9484 00000100:00100000:1.0:1763343038.061460:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56909:x1848997993627136:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:1.0:1763343038.061514:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343038.061542:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7ae9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1eb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98f3 expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.061563:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:1.0:1763343038.061569:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343038.061681:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7bde lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.061695:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7bde lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.061705:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7bde lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00010000:1.0:1763343038.061818:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000839ec15 reply state 000000001b4a7eb2 transno 8589940127 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7bde lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.061830:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7bde lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.061836:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:1.0:1763343038.061838:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343038.061841:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343038.062079:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56909:x1848997993627136:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 619us (858us total) trans 8589940127 rc 0/0 00000100:00100000:1.0:1763343038.062088:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9484 00000100:00100000:0.0:1763343038.065027:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.065201:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993627264 00000100:00100000:2.0:1763343038.065215:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993627264 00000100:00100000:2.0:1763343038.065459:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6673 00000100:00100000:2.0:1763343038.065472:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:56909:x1848997993627264:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:3.0:1763343038.065490:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:2.0:1763343038.065495:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.065580:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae7be5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac994e expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343038.065614:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b6:0x0] initial LVB size: 4096, mtime: 0x691a7abd, atime: 0x0, ctime: 0x691a7abd, blocks: 0x8 00010000:00010000:2.0:1763343038.065675:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343038.065678:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343038.065688:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae7be5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac994e expref: 14 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.065709:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae7be5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac994e expref: 14 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.065724:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c600, rc 0) 00000100:00100000:1.0:1763343038.065761:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993627392 00000100:00100000:1.0:1763343038.065767:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993627392 00000100:00100000:1.0:1763343038.065802:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9485 00000100:00100000:2.0:1763343038.065804:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:56909:x1848997993627264:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 335us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.065809:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56913:x1848997993627392:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:2.0:1763343038.065812:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6673 00010000:00010000:1.0:1763343038.065824:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.065841:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7bec lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9955 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.065926:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7bf3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.065942:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7bf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.065954:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7bf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.065965:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7bfa lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.065972:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7bfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.065979:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7bfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066041:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7bf3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066049:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7bf3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066055:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7bf3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066062:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7bf3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066068:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.066072:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7bf3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066079:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7bf3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066096:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289300) 00010000:00010000:1.0:1763343038.066100:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.066106:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7bf3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066117:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7bf3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066133:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7bfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066138:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7bfa lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066144:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7bfa lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066149:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.066151:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7bfa lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066158:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7bfa lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066164:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289000) 00010000:00010000:1.0:1763343038.066167:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.066170:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7bfa lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066175:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7bfa lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.066201:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7bec lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9955 expref: 259 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.066212:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289300) 00010000:00010000:1.0:1763343038.066214:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.066217:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7bec lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9955 expref: 259 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.066226:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:1.0:1763343038.066259:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56913:x1848997993627392:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 449us (768us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343038.066269:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9485 00000100:00100000:0.0:1763343038.068342:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.068675:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993627520 00000100:00100000:2.0:1763343038.068687:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993627520 00000100:00100000:2.0:1763343038.068758:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6674 00000100:00100000:2.0:1763343038.068768:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:56909:x1848997993627520:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343038.068790:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.068816:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae7c01 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac995c expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.068855:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae7930 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9867 expref: 19 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343038.068865:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343038.068876:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343038.068882:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae7c01 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac995c expref: 19 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.068928:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae7930 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9867 expref: 19 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343038.068942:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae7930 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9867 expref: 19 pid: 28996 timeout: 1331 lvb_type: 1 00000100:00100000:2.0:1763343038.068958:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010287744:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343038.069058:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726d80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343038.072764:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.072889:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.073198:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993627776 00000100:00100000:1.0:1763343038.073212:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993627776 00000100:00100000:1.0:1763343038.073296:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9486 00000100:00100000:1.0:1763343038.073307:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56913:x1848997993627776:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343038.073335:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.073339:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343038.073375:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7bd7 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9947 expref: 258 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.073398:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289300) 00010000:00010000:1.0:1763343038.073411:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343038.073431:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7c08 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9963 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.073588:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7c0f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.073604:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7c0f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.073615:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7c0f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.073661:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7c16 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.073669:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7c16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.073676:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7c16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.074186:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c1d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.074197:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c1d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.074205:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c1d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343038.074216:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ee:0x0]: returning size 0 00010000:00010000:1.0:1763343038.074246:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7c0f lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.074254:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7c0f lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.074261:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7c0f lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.074269:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7c0f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.074276:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.074281:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7c0f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.074290:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7c0f lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.074299:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:1.0:1763343038.074302:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.074306:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7c0f lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.074313:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae7c0f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:1.0:1763343038.074325:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008ae74a99 reply state 00000000ab7a1603 transno 8589940128 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7c16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.074337:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7c16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.074343:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289000) 00010000:00010000:1.0:1763343038.074345:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343038.074348:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343038.074378:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae7c08 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9963 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.074397:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c1d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9963 expref: 259 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.074405:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdc900) 00010000:00010000:1.0:1763343038.074407:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343038.074410:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00000100:00100000:1.0:1763343038.074491:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56913:x1848997993627776:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1185us (1741us total) trans 8589940128 rc 0/0 00000100:00100000:1.0:1763343038.074500:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9486 00000100:00100000:0.0:1763343038.074673:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993627904 00000100:00100000:0.0:1763343038.074683:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993627904 00010000:00010000:0.0:1763343038.074717:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae7930 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9867 expref: 20 pid: 28996 timeout: 1331 lvb_type: 1 00000100:00100000:0.0:1763343038.074751:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3126 00000100:00100000:0.0:1763343038.074760:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35188bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993627904:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343038.074774:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343038.074797:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae7930 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9867 expref: 20 pid: 28996 timeout: 1331 lvb_type: 1 00010000:00010000:0.0:1763343038.074809:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae7930 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9867 expref: 20 pid: 28996 timeout: 1331 lvb_type: 1 00010000:00010000:0.0:1763343038.074829:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.074832:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.074838:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae7c01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac995c expref: 20 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.074849:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae7c01 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac995c expref: 20 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.074903:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae7c01 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac995c expref: 20 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343038.074917:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062c9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1848998010287872:192.168.204.21@tcp:105: 00000100:00100000:0.0:1763343038.074979:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3508519d80 going to sleep for 11 seconds 00010000:00010000:2.0:1763343038.075247:0:27835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae7930 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9867 expref: 20 pid: 28996 timeout: 1331 lvb_type: 1 00000100:00100000:2.0:1763343038.075260:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010287744:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343038.075285:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae7c01 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac995c expref: 19 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.075295:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d600, rc 0) 00000100:00100000:2.0:1763343038.075335:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:56909:x1848997993627520:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6569us (7008us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.075343:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6674 00000100:00100000:0.0:1763343038.081456:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062c9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1848998010287872:192.168.204.21@tcp:105: 00010000:00010000:0.0:1763343038.081498:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343038.081581:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35188bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993627904:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 6819us (8690us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.081597:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3126 00000100:00100000:3.0:1763343038.084003:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.084050:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.084083:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.084115:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993628032 00000100:00100000:3.0:1763343038.084127:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993628032 00002000:00010000:3.0:1763343038.084182:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/694 (5->18446744073709551615) 00002000:00100000:3.0:1763343038.084188:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062f3b80 with x1848997993628032 ext(5->18446744073709551615) 00000100:00100000:1.0:1763343038.084196:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993628288 00002000:00010000:3.0:1763343038.084203:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34062f3b80. 00000100:00100000:1.0:1763343038.084203:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993628288 00000100:00100000:3.0:1763343038.084236:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993628416 00000100:00100000:3.0:1763343038.084240:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993628416 00000100:00100000:1.0:1763343038.084256:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9487 00002000:00010000:3.0:1763343038.084258:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/692 (0->18446744073709551615) 00000100:00100000:1.0:1763343038.084269:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3507841050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56913:x1848997993628288:12345-192.168.204.21@tcp:101:lfs.0 00002000:00100000:3.0:1763343038.084277:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062f3800 with x1848997993628416 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343038.084286:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34062f3800. 00010000:00010000:1.0:1763343038.084295:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763343038.084306:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1624 00000100:00100000:3.0:1763343038.084316:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993628032:12345-192.168.204.21@tcp:10:lfs.0 00010000:00010000:1.0:1763343038.084322:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae7c2b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac996a expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.084453:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c32 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.084472:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c1d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9963 expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.084482:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c32 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.084525:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c1d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9963 expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.084541:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c1d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9963 expref: 261 pid: 6525 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343038.084558:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537913480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010288000:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343038.084673:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b6c0 going to sleep for 11 seconds 00002000:00010000:3.0:1763343038.084728:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:3.0:1763343038.084733:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb mtime from disk: 1763343037 -> 1763343037 00002000:00010000:3.0:1763343038.084736:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343038.084739:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb ctime from disk: 1763343037 -> 1763343037 00002000:00010000:3.0:1763343038.084742:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343038.084778:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993628032:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 463us (726us total) trans 17179871660 rc 0/0 00000100:00100000:3.0:1763343038.084787:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1624 00002000:00010000:3.0:1763343038.084791:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/694 (5->18446744073709551615) 00002000:00100000:3.0:1763343038.084794:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062f3b80 with x1848997993628032 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343038.084798:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34062f3b80. 00000100:00100000:3.0:1763343038.084818:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1625 00000100:00100000:3.0:1763343038.084826:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993628416:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:3.0:1763343038.084953:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343038.084956:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb mtime from disk: 0 -> 1763343037 00002000:00010000:3.0:1763343038.084958:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343038.084960:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb ctime from disk: 0 -> 1763343037 00002000:00010000:3.0:1763343038.084962:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343038.090364:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993628416:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 5520us (6261us total) trans 21474838956 rc 0/0 00000100:00100000:1.0:1763343038.090389:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1625 00002000:00010000:1.0:1763343038.090399:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/692 (0->18446744073709551615) 00002000:00100000:1.0:1763343038.090404:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062f3800 with x1848997993628416 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343038.090419:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34062f3800. 00000100:00100000:3.0:1763343038.090604:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537913480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010288000:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343038.090668:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c32 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:0.0:1763343038.091950:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.092266:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993628544 00000100:00100000:1.0:1763343038.092279:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993628544 00010000:00010000:1.0:1763343038.092330:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c1d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9963 expref: 262 pid: 6525 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343038.092381:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3127 00000100:00100000:1.0:1763343038.092392:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:2430:x1848997993628544:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343038.092416:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343038.092424:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c1d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9963 expref: 262 pid: 6525 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343038.092449:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c1d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9963 expref: 262 pid: 6525 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343038.092478:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c1d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9963 expref: 262 pid: 6525 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343038.092885:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdc900) 00010000:00010000:1.0:1763343038.092890:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c32 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.092902:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c32 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.092915:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c32 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.093064:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343038.093377:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:2430:x1848997993628544:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 983us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.093387:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3127 00010000:00010000:3.0:1763343038.095021:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c32 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.095041:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c32 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343038.095076:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ee:0x0]: returning size 0 00000100:00100000:2.0:1763343038.095206:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.095318:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993628800 00000100:00100000:3.0:1763343038.095463:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993628800 00000100:00100000:2.0:1763343038.095674:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9488 00000100:00100000:2.0:1763343038.095686:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56909:x1848997993628800:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:2.0:1763343038.095780:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7c39 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.095798:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7c39 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.095810:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7c39 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00010000:2.0:1763343038.095962:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d28980c1 reply state 00000000a0013023 transno 8589940129 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7c39 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.095985:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7c39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.095994:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:2.0:1763343038.095997:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343038.096001:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343038.096108:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56909:x1848997993628800:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 425us (907us total) trans 8589940129 rc 0/0 00000100:00100000:2.0:1763343038.096116:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9488 00000004:00080000:1.0:1763343038.096657:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2b7:0x0], index 0: 0 00000004:00080000:1.0:1763343038.096665:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2b9:0x0], index 1: 0 00000004:00080000:1.0:1763343038.096669:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2ba:0x0], index 1: 0 00000004:00080000:1.0:1763343038.096673:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2b8:0x0], index 0: 0 00010000:00010000:1.0:1763343038.096765:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c32 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.096774:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c32 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.096781:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c32 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.096788:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.096793:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c32 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.096800:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c32 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.096813:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdc900) 00010000:00010000:1.0:1763343038.096815:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343038.096819:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c32 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.096827:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c32 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.096884:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae7c2b lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac996a expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.096896:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdc900) 00010000:00010000:1.0:1763343038.096898:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343038.096902:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae7c2b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac996a expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.096918:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:1.0:1763343038.097248:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3507841050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56913:x1848997993628288:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 12982us (13256us total) trans 8589940130 rc 301/301 00000100:00100000:1.0:1763343038.097257:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9487 00000100:00100000:0.0:1763343038.102069:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.102315:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993628928 00000100:00100000:2.0:1763343038.102331:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993628928 00000100:00100000:2.0:1763343038.102414:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6675 00000100:00100000:2.0:1763343038.102426:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:56909:x1848997993628928:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343038.102454:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.102481:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7c47 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9971 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.102522:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae7af0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98fa expref: 20 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343038.102532:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343038.102535:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343038.102539:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7c47 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9971 expref: 20 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.102579:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae7af0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98fa expref: 20 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343038.102594:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae7af0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98fa expref: 20 pid: 8407 timeout: 1331 lvb_type: 1 00000100:00100000:2.0:1763343038.102609:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010288128:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343038.102743:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726600 going to sleep for 11 seconds 00000100:00100000:3.0:1763343038.103023:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.103574:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993629184 00000100:00100000:1.0:1763343038.103585:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993629184 00000100:00100000:1.0:1763343038.103682:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3238 00000100:00100000:1.0:1763343038.103692:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56913:x1848997993629184:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343038.104096:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56913:x1848997993629184:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 403us (1072us total) trans 8589940131 rc 0/0 00000100:00100000:1.0:1763343038.104105:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3238 00000100:00100000:3.0:1763343038.113238:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.113290:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.113323:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993629568 00000100:00100000:0.0:1763343038.113323:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993629440 00000100:00100000:3.0:1763343038.113334:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993629568 00000100:00100000:0.0:1763343038.113334:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993629440 00010000:00010000:3.0:1763343038.113385:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae7af0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98fa expref: 21 pid: 8407 timeout: 1331 lvb_type: 1 00000100:00100000:0.0:1763343038.113397:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3239 00000100:00100000:0.0:1763343038.113407:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56913:x1848997993629440:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343038.113463:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3128 00000100:00100000:3.0:1763343038.113471:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993629568:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343038.113501:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343038.113527:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae7af0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98fa expref: 21 pid: 8407 timeout: 1331 lvb_type: 1 00000100:00100000:2.0:1763343038.113533:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010288128:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343038.113549:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae7af0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98fa expref: 21 pid: 8407 timeout: 1331 lvb_type: 1 00010000:00010000:3.0:1763343038.113580:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae7af0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98fa expref: 21 pid: 8407 timeout: 1331 lvb_type: 1 00010000:00010000:2.0:1763343038.113595:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7c47 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9971 expref: 21 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.113605:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.113609:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.113655:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7c47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9971 expref: 20 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.113668:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7c47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9971 expref: 20 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.113761:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352da00, rc 0) 00000100:00100000:2.0:1763343038.113850:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:56909:x1848997993628928:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 11424us (11796us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.113859:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6675 00000100:00100000:0.0:1763343038.114319:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56913:x1848997993629440:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 911us (1095us total) trans 8589940132 rc 0/0 00000100:00100000:0.0:1763343038.114329:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3239 00010000:00010000:3.0:1763343038.114399:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7c47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9971 expref: 19 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343038.114418:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1848998010288256:192.168.204.21@tcp:105: 00000100:00100000:3.0:1763343038.116435:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c300 going to sleep for 11 seconds 00000100:00100000:3.0:1763343038.123717:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1848998010288256:192.168.204.21@tcp:105: 00010000:00010000:3.0:1763343038.123758:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343038.124426:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993629568:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 10953us (11132us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343038.124441:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3128 00000100:00100000:2.0:1763343038.125086:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.125402:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993629696 00000100:00100000:1.0:1763343038.125413:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993629696 00000100:00100000:1.0:1763343038.125472:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6676 00000100:00100000:1.0:1763343038.125482:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993629696:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:1.0:1763343038.125710:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343038.125715:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb mtime from disk: 1763343037 -> 1763343037 00002000:00010000:1.0:1763343038.125717:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb atime from disk: 1763343037 -> 1763343037 00002000:00010000:1.0:1763343038.125719:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb ctime from disk: 1763343037 -> 1763343038 00002000:00010000:1.0:1763343038.125722:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343038.125774:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993629696:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 294us (689us total) trans 21474838957 rc 0/0 00000100:00100000:1.0:1763343038.125780:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6676 00000100:00100000:2.0:1763343038.129559:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.129696:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993629952 00000100:00100000:1.0:1763343038.129710:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993629952 00000100:00100000:1.0:1763343038.129782:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9489 00000100:00100000:1.0:1763343038.129794:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993629952:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343038.130513:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.130550:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c4e lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9978 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.130769:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7c55 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.130787:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7c55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.130801:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7c55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.130812:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7c5c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.130820:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7c5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.130826:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7c5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132064:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae7c63 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132077:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae7c63 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132089:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae7c63 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343038.132103:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ee:0x0]: returning size 0 00010000:00010000:1.0:1763343038.132204:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7c55 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132212:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7c55 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132220:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7c55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132225:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.132230:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7c55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132237:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7c55 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132250:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc900) 00010000:00010000:1.0:1763343038.132253:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.132259:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7c55 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132270:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7c55 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132285:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7c5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132291:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7c5c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132296:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7c5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132301:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.132304:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7c5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132310:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7c5c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132317:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289000) 00010000:00010000:1.0:1763343038.132320:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.132323:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7c5c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132328:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7c5c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.132384:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7c4e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9978 expref: 267 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.132406:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae7c63 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9978 expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.132420:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:1.0:1763343038.132423:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343038.132425:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:1.0:1763343038.132516:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:55941:x1848997993629952:12345-192.168.204.21@tcp:101:bash.0 Request processed in 2724us (2971us total) trans 8589940133 rc 0/0 00000100:00100000:1.0:1763343038.132526:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9489 00000100:00100000:2.0:1763343038.132811:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.133088:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993630208 00000100:00100000:3.0:1763343038.133100:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993630208 00000100:00100000:3.0:1763343038.133151:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3240 00000100:00100000:3.0:1763343038.133160:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56909:x1848997993630208:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:3.0:1763343038.133224:0:6527:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7a3a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98bb expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.133276:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343038.133288:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7ad4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ec expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.133299:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343038.133340:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ec expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.133357:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7ad4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ec expref: 266 pid: 10041 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1763343038.133373:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010288384:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343038.133455:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c300 going to sleep for 11 seconds 00000100:00100000:2.0:1763343038.138860:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.138979:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010288384:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343038.139016:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00000100:00100000:2.0:1763343038.139761:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.139887:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993630336 00000100:00100000:1.0:1763343038.139898:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993630336 00000100:00100000:1.0:1763343038.139966:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9490 00000100:00100000:1.0:1763343038.139978:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:55941:x1848997993630336:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343038.140010:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.140038:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c78 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac997f expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.140086:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7c7f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.140104:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7c7f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.140117:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7c7f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.140288:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c78 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac997f expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.140313:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7c7f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac997f expref: 268 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.140329:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:1.0:1763343038.140333:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343038.140338:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:1.0:1763343038.140429:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:55941:x1848997993630336:12345-192.168.204.21@tcp:101:bash.0 Request processed in 453us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.140439:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9490 00000100:00100000:3.0:1763343038.140611:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993630464 00000100:00100000:3.0:1763343038.140650:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993630464 00010000:00010000:3.0:1763343038.140674:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7ad4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ec expref: 268 pid: 10041 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1763343038.140702:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3129 00000100:00100000:3.0:1763343038.140708:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:2429:x1848997993630464:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343038.140719:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343038.140725:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7ad4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ec expref: 268 pid: 10041 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343038.140737:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ec expref: 268 pid: 10041 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343038.140754:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7ad4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98ec expref: 268 pid: 10041 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343038.140765:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:3.0:1763343038.140769:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343038.140779:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343038.140785:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343038.140811:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343038.140836:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:2429:x1848997993630464:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 128us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343038.140843:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3129 00010000:00010000:1.0:1763343038.142219:0:6527:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343038.142235:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00000040:00080000:1.0:1763343038.142543:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1470, 88 off123968 00000004:00080000:1.0:1763343038.143180:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231810557225ns, next at 1232093431049ns, rc = 0 00000040:00080000:1.0:1763343038.143607:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1471, 88 off123968 00000004:00080000:1.0:1763343038.143614:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231810992947ns, next at 1232093460684ns, rc = 0 00000040:00080000:1.0:1763343038.143883:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1472, 88 off124056 00000004:00080000:1.0:1763343038.143889:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231811268635ns, next at 1232093460684ns, rc = 0 00000040:00080000:1.0:1763343038.143905:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1471, 88 off124056 00000004:00080000:1.0:1763343038.143909:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231811288666ns, next at 1232093431049ns, rc = 0 00000100:00100000:2.0:1763343038.146847:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.147271:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993630720 00000100:00100000:0.0:1763343038.147286:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993630720 00000100:00100000:0.0:1763343038.147369:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9491 00000100:00100000:0.0:1763343038.147381:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:55941:x1848997993630720:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343038.147458:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343038.147499:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae7c63 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9978 expref: 268 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.147524:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:0.0:1763343038.147532:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343038.147850:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7c86 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343038.147876:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7c86 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343038.147887:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7c86 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000001:00080000:0.0:1763343038.147947:0:10041:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940135 00000004:00010000:0.0:1763343038.147973:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b0a056d6 reply state 000000008b5a6f41 transno 8589940136 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7c86 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343038.147986:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7c86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343038.147992:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:0.0:1763343038.147995:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343038.147998:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343038.148125:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:55941:x1848997993630720:12345-192.168.204.21@tcp:36:bash.0 Request processed in 743us (1302us total) trans 8589940136 rc 0/0 00000100:00100000:0.0:1763343038.148133:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9491 00000020:00080000:0.0:1763343038.148139:0:10041:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:3.0:1763343038.150377:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940134 is committed 00000004:00080000:3.0:1763343038.150396:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 969 committed 00010000:00010000:1.0:1763343038.150414:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00000004:00080000:3.0:1763343038.150415:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 968 committed 00010000:00010000:1.0:1763343038.150431:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00000004:00080000:3.0:1763343038.150432:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 967 committed 00000004:00080000:3.0:1763343038.150436:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 968 committed 00010000:00010000:1.0:1763343038.150445:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.150458:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.150465:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.150475:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.150498:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289000) 00010000:00010000:1.0:1763343038.150501:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.150508:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b91 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.150515:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae7b91 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.150549:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7bde lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.150556:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7bde lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.150564:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7bde lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.150571:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.150575:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7bde lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.150582:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7bde lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.150592:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:1.0:1763343038.150597:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.150601:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7bde lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.150607:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae7bde lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.150650:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7c16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.150658:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7c16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00000004:00010000:3.0:1763343038.150661:0:6527:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c6a5ce5e reply state 00000000ba8dd945 transno 8589940134 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343038.150665:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7c16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.150680:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.150685:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7c16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.150690:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343038.150693:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7c16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.150705:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:1.0:1763343038.150709:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289000) 00010000:00010000:3.0:1763343038.150710:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1763343038.150716:0:6527:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343038.150716:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.150722:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7c16 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.150725:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:3.0:1763343038.150733:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343038.150734:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae7c16 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.150743:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae7a3a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98bb expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.150764:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7c39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.150772:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7c39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.150779:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7c39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.150785:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.150788:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7c39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.150794:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7c39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.150802:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:1.0:1763343038.150805:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.150809:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7c39 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.150814:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7c39 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00080000:3.0:1763343038.150900:0:6527:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763343038.150915:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56909:x1848997993630208:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 17755us (18103us total) trans 8589940134 rc 0/0 00000100:00100000:3.0:1763343038.150927:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3240 00000100:00100000:0.0:1763343038.150971:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010288512:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343038.151047:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343038.151109:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343038.151116:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010288640:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343038.151140:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343038.151175:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.151183:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.151189:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.151194:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.151197:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.151204:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.151213:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:0.0:1763343038.151216:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343038.151219:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.151226:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae7c71 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00000100:00100000:0.0:1763343038.151270:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010288512 00000100:00100000:0.0:1763343038.151279:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010288512 00000100:00100000:0.0:1763343038.151320:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010288640 00000100:00100000:0.0:1763343038.151323:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010288640 00000100:00100000:0.0:1763343038.151344:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6677 00000100:00100000:0.0:1763343038.151354:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3657:x1848998010288512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343038.151388:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:695 count 1 00010000:00010000:0.0:1763343038.151418:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae7c8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.151439:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae7b44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac991d expref: 14 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.151448:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343038.151451:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343038.151455:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae7c8d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.151487:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae7b44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac991d expref: 14 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.151504:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae7b44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac991d expref: 14 pid: 27835 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1763343038.151517:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010289024:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343038.151568:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35085190c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343038.151587:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6678 00000100:00100000:0.0:1763343038.151595:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3657:x1848998010288640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343038.151607:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:696 count 1 00002000:00010000:0.0:1763343038.151661:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343038.151668:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae7c94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.151677:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.151679:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.151684:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae7c94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.151697:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae7c94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.151706:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae7c94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.151713:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae7c94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.151736:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343038.152054:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3657:x1848998010288640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 457us (910us total) trans 17179871661 rc 0/0 00000100:00100000:0.0:1763343038.152063:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6678 00010000:00010000:0.0:1763343038.152093:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343038.152100:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae7c94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.152108:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dcc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343038.152113:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae7c94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.152121:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae7c94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.152137:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae7c94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.152150:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae7c94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.152165:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343038.152167:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343038.152169:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343038.152202:0:3657:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871657 gen 2 00000004:00080000:0.0:1763343038.152208:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b91f80, transno 17179871536 00000004:00080000:0.0:1763343038.152229:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b91180, transno 17179871537 00000004:00080000:0.0:1763343038.152232:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b90380, transno 17179871538 00000004:00080000:0.0:1763343038.152235:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b93800, transno 17179871539 00000004:00080000:0.0:1763343038.152238:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a4a80, transno 17179871540 00000004:00080000:0.0:1763343038.152241:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a4380, transno 17179871541 00000004:00080000:0.0:1763343038.152244:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a5880, transno 17179871542 00000004:00080000:0.0:1763343038.152247:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a5180, transno 17179871543 00000004:00080000:0.0:1763343038.152249:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a5c00, transno 17179871545 00000004:00080000:0.0:1763343038.152252:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a4700, transno 17179871546 00000004:00080000:0.0:1763343038.152255:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a5500, transno 17179871547 00000004:00080000:0.0:1763343038.152258:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a6680, transno 17179871548 00000004:00080000:0.0:1763343038.152261:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34060ace00, transno 17179871551 00000004:00080000:0.0:1763343038.152264:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34060af100, transno 17179871552 00000004:00080000:0.0:1763343038.152267:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b9180, transno 17179871553 00000004:00080000:0.0:1763343038.152270:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095bbb80, transno 17179871554 00000004:00080000:0.0:1763343038.152274:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad3480, transno 17179871558 00000004:00080000:0.0:1763343038.152277:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad1f80, transno 17179871559 00000004:00080000:0.0:1763343038.152280:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad0a80, transno 17179871560 00000004:00080000:0.0:1763343038.152283:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad0700, transno 17179871561 00000004:00080000:0.0:1763343038.152286:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a4000, transno 17179871562 00000004:00080000:0.0:1763343038.152289:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a7480, transno 17179871563 00000004:00080000:0.0:1763343038.152292:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537910a80, transno 17179871564 00000004:00080000:0.0:1763343038.152294:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a4e00, transno 17179871565 00000004:00080000:0.0:1763343038.152298:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c251f80, transno 17179871568 00000004:00080000:0.0:1763343038.152300:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c253100, transno 17179871569 00000004:00080000:0.0:1763343038.152303:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c252300, transno 17179871570 00000004:00080000:0.0:1763343038.152306:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c251c00, transno 17179871571 00000004:00080000:0.0:1763343038.152308:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a6a00, transno 17179871575 00000004:00080000:0.0:1763343038.152311:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a5f80, transno 17179871576 00000004:00080000:0.0:1763343038.152314:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a7b80, transno 17179871577 00000004:00080000:0.0:1763343038.152317:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a6d80, transno 17179871578 00000004:00080000:0.0:1763343038.152319:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34060ab800, transno 17179871579 00000004:00080000:0.0:1763343038.152322:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34060ab480, transno 17179871580 00000004:00080000:0.0:1763343038.152324:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34060a8000, transno 17179871581 00000004:00080000:0.0:1763343038.152327:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34060abb80, transno 17179871582 00000004:00080000:0.0:1763343038.152330:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052af800, transno 17179871584 00000004:00080000:0.0:1763343038.152333:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052ac000, transno 17179871585 00000004:00080000:0.0:1763343038.152336:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052ad880, transno 17179871586 00000004:00080000:0.0:1763343038.152338:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052adc00, transno 17179871587 00000004:00080000:0.0:1763343038.152341:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a353876e300, transno 17179871589 00000004:00080000:0.0:1763343038.152345:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a353876d500, transno 17179871590 00000004:00080000:0.0:1763343038.152347:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a353876ea00, transno 17179871591 00000004:00080000:0.0:1763343038.152350:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a353876c700, transno 17179871592 00000004:00080000:0.0:1763343038.152353:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b2680, transno 17179871594 00000004:00080000:0.0:1763343038.152356:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b1880, transno 17179871595 00000004:00080000:0.0:1763343038.152358:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b3480, transno 17179871596 00000004:00080000:0.0:1763343038.152361:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b1180, transno 17179871597 00000004:00080000:0.0:1763343038.152364:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a5f80, transno 17179871599 00000004:00080000:0.0:1763343038.152367:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a7800, transno 17179871600 00000004:00080000:0.0:1763343038.152370:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a5880, transno 17179871601 00000004:00080000:0.0:1763343038.152373:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a4a80, transno 17179871602 00000004:00080000:0.0:1763343038.152376:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3503521f80, transno 17179871605 00000004:00080000:0.0:1763343038.152379:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3503521880, transno 17179871606 00000004:00080000:0.0:1763343038.152382:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a351fc74e00, transno 17179871607 00000004:00080000:0.0:1763343038.152385:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a351fc76d80, transno 17179871608 00000004:00080000:0.0:1763343038.152388:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b4700, transno 17179871612 00000004:00080000:0.0:1763343038.152390:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b5880, transno 17179871613 00000004:00080000:0.0:1763343038.152393:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a353876ca80, transno 17179871614 00000004:00080000:0.0:1763343038.152396:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406551880, transno 17179871615 00000004:00080000:0.0:1763343038.152399:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7d180, transno 17179871616 00000004:00080000:0.0:1763343038.152402:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a351fc74a80, transno 17179871617 00000004:00080000:0.0:1763343038.152405:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7c000, transno 17179871618 00000004:00080000:0.0:1763343038.152408:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7ca80, transno 17179871619 00000004:00080000:0.0:1763343038.152410:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b8380, transno 17179871621 00000004:00080000:0.0:1763343038.152413:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3503521180, transno 17179871622 00000004:00080000:0.0:1763343038.152416:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3503522300, transno 17179871623 00000004:00080000:0.0:1763343038.152419:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3503523b80, transno 17179871624 00000004:00080000:0.0:1763343038.152422:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b0e00, transno 17179871626 00000004:00080000:0.0:1763343038.152425:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34034f2d80, transno 17179871627 00000004:00080000:0.0:1763343038.152429:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a353796b100, transno 17179871628 00000004:00080000:0.0:1763343038.152431:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b0a80, transno 17179871629 00000004:00080000:0.0:1763343038.152435:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f38700, transno 17179871632 00000004:00080000:0.0:1763343038.152437:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f3ad80, transno 17179871633 00000004:00080000:0.0:1763343038.152451:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c39880, transno 17179871635 00000004:00080000:0.0:1763343038.152454:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c39c00, transno 17179871636 00000004:00080000:0.0:1763343038.152457:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c3bdf80, transno 17179871640 00000004:00080000:0.0:1763343038.152460:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c3bdc00, transno 17179871641 00000004:00080000:0.0:1763343038.152463:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c3bf800, transno 17179871642 00000004:00080000:0.0:1763343038.152466:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c3bca80, transno 17179871643 00000004:00080000:0.0:1763343038.152469:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340ccc3b80, transno 17179871644 00000004:00080000:0.0:1763343038.152472:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340ccc1880, transno 17179871645 00000004:00080000:0.0:1763343038.152475:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340ccc0e00, transno 17179871647 00000004:00080000:0.0:1763343038.152478:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340ccc2680, transno 17179871648 00000004:00080000:0.0:1763343038.152481:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340ccc3800, transno 17179871649 00000004:00080000:0.0:1763343038.152483:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340ccc2300, transno 17179871650 00000004:00080000:0.0:1763343038.152486:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340ccc3480, transno 17179871651 00000004:00080000:0.0:1763343038.152489:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340ccc0700, transno 17179871652 00000004:00080000:0.0:1763343038.152492:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c3b100, transno 17179871654 00000004:00080000:0.0:1763343038.152495:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537912d80, transno 17179871655 00000004:00080000:0.0:1763343038.152498:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478d880, transno 17179871656 00000004:00080000:0.0:1763343038.152501:0:3657:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478d180, transno 17179871657 00000100:00100000:0.0:1763343038.152508:0:3657:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a34062f2300 x1848998010288640/t17179871661(17179871661) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763343054 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763343038.152520:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062f2300/2, rc 0, transno 17179871661 00000100:00100000:0.0:1763343038.152525:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010288640:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343038.152910:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010288768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343038.152972:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343038.153022:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343038.153031:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010288896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343038.153058:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343038.153182:0:32357:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 4 in progress, 3 in flight, 92 done 00000100:00100000:2.0:1763343038.153220:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010289536:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343038.153247:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343038.153277:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343038.153283:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010289408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343038.153303:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343038.153848:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010288768 00000100:00100000:1.0:1763343038.153858:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010288768 00000100:00100000:1.0:1763343038.153910:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010288896 00000100:00100000:1.0:1763343038.153914:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010288896 00000100:00100000:1.0:1763343038.153927:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010289536 00000100:00100000:1.0:1763343038.153930:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010289536 00000100:00100000:1.0:1763343038.153944:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010289408 00000100:00100000:1.0:1763343038.153946:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010289408 00000100:00100000:1.0:1763343038.153964:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6679 00000100:00100000:1.0:1763343038.153974:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3659:x1848998010288768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763343038.154138:0:28994:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343038.154143:0:28994:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b5:0x0] updating lvb mtime from disk: 1763343037 -> 1763343037 00002000:00010000:1.0:1763343038.154146:0:28994:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2b5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343038.154149:0:28994:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b5:0x0] updating lvb ctime from disk: 1763343037 -> 1763343037 00002000:00010000:1.0:1763343038.154152:0:28994:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343038.154211:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3659:x1848998010288768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 238us (1240us total) trans 17179871662 rc 0/0 00000100:00100000:1.0:1763343038.154219:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6679 00000100:00100000:1.0:1763343038.154237:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6680 00000100:00100000:1.0:1763343038.154244:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3659:x1848998010288896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763343038.154297:0:28994:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343038.154300:0:28994:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb mtime from disk: 1763343037 -> 1763343037 00002000:00010000:1.0:1763343038.154302:0:28994:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343038.154305:0:28994:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb ctime from disk: 1763343037 -> 1763343037 00002000:00010000:1.0:1763343038.154307:0:28994:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343038.154333:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3659:x1848998010288896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (1276us total) trans 17179871663 rc 0/0 00000100:00100000:1.0:1763343038.154339:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6680 00000100:00100000:1.0:1763343038.154351:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6681 00000100:00100000:1.0:1763343038.154357:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3660:x1848998010289536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763343038.154434:0:28994:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343038.154438:0:28994:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb mtime from disk: 1763343037 -> 1763343037 00002000:00010000:1.0:1763343038.154440:0:28994:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343038.154442:0:28994:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb ctime from disk: 1763343037 -> 1763343037 00002000:00010000:1.0:1763343038.154444:0:28994:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343038.154482:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3660:x1848998010289536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (1233us total) trans 21474838958 rc 0/0 00000100:00100000:1.0:1763343038.154488:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6681 00000100:00100000:1.0:1763343038.154500:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6682 00000100:00100000:1.0:1763343038.154506:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3660:x1848998010289408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763343038.154555:0:28994:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343038.154558:0:28994:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb mtime from disk: 1763343037 -> 1763343037 00002000:00010000:1.0:1763343038.154560:0:28994:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb atime from disk: 1763343037 -> 1763343037 00002000:00010000:1.0:1763343038.154563:0:28994:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb ctime from disk: 1763343038 -> 1763343038 00002000:00010000:1.0:1763343038.154565:0:28994:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343038.154589:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3660:x1848998010289408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (1284us total) trans 21474838959 rc 0/0 00000100:00100000:1.0:1763343038.154595:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6682 00000004:00080000:1.0:1763343038.154675:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062f0380/2, rc 0, transno 17179871663 00000100:00100000:1.0:1763343038.154682:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010288896:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763343038.154692:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062f3480/2, rc 0, transno 17179871662 00000100:00100000:1.0:1763343038.154695:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010288768:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343038.155274:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478d180/2, rc 0, transno 21474838959 00000100:00100000:2.0:1763343038.155283:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010289408:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763343038.155294:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478d500/2, rc 0, transno 21474838958 00000100:00100000:2.0:1763343038.155297:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010289536:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343038.156202:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.157309:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993630848 00000100:00100000:1.0:1763343038.157326:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993630848 00000100:00100000:1.0:1763343038.157411:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9492 00000100:00100000:1.0:1763343038.157423:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:55941:x1848997993630848:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343038.157451:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.157482:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c9b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9986 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.157555:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c9b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9986 expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.157572:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c9b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9986 expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.157596:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:1.0:1763343038.157600:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343038.157604:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00000100:00100000:1.0:1763343038.157714:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:55941:x1848997993630848:12345-192.168.204.21@tcp:101:bash.0 Request processed in 292us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.157722:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9492 00000100:00100000:2.0:1763343038.158854:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.159085:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.159158:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010289024:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343038.159244:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae7c8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343038.159335:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993631104 00000100:00100000:0.0:1763343038.159345:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993631104 00010000:00010000:0.0:1763343038.159385:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae7b44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac991d expref: 15 pid: 27835 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1763343038.159427:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3130 00000100:00100000:0.0:1763343038.159437:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993631104:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343038.159454:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343038.159460:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae7b44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac991d expref: 15 pid: 27835 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343038.159473:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae7b44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac991d expref: 15 pid: 27835 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343038.159503:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92200/0x607405d401ae7b44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac991d expref: 15 pid: 27835 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343038.159521:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.159524:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.159529:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae7c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.159540:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae7c8d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.159571:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343038.159615:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993631104:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 179us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.159639:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3130 00000100:00100000:0.0:1763343038.159664:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993630976 00000100:00100000:0.0:1763343038.159667:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993630976 00000100:00100000:0.0:1763343038.159694:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9493 00000100:00100000:0.0:1763343038.159699:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56909:x1848997993630976:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.159724:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.159743:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae7ca2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac998d expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.159798:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae7ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac998d expref: 256 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.159811:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd000/0x607405d401ae7ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac998d expref: 256 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.159829:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:0.0:1763343038.159832:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343038.159835:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd000, rc 0) 00000100:00100000:0.0:1763343038.159856:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56909:x1848997993630976:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 156us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.159862:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9493 00000100:00100000:1.0:1763343038.159970:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010289280:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343038.160020:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343038.160063:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343038.160069:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010289152:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343038.160086:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343038.160160:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae7c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.160170:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae7c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.160181:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae7c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.160188:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae7c8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.160211:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343038.160489:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010288512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9135us (9440us total) trans 17179871664 rc 0/0 00000100:00100000:2.0:1763343038.160497:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6677 00000100:00100000:2.0:1763343038.160514:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010289280 00000100:00100000:2.0:1763343038.160518:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010289280 00000100:00100000:2.0:1763343038.160544:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010289152 00000100:00100000:2.0:1763343038.160547:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010289152 00000100:00100000:2.0:1763343038.160566:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6683 00000100:00100000:2.0:1763343038.160573:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3658:x1848998010289280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343038.160596:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:694 count 1 00002000:00010000:2.0:1763343038.160663:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343038.160670:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae7ca9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.160680:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343038.160683:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343038.160686:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae7ca9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.160698:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae7ca9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.160706:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae7ca9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.160712:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae7ca9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.160727:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763343038.160863:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3658:x1848998010289280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 291us (842us total) trans 21474838960 rc 0/0 00000100:00100000:2.0:1763343038.160884:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6683 00000100:00100000:2.0:1763343038.160897:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6684 00000100:00100000:2.0:1763343038.160903:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3658:x1848998010289152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343038.160913:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:693 count 1 00010000:00010000:2.0:1763343038.160923:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae7cb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.160937:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3501480a00/0x607405d401ae7b4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9924 expref: 19 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.160943:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343038.160945:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343038.160947:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae7cb0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.160977:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3501480a00/0x607405d401ae7b4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9924 expref: 19 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.160996:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3501480a00/0x607405d401ae7b4b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9924 expref: 19 pid: 27835 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343038.161009:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a354134f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010289664:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343038.161063:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a351ffa9840 going to sleep for 11 seconds 00010000:00010000:2.0:1763343038.161082:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343038.161088:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae7c8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.161096:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343038.161100:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae7c8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.161109:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae7c8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.161124:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae7c8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.161131:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae7c8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.161148:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343038.161151:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae7ca9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.161163:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343038.161166:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae7ca9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.161172:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae7ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.161179:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae7ca9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.161185:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae7ca9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.161194:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.161195:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.161197:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763343038.161231:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478d880/2, rc 0, transno 21474838960 00000100:00100000:2.0:1763343038.161237:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010289280:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763343038.161261:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062f0a80/2, rc 0, transno 17179871664 00000100:00100000:2.0:1763343038.161277:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010288512:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763343038.161787:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343038.167063:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a354134f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010289664:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343038.167101:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae7cb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343038.168461:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.168566:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.168763:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993631616 00000100:00100000:3.0:1763343038.168775:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993631616 00000100:00100000:2.0:1763343038.169760:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.169897:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993631744 00000100:00100000:1.0:1763343038.169908:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993631744 00010000:00010000:1.0:1763343038.169952:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501480a00/0x607405d401ae7b4b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9924 expref: 20 pid: 27835 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343038.169995:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3131 00000100:00100000:1.0:1763343038.170004:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993631744:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1763343038.170016:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3241 00000100:00100000:3.0:1763343038.170028:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56909:x1848997993631616:12345-192.168.204.21@tcp:35:lfs.0 00010000:00010000:1.0:1763343038.170028:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343038.170034:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3501480a00/0x607405d401ae7b4b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9924 expref: 20 pid: 27835 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343038.170049:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3501480a00/0x607405d401ae7b4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9924 expref: 20 pid: 27835 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343038.170084:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3501480a00/0x607405d401ae7b4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9924 expref: 20 pid: 27835 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343038.170107:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.170110:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.170116:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae7cb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.170128:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae7cb0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.170161:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343038.170226:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993631744:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 222us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.170234:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3131 00010000:00010000:1.0:1763343038.170269:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae7cb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.170279:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae7cb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.170290:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae7cb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.170300:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae7cb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.170326:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343038.170583:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3658:x1848998010289152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9679us (10494us total) trans 21474838961 rc 0/0 00000100:00100000:1.0:1763343038.170593:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6684 00010000:00010000:1.0:1763343038.170653:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343038.170660:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae7cb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.170668:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343038.170673:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae7cb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.170682:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae7cb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.170694:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae7cb0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.170700:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae7cb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.170718:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343038.170719:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343038.170721:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343038.170745:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993631360 00000100:00100000:1.0:1763343038.170750:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993631360 00000100:00100000:1.0:1763343038.170783:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9494 00000100:00100000:1.0:1763343038.170790:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:55941:x1848997993631360:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343038.170801:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.170803:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343038.170821:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7c9b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9986 expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.170835:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:1.0:1763343038.170840:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343038.170854:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7cb7 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9994 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.170908:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7cbe lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.170921:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7cbe lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.170929:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7cbe lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:1.0:1763343038.171108:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1472, 88 off124144 00000004:00080000:1.0:1763343038.171116:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231838494262ns, next at 1232093431049ns, rc = 0 00000040:00080000:1.0:1763343038.171179:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1473, 88 off124144 00000004:00080000:1.0:1763343038.171183:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231838561994ns, next at 1232093460684ns, rc = 0 00000040:00080000:1.0:1763343038.171199:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1474, 88 off124232 00000004:00080000:1.0:1763343038.171202:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231838581449ns, next at 1232093460684ns, rc = 0 00000040:00080000:1.0:1763343038.171209:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1473, 88 off124232 00000004:00080000:1.0:1763343038.171212:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231838591501ns, next at 1232093431049ns, rc = 0 00000004:00080000:2.0:1763343038.171758:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478c000/2, rc 0, transno 21474838961 00000100:00100000:2.0:1763343038.171779:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010289152:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1763343038.174057:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940137 is committed 00000004:00080000:2.0:1763343038.174077:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 971 committed 00000004:00080000:2.0:1763343038.174082:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 970 committed 00000004:00080000:2.0:1763343038.174093:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 969 committed 00000004:00080000:2.0:1763343038.174096:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 970 committed 00010000:00010000:0.0:1763343038.174176:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7c86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343038.174191:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7c86 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343038.174200:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7c86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343038.174207:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058ddc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.174213:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7c86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343038.174221:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7c86 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343038.174243:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:0.0:1763343038.174247:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.174254:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7c86 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343038.174260:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae7c86 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00080000:3.0:1763343038.176811:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1eb:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763343038.176918:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1474, 64 off124296 00000040:00080000:3.0:1763343038.176947:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1475, 64 off124296 00000040:00080000:3.0:1763343038.176957:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1476, 64 off124360 00000040:00080000:3.0:1763343038.176966:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1475, 64 off124360 00010000:00010000:3.0:1763343038.177054:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7cc5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343038.177075:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343038.177089:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343038.177100:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7cc5 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343038.177107:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7cc5 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343038.177112:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343038.177137:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343038.177416:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56909:x1848997993631616:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 7384us (8961us total) trans 8589940138 rc 0/0 00000100:00100000:3.0:1763343038.177427:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3241 00000100:00100000:1.0:1763343038.178047:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010289920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343038.178109:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343038.178151:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343038.178157:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010289792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343038.178182:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343038.178264:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010290048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343038.178292:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343038.178311:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343038.178317:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010290176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343038.178337:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343038.178372:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010289920 00000100:00100000:1.0:1763343038.178382:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010289920 00000100:00100000:1.0:1763343038.178430:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010289792 00000100:00100000:1.0:1763343038.178433:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010289792 00000100:00100000:1.0:1763343038.178452:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010290048 00000100:00100000:1.0:1763343038.178454:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010290048 00000100:00100000:1.0:1763343038.178471:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010290176 00000100:00100000:1.0:1763343038.178473:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010290176 00000100:00100000:1.0:1763343038.178491:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6685 00000100:00100000:1.0:1763343038.178499:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3658:x1848998010289920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343038.178712:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3658:x1848998010289920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (602us total) trans 21474838962 rc 0/0 00000100:00100000:1.0:1763343038.178719:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6685 00000100:00100000:1.0:1763343038.178738:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6686 00000100:00100000:1.0:1763343038.178744:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3658:x1848998010289792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343038.178810:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3658:x1848998010289792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (627us total) trans 21474838963 rc 0/0 00000100:00100000:1.0:1763343038.178816:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6686 00000100:00100000:1.0:1763343038.178827:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6687 00000100:00100000:1.0:1763343038.178833:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3659:x1848998010290048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343038.178949:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3659:x1848998010290048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (655us total) trans 17179871665 rc 0/0 00000100:00100000:1.0:1763343038.178956:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6687 00000100:00100000:1.0:1763343038.178969:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6688 00000100:00100000:1.0:1763343038.178974:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3659:x1848998010290176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343038.179042:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3659:x1848998010290176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (704us total) trans 17179871666 rc 0/0 00000100:00100000:1.0:1763343038.179048:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6688 00000004:00080000:1.0:1763343038.179109:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537911f80/2, rc 0, transno 17179871666 00000100:00100000:1.0:1763343038.179121:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537911f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010290176:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763343038.179131:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537913100/2, rc 0, transno 17179871665 00000100:00100000:1.0:1763343038.179134:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010290048:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763343038.179153:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537913b80/2, rc 0, transno 21474838963 00000100:00100000:1.0:1763343038.179161:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010289792:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343038.179171:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537910700/2, rc 0, transno 21474838962 00000100:00100000:1.0:1763343038.179174:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010289920:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343038.179256:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7cbe lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9994 expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.179271:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:1.0:1763343038.179274:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343038.179293:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7cb7 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9994 expref: 255 pid: 28422 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343038.179319:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7cbe lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9994 expref: 254 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.179352:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:1.0:1763343038.179355:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343038.179358:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343038.179409:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:55941:x1848997993631360:12345-192.168.204.21@tcp:101:bash.0 Request processed in 8619us (9657us total) trans 8589940137 rc 0/0 00000100:00100000:1.0:1763343038.179418:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9494 00010000:00010000:0.0:1763343038.179665:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343038.179675:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7cc5 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.179683:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343038.179687:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7cc5 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.179697:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.179710:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1eb:0x0].0x0 (ffff9a34037c4800) 00010000:00010000:0.0:1763343038.179713:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343038.179717:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7cc5 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.179723:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7cc5 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.179738:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343038.179740:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343038.179742:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343038.183359:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.183418:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.183420:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993632000 00000100:00100000:0.0:1763343038.183436:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993632000 00000100:00100000:0.0:1763343038.183516:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9495 00000100:00100000:0.0:1763343038.183529:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56909:x1848997993632000:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.183559:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.183591:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7ccc lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac999b expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.183723:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7cd3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.183741:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7cd3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.183754:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7cd3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.183768:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7cda lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.183775:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7cda lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.183782:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7cda lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.183948:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ce1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.183958:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.183965:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343038.183976:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ee:0x0]: returning size 2 00010000:00010000:0.0:1763343038.184076:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7cd3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.184083:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7cd3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.184089:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7cd3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.184095:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.184099:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7cd3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.184106:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7cd3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.184118:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4500) 00010000:00010000:0.0:1763343038.184121:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.184124:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7cd3 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.184130:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7cd3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.184142:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7cda lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.184148:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7cda lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.184153:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7cda lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.184157:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dda00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.184159:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7cda lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.184164:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7cda lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.184169:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4700) 00010000:00010000:0.0:1763343038.184171:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.184173:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7cda lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.184178:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7cda lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.184222:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7ccc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac999b expref: 257 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.184236:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac999b expref: 256 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.184243:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:0.0:1763343038.184246:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343038.184248:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd800, rc 0) 00000100:00100000:0.0:1763343038.184339:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56909:x1848997993632000:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 813us (998us total) trans 8589940139 rc 0/0 00000100:00100000:0.0:1763343038.184348:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9495 00000100:00100000:3.0:1763343038.185104:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993632128 00000100:00100000:3.0:1763343038.185113:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993632128 00000100:00100000:3.0:1763343038.185161:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6689 00000100:00100000:3.0:1763343038.185169:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:55941:x1848997993632128:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343038.185185:0:10294:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343038.185200:0:10294:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7cef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac99a2 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343038.185232:0:10294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343038.185249:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.185251:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.185259:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7cef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a2 expref: 20 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.185286:0:10294:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7cef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a2 expref: 20 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.185306:0:10294:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480e00, rc 0) 00000100:00100000:3.0:1763343038.185354:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:55941:x1848997993632128:12345-192.168.204.21@tcp:101:bash.0 Request processed in 184us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343038.185361:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6689 00000100:00100000:1.0:1763343038.188188:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.188238:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993632256 00000100:00100000:0.0:1763343038.188252:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993632256 00000100:00100000:1.0:1763343038.188419:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.188440:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6690 00000100:00100000:0.0:1763343038.188452:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:55941:x1848997993632256:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343038.188475:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.188505:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae7cf6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac99a9 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343038.188536:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343038.188562:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.188565:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1763343038.188566:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993632512 00000100:00100000:3.0:1763343038.188570:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993632512 00010000:00010000:0.0:1763343038.188576:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae7cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a9 expref: 15 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.188593:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae7cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a9 expref: 15 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.188608:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058ddc00, rc 0) 00000100:00100000:3.0:1763343038.188613:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3242 00000100:00100000:3.0:1763343038.188680:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350922b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56909:x1848997993632512:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343038.188711:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:55941:x1848997993632256:12345-192.168.204.21@tcp:101:bash.0 Request processed in 262us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.188719:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6690 00000100:00100000:3.0:1763343038.189527:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350922b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56909:x1848997993632512:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 902us (1102us total) trans 8589940140 rc 0/0 00000100:00100000:3.0:1763343038.189537:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3242 00000100:00100000:1.0:1763343038.193025:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.193131:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.193305:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.193426:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993632640 00000100:00100000:3.0:1763343038.193443:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993632640 00002000:00010000:3.0:1763343038.193502:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/695 (0->18446744073709551615) 00002000:00100000:3.0:1763343038.193509:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537910380 with x1848997993632640 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343038.193526:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537910380. 00000100:00100000:0.0:1763343038.193564:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993632768 00000100:00100000:0.0:1763343038.193569:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993632768 00002000:00010000:0.0:1763343038.193589:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/697 (0->18446744073709551615) 00002000:00100000:0.0:1763343038.193594:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d1a4a80 with x1848997993632768 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343038.193602:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340d1a4a80. 00000100:00100000:0.0:1763343038.193667:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1626 00000100:00100000:0.0:1763343038.193679:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993632640:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343038.193952:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343038.193956:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb mtime from disk: 0 -> 1763343038 00002000:00010000:0.0:1763343038.193959:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343038.193962:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb ctime from disk: 0 -> 1763343038 00002000:00010000:0.0:1763343038.193964:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343038.194044:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993632640:12345-192.168.204.21@tcp:10:bash.0 Request processed in 366us (1035us total) trans 21474838964 rc 0/0 00000100:00100000:0.0:1763343038.194054:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1626 00002000:00010000:0.0:1763343038.194059:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/695 (0->18446744073709551615) 00002000:00100000:0.0:1763343038.194062:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537910380 with x1848997993632640 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343038.194067:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537910380. 00000100:00100000:0.0:1763343038.194088:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1627 00000100:00100000:0.0:1763343038.194097:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993632768:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343038.194203:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343038.194206:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b9:0x0] updating lvb mtime from disk: 0 -> 1763343038 00002000:00010000:0.0:1763343038.194209:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2b9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343038.194211:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b9:0x0] updating lvb ctime from disk: 0 -> 1763343038 00002000:00010000:0.0:1763343038.194213:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343038.194234:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993632768:12345-192.168.204.21@tcp:10:bash.0 Request processed in 139us (1104us total) trans 17179871667 rc 0/0 00000100:00100000:0.0:1763343038.194242:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1627 00002000:00010000:0.0:1763343038.194245:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/697 (0->18446744073709551615) 00002000:00100000:0.0:1763343038.194248:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d1a4a80 with x1848997993632768 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343038.194253:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340d1a4a80. 00000100:00100000:2.0:1763343038.194610:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993632896 00000100:00100000:2.0:1763343038.194618:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993632896 00000100:00100000:2.0:1763343038.194676:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3243 00000100:00100000:2.0:1763343038.194683:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56909:x1848997993632896:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:2.0:1763343038.194808:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56909:x1848997993632896:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 126us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.194815:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3243 00000100:00100000:2.0:1763343038.214121:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.217316:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993633152 00000100:00100000:1.0:1763343038.217340:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993633152 00000100:00100000:1.0:1763343038.217446:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3244 00000100:00100000:1.0:1763343038.217458:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:55941:x1848997993633152:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:3.0:1763343038.217603:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.217909:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:55941:x1848997993633152:12345-192.168.204.21@tcp:35:bash.0 Request processed in 452us (3805us total) trans 8589940141 rc 0/0 00000100:00100000:1.0:1763343038.217919:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3244 00000100:00100000:0.0:1763343038.218091:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993633408 00000100:00100000:0.0:1763343038.218098:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993633408 00000100:00100000:0.0:1763343038.218148:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9496 00000100:00100000:0.0:1763343038.218156:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56914:x1848997993633408:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.218169:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.218197:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7cfd lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac99b0 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.218341:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7d04 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.218361:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7d04 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.218377:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7d04 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343038.218393:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ee:0x0]: returning size 5 00010000:00010000:0.0:1763343038.218483:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7cfd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b0 expref: 261 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.218505:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7d04 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b0 expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.218517:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:0.0:1763343038.218520:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763343038.218525:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dce00, rc 0) 00000100:00100000:0.0:1763343038.218570:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56914:x1848997993633408:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 414us (968us total) trans 8589940142 rc 0/0 00000100:00100000:0.0:1763343038.218578:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9496 00000100:00100000:3.0:1763343038.229057:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.229145:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993633664 00000100:00100000:0.0:1763343038.229160:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993633664 00000100:00100000:0.0:1763343038.229242:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9497 00000100:00100000:0.0:1763343038.229254:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56914:x1848997993633664:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.229290:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.229498:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7d12 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac99b7 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.229683:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.229701:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ce1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac999b expref: 261 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.229712:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.229758:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac999b expref: 261 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.229773:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ce1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac999b expref: 261 pid: 28422 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1763343038.229789:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010290304:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343038.229905:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35067e39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343038.234143:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.235557:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993633792 00000100:00100000:3.0:1763343038.235575:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993633792 00010000:00010000:3.0:1763343038.236432:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ce1 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac999b expref: 262 pid: 28422 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343038.236776:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3132 00000100:00100000:1.0:1763343038.236796:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:2430:x1848997993633792:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343038.236818:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343038.236828:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ce1 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac999b expref: 262 pid: 28422 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343038.236842:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ce1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac999b expref: 262 pid: 28422 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343038.236901:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:1.0:1763343038.236907:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.236919:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.236927:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.236952:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343038.237025:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7ce1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac999b expref: 262 pid: 28422 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343038.237039:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:2430:x1848997993633792:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 252us (2911us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.237045:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010290304:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343038.237046:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3132 00010000:00010000:0.0:1763343038.237072:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.237083:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.237089:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343038.237120:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ee:0x0]: returning size 5 00010000:00010000:0.0:1763343038.237304:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7d12 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b7 expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.237322:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b7 expref: 261 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.237329:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:0.0:1763343038.237331:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763343038.237335:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc000, rc 0) 00000100:00100000:0.0:1763343038.237384:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56914:x1848997993633664:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8133us (8343us total) trans 8589940143 rc 0/0 00000100:00100000:0.0:1763343038.237392:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9497 00000100:00100000:2.0:1763343038.243744:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.243807:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993633920 00000100:00100000:0.0:1763343038.243822:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993633920 00000100:00100000:0.0:1763343038.243911:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9498 00000100:00100000:0.0:1763343038.243924:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56915:x1848997993633920:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:0.0:1763343038.243954:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.243986:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7d27 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac99be expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.244078:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7d2e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.244096:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7d2e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.244110:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7d2e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.244126:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d35 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.244134:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.244140:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.244239:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7d3c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.244256:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b7 expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.244266:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7d3c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.244326:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b7 expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.244341:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b7 expref: 262 pid: 28422 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1763343038.244357:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010290432:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343038.244464:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f319c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343038.244487:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.244610:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993634048 00000100:00100000:2.0:1763343038.244616:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993634048 00000100:00100000:2.0:1763343038.244680:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9499 00000100:00100000:2.0:1763343038.244689:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56914:x1848997993634048:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343038.244703:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.244713:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7d43 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac99c5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.244789:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7d4a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.244798:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7d4a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.244805:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7d4a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:0.0:1763343038.247371:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010290432:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343038.247412:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7d3c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343038.247528:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.248134:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993634176 00000100:00100000:2.0:1763343038.248146:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993634176 00010000:00010000:2.0:1763343038.248197:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b7 expref: 265 pid: 28422 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343038.248246:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3133 00000100:00100000:2.0:1763343038.248257:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3542052450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:2429:x1848997993634176:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343038.248289:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343038.248298:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b7 expref: 265 pid: 28422 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343038.248312:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b7 expref: 265 pid: 28422 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343038.248340:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d19 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1ee:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b7 expref: 265 pid: 28422 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343038.248361:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:2.0:1763343038.248366:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7d3c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.248381:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7d3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.248389:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7d3c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.248398:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7d4a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.248405:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7d4a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.248411:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7d4a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.248453:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343038.248515:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3542052450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:2429:x1848997993634176:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 258us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.248523:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3133 00010000:00010000:3.0:1763343038.248722:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7d4a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.248730:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7d4a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.248795:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7d3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343038.248797:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ee:0x0]: returning size 5 00010000:00010000:0.0:1763343038.248802:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7d3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343038.248803:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00200000:0.0:1763343038.248822:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ee:0x0]: returning size 5 00000004:00200000:0.0:1763343038.248824:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343038.248828:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7d4a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00010000:0.0:1763343038.248833:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7d3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.248842:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7d3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.248852:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7d2e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.248859:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7d2e lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.248876:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7d2e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.248878:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae7d43 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99c5 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.248883:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.248888:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7d2e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.248896:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7d2e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.248897:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7d4a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99c5 expref: 263 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.248906:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:0.0:1763343038.248906:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4500) 00010000:00010000:3.0:1763343038.248908:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343038.248909:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343038.248911:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c200, rc 0) 00010000:00010000:0.0:1763343038.248913:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7d2e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.248919:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7d2e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.248929:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.248934:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d35 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.248940:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.248945:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dcc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.248948:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343038.248951:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56914:x1848997993634048:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4264us (4465us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343038.248954:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d35 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343038.248959:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9499 00010000:00010000:0.0:1763343038.248962:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4700) 00010000:00010000:0.0:1763343038.248964:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.248967:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d35 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.248972:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d35 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.248998:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7d27 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99be expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.249011:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7d3c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99be expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.249018:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:0.0:1763343038.249020:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343038.249022:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc600, rc 0) 00000100:00100000:0.0:1763343038.249046:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56915:x1848997993633920:12345-192.168.204.21@tcp:101:rm.0 Request processed in 5126us (5320us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.249053:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9498 00000100:00100000:1.0:1763343038.253680:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.253733:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.254055:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993634688 00000100:00100000:2.0:1763343038.254070:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993634688 00000100:00100000:2.0:1763343038.254137:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9500 00000100:00100000:2.0:1763343038.254148:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56915:x1848997993634688:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:2.0:1763343038.254220:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1763343038.254257:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae7cbe lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9994 expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.254297:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7d3c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99be expref: 261 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.254316:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7d4a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99c5 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.254331:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae7c7f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac997f expref: 259 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.254342:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:2.0:1763343038.254348:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343038.254385:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7d51 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.254399:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7d51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.254410:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7d51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.254425:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7d58 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.254432:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7d58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.254438:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7d58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.254542:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7d5f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.254553:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7d04 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b0 expref: 258 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.254566:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7d5f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.254606:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7d04 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b0 expref: 258 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.254658:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7d04 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b0 expref: 258 pid: 28422 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343038.254677:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010290560:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343038.254780:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe900 going to sleep for 11 seconds 00000100:00100000:0.0:1763343038.255233:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993634432 00000100:00100000:0.0:1763343038.255242:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993634432 00000100:00100000:0.0:1763343038.255303:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3245 00000100:00100000:0.0:1763343038.255314:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56914:x1848997993634432:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343038.255648:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56914:x1848997993634432:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 335us (1982us total) trans 8589940144 rc 0/0 00000100:00100000:0.0:1763343038.255658:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3245 00000100:00100000:0.0:1763343038.257912:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010290560:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343038.257952:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7d5f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343038.259010:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.259123:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993634816 00000100:00100000:3.0:1763343038.259134:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993634816 00010000:00010000:3.0:1763343038.259182:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7d04 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b0 expref: 260 pid: 28422 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1763343038.259232:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3134 00000100:00100000:3.0:1763343038.259243:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56914:x1848997993634816:12345-192.168.204.21@tcp:103:lfs.0 00010000:00010000:3.0:1763343038.259492:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343038.259502:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7d04 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b0 expref: 260 pid: 28422 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343038.259517:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7d04 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b0 expref: 260 pid: 28422 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343038.259546:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7d04 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99b0 expref: 260 pid: 28422 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343038.259564:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:3.0:1763343038.259569:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7d5f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.259581:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7d5f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.259588:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7d5f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.259700:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343038.259775:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7d5f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343038.259777:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56914:x1848997993634816:12345-192.168.204.21@tcp:103:lfs.0 Request processed in 535us (773us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343038.259785:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7d5f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343038.259792:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3134 00000004:00080000:0.0:1763343038.260138:0:28422:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1ee:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763343038.260253:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7d5f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.260261:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7d5f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.260268:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7d5f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.260275:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.260281:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7d5f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.260288:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7d5f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.261244:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a3403bdcb00) 00010000:00010000:0.0:1763343038.261255:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343038.261262:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7d5f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.261271:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae7d5f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.261380:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7d51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.261387:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7d51 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.261393:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7d51 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.261399:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.261402:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7d51 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.261408:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7d51 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.261416:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935700) 00010000:00010000:0.0:1763343038.261490:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.261494:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7d51 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.261500:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7d51 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343038.261516:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001a658656 reply state 00000000301a95eb transno 8589940145 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7d58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.261529:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7d58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.261538:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935900) 00010000:00010000:0.0:1763343038.261540:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343038.261544:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343038.261739:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56915:x1848997993634688:12345-192.168.204.21@tcp:36:rm.0 Request processed in 7587us (7999us total) trans 8589940145 rc 0/0 00000100:00100000:0.0:1763343038.261749:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9500 00000100:00100000:3.0:1763343038.262056:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.262095:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993635200 00000100:00100000:0.0:1763343038.262104:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993635200 00000100:00100000:0.0:1763343038.262165:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9501 00000100:00100000:0.0:1763343038.262176:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56914:x1848997993635200:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.262203:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.262228:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7d66 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac99cc expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.262667:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d6d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.262682:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d6d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.262693:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d6d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343038.262706:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ee:0x0]: returning size 5 00010000:00010000:0.0:1763343038.262898:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7d66 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99cc expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.262917:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d6d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99cc expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.262930:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:0.0:1763343038.262933:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343038.262935:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc000, rc 0) 00000100:00100000:0.0:1763343038.262993:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56914:x1848997993635200:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 819us (937us total) trans 8589940146 rc 0/0 00000100:00100000:0.0:1763343038.262999:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9501 00000100:00100000:3.0:1763343038.265477:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.265535:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993635328 00000100:00100000:0.0:1763343038.265547:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993635328 00000100:00100000:0.0:1763343038.265640:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9502 00000100:00100000:0.0:1763343038.265652:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56914:x1848997993635328:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.265683:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.265708:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7d7b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac99d3 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.265776:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7d7b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99d3 expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.265793:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7d7b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99d3 expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.265819:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:0.0:1763343038.265822:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343038.265826:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dda00, rc 0) 00000100:00100000:0.0:1763343038.265904:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56914:x1848997993635328:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 254us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.265912:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9502 00000100:00100000:1.0:1763343038.267955:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.268082:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993635456 00000100:00100000:0.0:1763343038.268093:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993635456 00000100:00100000:0.0:1763343038.268157:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6691 00000100:00100000:0.0:1763343038.268167:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993635456:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:0.0:1763343038.268220:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.268241:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7cef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a2 expref: 21 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.268250:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343038.268252:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343038.268256:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d82 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.268392:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7cef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a2 expref: 21 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.268412:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7cef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a2 expref: 21 pid: 10294 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1763343038.268429:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010290688:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343038.268535:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31e40 going to sleep for 11 seconds 00000100:00100000:0.0:1763343038.271612:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010290688:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343038.271677:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.273285:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.273536:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993635584 00000100:00100000:0.0:1763343038.273548:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993635584 00002000:00100000:0.0:1763343038.273613:0:24021:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x2b7:0x0] (0->4) req@ffff9a340d1a5500 x1848997993635584/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:534/0 lens 496/0 e 0 to 0 dl 1763343049 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1763343038.273690:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00002000:00100000:0.0:1763343038.273710:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d1a5500 with x1848997993635584 ext(0->4) 00010000:00010000:0.0:1763343038.273725:0:24021:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7cef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a2 expref: 22 pid: 10294 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343038.273744:0:24021:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7cef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a2 expref: 22 pid: 10294 timeout: 1331 lvb_type: 0 00002000:00010000:0.0:1763343038.273753:0:24021:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a340d1a5500 00000100:00100000:0.0:1763343038.273788:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 109 00000100:00100000:0.0:1763343038.273799:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993635584:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:2.0:1763343038.274752:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993635712 00000100:00100000:2.0:1763343038.274763:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993635712 00000100:00100000:2.0:1763343038.274824:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9503 00000100:00100000:2.0:1763343038.274834:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56916:x1848997993635712:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343038.274850:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.274892:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7d89 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac99da expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.274972:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7d90 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.274987:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7d90 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.274999:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7d90 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.275010:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7d97 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.275017:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7d97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.275022:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7d97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:0.0:1763343038.275051:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2429:x1848997993635584:12345-192.168.204.21@tcp:4:bash.0 Request processed in 1252us (1783us total) trans 21474838965 rc 0/0 00000100:00100000:0.0:1763343038.275059:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 109 00010000:00010000:2.0:1763343038.275061:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7d90 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.275069:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7d90 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00002000:00100000:0.0:1763343038.275069:0:24021:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x2b7:0x0] (0->4) req@ffff9a340d1a5500 x1848997993635584/t21474838965(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:534/0 lens 496/448 e 0 to 0 dl 1763343049 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1763343038.275077:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7d90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00002000:00100000:0.0:1763343038.275078:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d1a5500 with x1848997993635584 ext(0->4) 00010000:00010000:2.0:1763343038.275084:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.275085:0:24021:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7cef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a2 expref: 24 pid: 10294 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343038.275089:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7d90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.275097:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7d90 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.275098:0:24021:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7cef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a2 expref: 24 pid: 10294 timeout: 1331 lvb_type: 0 00002000:00010000:0.0:1763343038.275106:0:24021:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a340d1a5500 00010000:00010000:2.0:1763343038.275111:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935000) 00010000:00010000:2.0:1763343038.275114:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.275119:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7d90 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.275125:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7d90 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.275141:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7d97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.275147:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7d97 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.275154:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7d97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.275159:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.275162:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7d97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.275167:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7d97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.275173:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935900) 00010000:00010000:2.0:1763343038.275176:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.275178:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7d97 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.275184:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7d97 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.275213:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7d89 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99da expref: 264 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.275223:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935000) 00010000:00010000:2.0:1763343038.275225:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.275229:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae7d89 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99da expref: 264 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.275242:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c200, rc 0) 00000100:00100000:2.0:1763343038.275277:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56916:x1848997993635712:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 446us (1588us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343038.275284:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9503 00000100:00100000:1.0:1763343038.278598:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.278960:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993635840 00000100:00100000:3.0:1763343038.278974:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993635840 00000100:00100000:3.0:1763343038.279045:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9504 00000100:00100000:3.0:1763343038.279057:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56916:x1848997993635840:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343038.279085:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343038.279116:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7d9e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac99e1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.279216:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae7da5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279233:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae7da5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279245:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae7da5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279258:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7dac lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279278:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7dac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279286:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7dac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279351:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae7da5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279363:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae7da5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279370:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae7da5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279377:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae7da5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279383:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501481200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343038.279387:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae7da5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279395:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae7da5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279410:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037be500) 00010000:00010000:3.0:1763343038.279414:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343038.279420:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae7da5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279426:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae7da5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279444:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7dac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279449:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7dac lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279454:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7dac lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279459:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343038.279462:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7dac lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279468:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7dac lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279475:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935900) 00010000:00010000:3.0:1763343038.279478:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343038.279481:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7dac lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279488:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae7dac lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.279520:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7d9e lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99e1 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.279531:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037be500) 00010000:00010000:3.0:1763343038.279534:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343038.279538:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae7d9e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99e1 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.279551:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480600, rc 0) 00000100:00100000:3.0:1763343038.279887:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56916:x1848997993635840:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 830us (1299us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343038.279895:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9504 00000100:00100000:2.0:1763343038.280007:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.280150:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993635968 00000100:00100000:3.0:1763343038.280157:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993635968 00010000:00010000:3.0:1763343038.280227:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7cef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a2 expref: 24 pid: 10294 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1763343038.280277:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3135 00000100:00100000:3.0:1763343038.280287:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2429:x1848997993635968:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343038.280302:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1763343038.280325:0:6509:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:3.0:1763343038.280328:0:6509:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1763343038.280335:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7cef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a2 expref: 24 pid: 10294 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343038.280348:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7cef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a2 expref: 24 pid: 10294 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343038.280368:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae7cef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a2 expref: 24 pid: 10294 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343038.280384:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.280386:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.280391:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.280401:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d82 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.280520:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343038.280520:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.280529:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.280551:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.280559:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343038.280561:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2429:x1848997993635968:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 276us (555us total) trans 0 rc 0/0 00010000:00010000:0.0:1763343038.280567:0:28995:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343038.280569:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3135 00010000:00010000:0.0:1763343038.280574:0:28995:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dcc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343038.280578:0:28995:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.280586:0:28995:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d82 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.280597:0:28995:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d82 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.280611:0:28995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7d82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343038.280687:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993635456:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 12522us (12744us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.280696:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6691 00000100:00100000:2.0:1763343038.282944:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.282994:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.283073:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993636096 00000100:00100000:3.0:1763343038.283086:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993636096 00000100:00100000:3.0:1763343038.283199:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993636352 00000100:00100000:3.0:1763343038.283204:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993636352 00000100:00100000:3.0:1763343038.283243:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9505 00000100:00100000:3.0:1763343038.283255:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56916:x1848997993636096:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343038.283290:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343038.283321:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7db3 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac99e8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343038.283379:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9506 00000100:00100000:0.0:1763343038.283390:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56914:x1848997993636352:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:3.0:1763343038.283404:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae7dba lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.283420:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343038.283421:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae7dba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.283434:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae7dba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.283444:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7d7b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99d3 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.283463:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:0.0:1763343038.283468:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343038.283490:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7dc1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343038.283498:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00010000:00010000:0.0:1763343038.283499:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7dc1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343038.283503:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343038.283506:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7dc1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.283540:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7db3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99e8 expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.283554:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae7dba lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99e8 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.283561:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037be400) 00010000:00010000:3.0:1763343038.283564:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343038.283566:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403529600, rc 0) 00000100:00100000:3.0:1763343038.283655:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56916:x1848997993636096:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 402us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343038.283664:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9505 00000040:00080000:0.0:1763343038.283788:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1476, 88 off124448 00000004:00080000:0.0:1763343038.283798:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231951176167ns, next at 1232093431049ns, rc = 0 00000040:00080000:0.0:1763343038.283836:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1477, 88 off124448 00000004:00080000:0.0:1763343038.283841:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231951220431ns, next at 1232093460684ns, rc = 0 00000040:00080000:0.0:1763343038.283879:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1478, 88 off124536 00000004:00080000:0.0:1763343038.283885:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1231951263863ns, next at 1232093460684ns, rc = 0 00000040:00080000:0.0:1763343038.283896:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1477, 88 off124536 00000004:00080000:0.0:1763343038.283900:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1231951278973ns, next at 1232093431049ns, rc = 0 00010000:00010000:1.0:1763343038.286251:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7d58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00000001:00080000:2.0:1763343038.286278:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940147 is committed 00010000:00010000:1.0:1763343038.286286:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7d58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00000004:00080000:2.0:1763343038.286288:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 973 committed 00010000:00010000:1.0:1763343038.286294:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7d58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.286301:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352cc00 already unused, calling callback (ffffffffc19a2550) 00000004:00080000:2.0:1763343038.286302:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 972 committed 00010000:00010000:1.0:1763343038.286307:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7d58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00000004:00080000:2.0:1763343038.286315:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 971 committed 00010000:00010000:1.0:1763343038.286317:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7d58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00000004:00080000:2.0:1763343038.286318:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 972 committed 00010000:00010000:1.0:1763343038.286336:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935900) 00010000:00010000:1.0:1763343038.286340:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.286345:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7d58 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.286351:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7d58 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343038.286581:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008488a42f reply state 00000000f46cbd8b transno 8589940147 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7dc1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.286599:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7dc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.286607:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:0.0:1763343038.286609:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343038.286613:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1763343038.286775:0:28422:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343038.286799:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56914:x1848997993636352:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 3405us (3797us total) trans 8589940147 rc 0/0 00000100:00100000:0.0:1763343038.286809:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9506 00010000:00010000:0.0:1763343038.286847:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7dc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.286855:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7dc1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.286860:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7dc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.286876:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.286879:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7dc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.286885:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7dc1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.286897:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:0.0:1763343038.286899:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343038.286902:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7dc1 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.286908:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7dc1 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343038.286992:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010290816:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343038.287037:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.287047:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343038.287081:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010291328:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343038.287102:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343038.287126:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1763343038.287133:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010290944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343038.287152:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343038.287165:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010291456:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343038.287184:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343038.287225:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010290816 00000100:00100000:1.0:1763343038.287232:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010291072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343038.287234:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010290816 00000100:00100000:2.0:1763343038.287275:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010291328 00000100:00100000:2.0:1763343038.287278:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010291328 00000100:00100000:2.0:1763343038.287296:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010290944 00000100:00100000:2.0:1763343038.287299:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010290944 00000100:00100000:2.0:1763343038.287314:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010291456 00000100:00100000:2.0:1763343038.287317:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010291456 00000100:00100000:2.0:1763343038.287337:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6692 00000100:00100000:1.0:1763343038.287338:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343038.287346:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3657:x1848998010290816:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343038.287361:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010291584:0@lo:2:osp-syn-0-0.0 00002000:00080000:2.0:1763343038.287379:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:693 count 1 00000100:00100000:1.0:1763343038.287381:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343038.287399:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1763343038.287404:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010291200:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763343038.287408:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae7dc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.287421:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343038.287429:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae79ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98a6 expref: 15 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.287436:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010291712:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1763343038.287438:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343038.287441:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343038.287445:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae7dc8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.287454:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343038.287476:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae79ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98a6 expref: 15 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.287482:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010291072 00000100:00100000:1.0:1763343038.287485:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010291072 00010000:00010000:2.0:1763343038.287492:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae79ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98a6 expref: 15 pid: 8407 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343038.287501:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010291584 00000100:00100000:1.0:1763343038.287503:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010291584 00000100:00100000:2.0:1763343038.287505:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010291840:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343038.287510:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010291200 00000100:00100000:1.0:1763343038.287512:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010291200 00000100:00100000:1.0:1763343038.287520:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010291712 00000100:00100000:1.0:1763343038.287522:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010291712 00000100:00100000:1.0:1763343038.287533:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6693 00000100:00100000:1.0:1763343038.287538:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3657:x1848998010291328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343038.287551:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:691 count 1 00000100:00100000:2.0:1763343038.287558:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe900 going to sleep for 11 seconds 00010000:00010000:1.0:1763343038.287568:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7dcf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343038.287574:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6694 00000100:00100000:2.0:1763343038.287581:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3657:x1848998010290944:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763343038.287582:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7c47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9971 expref: 21 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.287589:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343038.287591:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00002000:00080000:2.0:1763343038.287593:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:694 count 1 00010000:00010000:1.0:1763343038.287593:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7dcf lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.287604:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae7dd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.287612:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7c47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9971 expref: 21 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.287614:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae7be5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac994e expref: 15 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.287648:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7c47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9971 expref: 21 pid: 27835 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343038.287657:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343038.287659:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1763343038.287661:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010291968:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343038.287662:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae7dd6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.287681:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae7be5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac994e expref: 15 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.287687:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1bf00 going to sleep for 11 seconds 00010000:00010000:2.0:1763343038.287690:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae7be5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac994e expref: 15 pid: 27835 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343038.287700:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010292096:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343038.287704:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6695 00000100:00100000:1.0:1763343038.287711:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3657:x1848998010291456:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343038.287725:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726d80 going to sleep for 11 seconds 00002000:00080000:1.0:1763343038.287725:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:692 count 1 00010000:00010000:1.0:1763343038.287737:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae7ddd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343038.287741:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6696 00000100:00100000:2.0:1763343038.287748:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3659:x1848998010291072:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1763343038.287750:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae7c01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac995c expref: 21 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.287756:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343038.287758:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343038.287760:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae7ddd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.287777:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae7c01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac995c expref: 21 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.287785:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae7c01 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac995c expref: 21 pid: 27835 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343038.287794:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010292224:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343038.287817:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343038.287837:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6697 00000100:00100000:1.0:1763343038.287844:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3659:x1848998010291584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763343038.287925:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343038.287929:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b9:0x0] updating lvb mtime from disk: 1763343038 -> 1763343038 00002000:00010000:2.0:1763343038.287932:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2b9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343038.287934:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b9:0x0] updating lvb ctime from disk: 1763343038 -> 1763343038 00002000:00010000:2.0:1763343038.287936:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343038.287956:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3659:x1848998010291584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (573us total) trans 21474838966 rc 0/0 00000100:00100000:2.0:1763343038.287959:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3659:x1848998010291072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 212us (696us total) trans 17179871668 rc 0/0 00000100:00100000:1.0:1763343038.287964:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6697 00000100:00100000:0.0:1763343038.288300:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993636480 00000100:00100000:0.0:1763343038.288307:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993636480 00000100:00100000:0.0:1763343038.288351:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9507 00000100:00100000:0.0:1763343038.288359:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56916:x1848997993636480:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.288373:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.288391:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7de4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac99ef expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.288458:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7deb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288473:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7deb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343038.288483:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6696 00010000:00010000:0.0:1763343038.288485:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7deb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288501:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7df2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343038.288502:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6698 00000100:00100000:2.0:1763343038.288508:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3659:x1848998010291200:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763343038.288508:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7df2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288515:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7df2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288563:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7deb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288570:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7deb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288575:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7deb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288581:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7deb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288586:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.288590:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7deb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288596:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7deb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343038.288604:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3659:x1848998010291200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (1181us total) trans 17179871669 rc 0/0 00010000:00010000:0.0:1763343038.288607:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037be400) 00000100:00100000:2.0:1763343038.288610:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6698 00010000:00010000:0.0:1763343038.288610:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.288614:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7deb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288640:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7deb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343038.288642:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6699 00000100:00100000:2.0:1763343038.288648:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3659:x1848998010291712:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763343038.288654:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7df2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288660:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7df2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288665:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7df2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288671:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.288673:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7df2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288679:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7df2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288687:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4500) 00010000:00010000:0.0:1763343038.288690:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.288693:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7df2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.288698:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7df2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343038.288716:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3659:x1848998010291712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1261us total) trans 21474838967 rc 0/0 00000100:00100000:2.0:1763343038.288723:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6699 00010000:00010000:0.0:1763343038.288729:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7de4 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99ef expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.288739:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037be400) 00010000:00010000:0.0:1763343038.288741:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.288745:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7de4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99ef expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.288753:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dce00, rc 0) 00000100:00100000:0.0:1763343038.288800:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56916:x1848997993636480:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 442us (1763us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343038.288807:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9507 00000004:00080000:0.0:1763343038.288960:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062cb800/2, rc 0, transno 17179871669 00000100:00100000:0.0:1763343038.288968:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010291200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343038.288983:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478c700/2, rc 0, transno 21474838967 00000100:00100000:0.0:1763343038.288988:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010291712:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343038.288997:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062ca680/2, rc 0, transno 17179871668 00000100:00100000:0.0:1763343038.289000:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010291072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343038.289008:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478e300/2, rc 0, transno 21474838966 00000100:00100000:0.0:1763343038.289011:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010291584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343038.291896:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.291936:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.291975:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.292015:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.292041:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.292072:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993636736 00000100:00100000:0.0:1763343038.292085:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993636736 00010000:00010000:0.0:1763343038.292138:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7c47 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9971 expref: 22 pid: 27835 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1763343038.292177:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993636608 00000100:00100000:0.0:1763343038.292180:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993636608 00010000:00010000:0.0:1763343038.292202:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae79ed lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98a6 expref: 16 pid: 8407 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1763343038.292215:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993636992 00000100:00100000:0.0:1763343038.292218:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993636992 00010000:00010000:0.0:1763343038.292231:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae7be5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac994e expref: 17 pid: 27835 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1763343038.292242:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993637120 00000100:00100000:0.0:1763343038.292245:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993637120 00010000:00010000:0.0:1763343038.292257:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae7c01 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac995c expref: 23 pid: 27835 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1763343038.292364:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3136 00000100:00100000:3.0:1763343038.292380:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2432:x1848997993636736:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763343038.292750:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010292224:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343038.292783:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae7ddd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.292809:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010291968:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343038.292819:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7dcf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.292903:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343038.292911:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7c47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9971 expref: 23 pid: 27835 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343038.292924:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7c47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9971 expref: 23 pid: 27835 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343038.292951:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7c47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9971 expref: 23 pid: 27835 timeout: 1331 lvb_type: 0 00010000:00010000:3.0:1763343038.292968:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.292971:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.292976:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7dcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.292986:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7dcf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.293020:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343038.293082:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2432:x1848997993636736:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 707us (1203us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343038.293131:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7dcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343038.293138:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3137 00010000:00010000:1.0:1763343038.293139:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7dcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343038.293148:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993636608:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343038.293149:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7dcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.293158:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7dcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.293159:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343038.293164:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae79ed lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98a6 expref: 17 pid: 8407 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343038.293175:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae79ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98a6 expref: 17 pid: 8407 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343038.293178:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343038.293190:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.293192:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.293195:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae7dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.293203:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae7dc8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.293215:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343038.293236:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993636608:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 90us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.293242:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3137 00000100:00100000:0.0:1763343038.293261:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3138 00000100:00100000:0.0:1763343038.293474:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2431:x1848997993636992:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343038.293485:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343038.293489:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae7be5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac994e expref: 16 pid: 27835 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343038.293498:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae7be5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac994e expref: 16 pid: 27835 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343038.293509:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.293511:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.293514:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae7dd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.293521:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae7dd6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.293533:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343038.293551:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2431:x1848997993636992:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 80us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.293579:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3139 00000100:00100000:2.0:1763343038.293602:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2431:x1848997993637120:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343038.293612:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343038.293617:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae7c01 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac995c expref: 22 pid: 27835 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343038.293654:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae7c01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac995c expref: 22 pid: 27835 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343038.293667:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae7c01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac995c expref: 22 pid: 27835 timeout: 1331 lvb_type: 0 00010000:00010000:2.0:1763343038.293678:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343038.293680:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343038.293683:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae7ddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.293691:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae7ddd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.293710:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343038.293778:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3136 00000100:00100000:2.0:1763343038.293783:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2431:x1848997993637120:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 186us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.293795:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3139 00000100:00100000:0.0:1763343038.293847:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3138 00000100:00100000:0.0:1763343038.293905:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993636864 00000100:00100000:0.0:1763343038.293913:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993636864 00000100:00100000:1.0:1763343038.293940:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3657:x1848998010291328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6399us (6835us total) trans 21474838968 rc 0/0 00010000:00010000:2.0:1763343038.293941:0:28996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c600/0x607405d401ae7be5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac994e expref: 15 pid: 27835 timeout: 1331 lvb_type: 0 00000100:00100000:1.0:1763343038.293951:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6693 00000100:00100000:2.0:1763343038.293953:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010292096:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343038.293971:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae7dd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.293977:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343038.293980:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae7dd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.293986:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7dcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.293987:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae7dd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.293994:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343038.293996:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae7dd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.293999:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7dcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.294004:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae7dd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.294009:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7dcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.294023:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7dcf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.294029:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343038.294031:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7dcf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.294049:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343038.294053:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae7dd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.294058:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343038.294061:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae7dd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.294067:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae7dd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.294077:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae7dd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.294084:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae7dd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.294096:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343038.294097:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343038.294099:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343038.294109:0:8410:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae7ddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.294116:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae7ddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.294123:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae7ddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.294130:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae7ddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.294144:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343038.294247:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3657:x1848998010290944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6665us (7092us total) trans 17179871670 rc 0/0 00000100:00100000:1.0:1763343038.294247:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3657:x1848998010291456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6535us (7060us total) trans 21474838969 rc 0/0 00000100:00100000:1.0:1763343038.294255:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6695 00000100:00100000:0.0:1763343038.294331:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9508 00000100:00100000:0.0:1763343038.294338:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+253:56914:x1848997993636864:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.294361:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.294382:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae7df9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac99f6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.294444:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae7df9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99f6 expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.294459:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae7df9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99f6 expref: 254 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.294480:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:0.0:1763343038.294484:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343038.294488:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34049c8200, rc 0) 00010000:00010000:3.0:1763343038.294491:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343038.294498:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae7ddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.294505:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343038.294508:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae7ddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343038.294513:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56914:x1848997993636864:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 177us (2538us total) trans 0 rc 0/0 00010000:00010000:3.0:1763343038.294515:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae7ddd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343038.294520:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9508 00010000:00010000:3.0:1763343038.294528:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae7ddd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.294535:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176600/0x607405d401ae7ddd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.294549:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343038.294550:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343038.294552:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343038.294584:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:1.0:1763343038.294592:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343038.294641:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993637376 00000100:00100000:3.0:1763343038.294646:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993637376 00000100:00100000:3.0:1763343038.294675:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9509 00000100:00100000:3.0:1763343038.294681:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56916:x1848997993637376:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343038.294689:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343038.294691:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343038.294705:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529600/0x607405d401ae7dba lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99e8 expref: 254 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.294720:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037be400) 00010000:00010000:3.0:1763343038.294728:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343038.294736:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae7e00 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac99fd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.294835:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7e07 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.294845:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7e07 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.294853:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7e07 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.294874:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7e0e lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.294880:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7e0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.294886:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7e0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343038.295177:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6694 00010000:00010000:2.0:1763343038.295233:0:28995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d200/0x607405d401ae79ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac98a6 expref: 14 pid: 8407 timeout: 1331 lvb_type: 0 00000100:00100000:2.0:1763343038.295245:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010291840:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343038.295263:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae7dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.295271:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae7dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.295278:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae7dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.295287:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae7dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.295294:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae7dc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.295313:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343038.295494:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3657:x1848998010290816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8147us (8444us total) trans 17179871671 rc 0/0 00000004:00080000:1.0:1763343038.295494:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062c8380/2, rc 0, transno 17179871670 00000100:00100000:2.0:1763343038.295500:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6692 00000100:00100000:1.0:1763343038.295500:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010290944:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1763343038.295515:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062f1880/2, rc 0, transno 21474838969 00010000:00010000:2.0:1763343038.295518:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1763343038.295521:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010291456:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763343038.295523:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae7dc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343038.295529:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062cad80/2, rc 0, transno 17179871671 00010000:00010000:2.0:1763343038.295532:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c200 already unused, calling callback (ffffffffc0d8ab40) 00000100:00100000:1.0:1763343038.295533:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010290816:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1763343038.295536:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae7dc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343038.295540:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062f1500/2, rc 0, transno 21474838968 00000100:00100000:1.0:1763343038.295543:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010291328:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763343038.295545:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae7dc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.295559:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae7dc8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.295566:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c200/0x607405d401ae7dc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.295580:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.295582:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.295584:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343038.296233:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae7e15 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.296248:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae7e15 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.296257:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae7e15 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:3.0:1763343038.296268:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f0:0x0]: returning size 0 00010000:00010000:3.0:1763343038.296301:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7e07 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.296308:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7e07 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.296313:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7e07 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.296319:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7e07 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.296323:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403528c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343038.296327:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7e07 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.296332:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7e07 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.296340:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037be500) 00010000:00010000:3.0:1763343038.296342:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343038.296346:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7e07 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.296353:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528c00/0x607405d401ae7e07 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:3.0:1763343038.296364:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005d6d2cfc reply state 00000000e16ff3f6 transno 8589940148 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7e0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.296376:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7e0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.296382:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037be200) 00010000:00010000:3.0:1763343038.296384:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343038.296387:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343038.296424:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529800/0x607405d401ae7e00 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99fd expref: 256 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.296443:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae7e15 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99fd expref: 255 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.296451:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a34037bee00) 00010000:00010000:3.0:1763343038.296453:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343038.296456:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403529e00, rc 0) 00000100:00100000:3.0:1763343038.296517:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56916:x1848997993637376:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1836us (1934us total) trans 8589940148 rc 0/0 00000100:00100000:3.0:1763343038.296525:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9509 00000100:00100000:0.0:1763343038.298904:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.299169:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993637504 00000100:00100000:3.0:1763343038.299184:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993637504 00000100:00100000:2.0:1763343038.299250:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.299347:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993637760 00000100:00100000:1.0:1763343038.299352:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993637760 00000100:00100000:1.0:1763343038.299393:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9510 00000100:00100000:3.0:1763343038.299403:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9511 00000100:00100000:3.0:1763343038.299414:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56916:x1848997993637760:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:1.0:1763343038.299434:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56914:x1848997993637504:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343038.299465:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.299465:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343038.299493:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7e2a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a0b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.299493:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7e23 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a04 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.299587:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7e31 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.299605:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7e31 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.299669:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7e31 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343038.299672:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7e38 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.299684:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae7e15 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99fd expref: 259 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.299693:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7e38 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343038.299704:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ee:0x0]: returning size 5 00000004:00200000:1.0:1763343038.299709:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343038.299733:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7e31 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343038.299739:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae7e15 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99fd expref: 259 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.299753:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae7e15 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99fd expref: 260 pid: 6523 timeout: 1331 lvb_type: 0 00010000:00010000:1.0:1763343038.299762:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7e23 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a04 expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343038.299767:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3501218e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010292352:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343038.299787:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7e31 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a04 expref: 259 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.299796:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:1.0:1763343038.299800:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763343038.299803:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343038.300523:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56914:x1848997993637504:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1086us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.300534:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9510 00000100:00100000:3.0:1763343038.300654:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c900 going to sleep for 11 seconds 00000100:00100000:2.0:1763343038.304397:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.304517:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.306068:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993637888 00000100:00100000:0.0:1763343038.306088:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993637888 00010000:00010000:0.0:1763343038.306153:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae7e15 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99fd expref: 259 pid: 6523 timeout: 1331 lvb_type: 0 00000100:00100000:0.0:1763343038.306220:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3140 00000100:00100000:0.0:1763343038.306233:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3542051850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:2430:x1848997993637888:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343038.306256:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343038.306264:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae7e15 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99fd expref: 259 pid: 6523 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343038.306279:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae7e15 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99fd expref: 259 pid: 6523 timeout: 1331 lvb_type: 0 00010000:00010000:0.0:1763343038.306312:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a34037bee00) 00010000:00010000:0.0:1763343038.306320:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7e38 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.306332:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7e38 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.306340:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7e38 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.306366:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343038.306444:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3542051850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:2430:x1848997993637888:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 213us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.306452:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3140 00000100:00100000:1.0:1763343038.306658:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993638016 00000100:00100000:1.0:1763343038.306663:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993638016 00000100:00100000:1.0:1763343038.306703:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6700 00000100:00100000:1.0:1763343038.306710:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993638016:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343038.306728:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.306751:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7e3f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a12 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343038.306782:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b7:0x0] initial LVB size: 5, mtime: 0x691a7abe, atime: 0x0, ctime: 0x691a7abe, blocks: 0x8 00010000:00010000:1.0:1763343038.306803:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.306806:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.306818:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7e3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a12 expref: 21 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343038.306834:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7e3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a12 expref: 21 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343038.306855:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:1.0:1763343038.306896:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993638016:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 186us (2379us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.306902:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6700 00010000:00010000:3.0:1763343038.307304:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403529e00/0x607405d401ae7e15 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99fd expref: 258 pid: 6523 timeout: 1331 lvb_type: 0 00000100:00100000:3.0:1763343038.307327:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3501218e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010292352:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343038.307356:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7e38 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.307366:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7e38 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.307371:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7e38 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:3.0:1763343038.307397:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f0:0x0]: returning size 0 00000004:00080000:3.0:1763343038.307711:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2bb:0x0], index 1: 0 00000004:00080000:3.0:1763343038.307721:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2b9:0x0], index 0: 0 00000004:00080000:3.0:1763343038.307727:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2ba:0x0], index 0: 0 00000004:00080000:3.0:1763343038.307732:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2bc:0x0], index 1: 0 00010000:00010000:3.0:1763343038.307891:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7e38 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.307904:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7e38 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.307911:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7e38 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.307918:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343038.307923:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7e38 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.307931:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7e38 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.307946:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a34037bee00) 00010000:00010000:3.0:1763343038.307949:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343038.307953:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7e38 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.307959:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7e38 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.308017:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7e2a lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a0b expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.308029:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a34037bee00) 00010000:00010000:3.0:1763343038.308032:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343038.308035:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7e2a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a0b expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.308049:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dce00, rc 0) 00000100:00100000:3.0:1763343038.308119:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56916:x1848997993637760:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8707us (8869us total) trans 8589940149 rc 301/301 00000100:00100000:3.0:1763343038.308128:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9511 00000100:00100000:3.0:1763343038.317376:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.317504:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993638272 00000100:00100000:1.0:1763343038.317520:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993638272 00000100:00100000:1.0:1763343038.317600:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3246 00000100:00100000:1.0:1763343038.317612:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56916:x1848997993638272:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343038.318052:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56916:x1848997993638272:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 439us (689us total) trans 8589940150 rc 0/0 00000100:00100000:1.0:1763343038.318062:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3246 00000100:00100000:3.0:1763343038.320812:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.320914:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993638528 00000100:00100000:0.0:1763343038.320926:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993638528 00000100:00100000:0.0:1763343038.320994:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3247 00000100:00100000:0.0:1763343038.321004:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56916:x1848997993638528:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343038.321297:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56916:x1848997993638528:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 292us (497us total) trans 8589940151 rc 0/0 00000100:00100000:0.0:1763343038.321305:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3247 00000100:00100000:3.0:1763343038.327242:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.328426:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993638784 00000100:00100000:0.0:1763343038.328444:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993638784 00000100:00100000:0.0:1763343038.328531:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9512 00000100:00100000:0.0:1763343038.328547:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:55941:x1848997993638784:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343038.328581:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.328611:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7e4d lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a19 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.328805:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7e54 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.328823:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7e54 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.328838:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7e54 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.328851:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e5b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.328857:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.328875:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.328953:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7e62 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.328961:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7e62 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.328967:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7e62 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343038.328979:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f0:0x0]: returning size 0 00010000:00010000:0.0:1763343038.329088:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7e54 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.329096:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7e54 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.329101:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7e54 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.329107:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7e54 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.329114:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.329118:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7e54 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.329126:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7e54 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.329141:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4500) 00010000:00010000:0.0:1763343038.329144:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.329150:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7e54 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.329156:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7e54 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.329171:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.329176:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e5b lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.329181:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.329186:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.329189:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.329194:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.329201:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037be200) 00010000:00010000:0.0:1763343038.329204:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.329208:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e5b lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.329213:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e5b lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.329258:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7e4d lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a19 expref: 262 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.329281:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7e62 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a19 expref: 261 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.329288:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343038.329291:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343038.329293:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34049c8600, rc 0) 00000100:00100000:0.0:1763343038.329385:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:55941:x1848997993638784:12345-192.168.204.21@tcp:101:bash.0 Request processed in 843us (2155us total) trans 8589940152 rc 0/0 00000100:00100000:0.0:1763343038.329394:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9512 00000100:00100000:3.0:1763343038.342843:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.343011:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993638912 00000100:00100000:1.0:1763343038.343028:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993638912 00000100:00100000:1.0:1763343038.343111:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9513 00000100:00100000:1.0:1763343038.343124:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:55941:x1848997993638912:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343038.343156:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.343186:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7e70 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a20 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.343237:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7e77 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.343255:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7e77 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.343272:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7e77 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.343435:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7e70 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a20 expref: 263 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.343456:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7e77 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a20 expref: 262 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.343466:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:1.0:1763343038.343469:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343038.343473:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00000100:00100000:1.0:1763343038.343563:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993638912:12345-192.168.204.21@tcp:101:bash.0 Request processed in 441us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.343572:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9513 00000100:00100000:2.0:1763343038.345690:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.345775:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993639168 00000100:00100000:0.0:1763343038.345786:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993639168 00000100:00100000:0.0:1763343038.345843:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9514 00000100:00100000:0.0:1763343038.345851:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993639168:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343038.345921:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343038.345960:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7e62 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a19 expref: 262 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.345981:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343038.345986:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343038.346214:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7e7e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.346230:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7e7e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.346239:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7e7e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000001:00080000:0.0:1763343038.346300:0:6523:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940153 00000004:00010000:0.0:1763343038.346325:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003d2a92d9 reply state 00000000817a339f transno 8589940154 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7e7e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.346338:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7e7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.346345:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343038.346348:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343038.346350:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343038.346453:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993639168:12345-192.168.204.21@tcp:36:bash.0 Request processed in 600us (773us total) trans 8589940154 rc 0/0 00000100:00100000:0.0:1763343038.346462:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9514 00000020:00080000:0.0:1763343038.346467:0:6523:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343038.353680:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.353777:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993639296 00000100:00100000:1.0:1763343038.353790:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993639296 00000100:00100000:1.0:1763343038.353847:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9515 00000100:00100000:1.0:1763343038.353857:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993639296:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343038.353898:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.353925:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7e85 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a27 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.354018:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7e85 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a27 expref: 265 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.354038:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7e85 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a27 expref: 265 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.354062:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:1.0:1763343038.354068:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343038.354073:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:1.0:1763343038.354163:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993639296:12345-192.168.204.21@tcp:101:bash.0 Request processed in 305us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.354173:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9515 00000100:00100000:3.0:1763343038.359299:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.359414:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993639552 00000100:00100000:0.0:1763343038.359427:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993639552 00000100:00100000:0.0:1763343038.359497:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9516 00000100:00100000:0.0:1763343038.359507:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993639552:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343038.359533:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.359536:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343038.359571:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7e85 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a27 expref: 265 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.359595:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343038.359602:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343038.359677:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7e8c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a2e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.359736:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e93 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.359750:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e93 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.359760:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e93 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:0.0:1763343038.360062:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1479, 88 off124624 00000004:00080000:0.0:1763343038.360072:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232027451061ns, next at 1232093460684ns, rc = 0 00000040:00080000:0.0:1763343038.360117:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1478, 88 off124624 00000004:00080000:0.0:1763343038.360122:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232027501635ns, next at 1232093431049ns, rc = 0 00000040:00080000:0.0:1763343038.360139:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1479, 88 off124712 00000004:00080000:0.0:1763343038.360143:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232027522329ns, next at 1232093431049ns, rc = 0 00000040:00080000:0.0:1763343038.360153:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1480, 88 off124712 00000004:00080000:0.0:1763343038.360157:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232027536251ns, next at 1232093460684ns, rc = 0 00000001:00080000:2.0:1763343038.367425:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940155 is committed 00000004:00080000:2.0:1763343038.367448:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 974 committed 00000004:00080000:2.0:1763343038.367466:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 975 committed 00000004:00080000:2.0:1763343038.367488:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 974 committed 00000004:00080000:2.0:1763343038.367490:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 973 committed 00010000:00010000:0.0:1763343038.367590:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7e0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.367604:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7e0e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.367612:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7e0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.367652:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403528e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.367659:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7e0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.367668:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7e0e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.367689:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037be200) 00010000:00010000:0.0:1763343038.367693:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.367699:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7e0e lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.367706:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7e0e lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.367740:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7e7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.367746:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7e7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.367752:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7e7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.367757:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.367760:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7e7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.367765:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7e7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.367773:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343038.367776:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.367780:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7e7e lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.367785:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7e7e lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.367855:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e93 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f0:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a2e expref: 257 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.367874:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343038.367876:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343038.367895:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7e8c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a2e expref: 257 pid: 6523 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343038.367911:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e93 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a2e expref: 256 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.367948:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343038.367951:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343038.367953:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34049c9400, rc 0) 00000100:00100000:0.0:1763343038.368049:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:55941:x1848997993639552:12345-192.168.204.21@tcp:101:bash.0 Request processed in 8540us (8764us total) trans 8589940155 rc 0/0 00000100:00100000:0.0:1763343038.368061:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9516 00000100:00100000:1.0:1763343038.368285:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010292608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343038.368356:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343038.368407:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343038.368414:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010292480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343038.368437:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343038.368475:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010292608 00000100:00100000:1.0:1763343038.368483:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010292608 00000100:00100000:1.0:1763343038.368531:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010292480 00000100:00100000:1.0:1763343038.368534:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010292480 00000100:00100000:1.0:1763343038.368554:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6701 00000100:00100000:1.0:1763343038.368563:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+33:3658:x1848998010292608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343038.368820:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3658:x1848998010292608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 257us (463us total) trans 21474838970 rc 0/0 00000100:00100000:1.0:1763343038.368828:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6701 00000100:00100000:1.0:1763343038.368843:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6702 00000100:00100000:1.0:1763343038.368849:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+33:3658:x1848998010292480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343038.368927:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3658:x1848998010292480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (488us total) trans 21474838971 rc 0/0 00000100:00100000:1.0:1763343038.368933:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6702 00000004:00080000:1.0:1763343038.368977:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a7b80/2, rc 0, transno 21474838971 00000100:00100000:1.0:1763343038.368983:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010292480:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343038.368996:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a6d80/2, rc 0, transno 21474838970 00000100:00100000:1.0:1763343038.368999:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010292608:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343038.369402:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3501218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010292864:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343038.369441:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343038.369468:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343038.369473:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3501218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010292736:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343038.369493:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343038.369516:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010292864 00000100:00100000:3.0:1763343038.369521:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010292864 00000100:00100000:3.0:1763343038.369548:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010292736 00000100:00100000:3.0:1763343038.369551:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010292736 00000100:00100000:3.0:1763343038.369567:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6703 00000100:00100000:3.0:1763343038.369574:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3660:x1848998010292864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343038.369742:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3660:x1848998010292864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 167us (298us total) trans 17179871672 rc 0/0 00000100:00100000:3.0:1763343038.369749:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6703 00000100:00100000:3.0:1763343038.369764:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6704 00000100:00100000:3.0:1763343038.369771:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3660:x1848998010292736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343038.369840:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3660:x1848998010292736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (345us total) trans 17179871673 rc 0/0 00000100:00100000:3.0:1763343038.369846:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6704 00000004:00080000:3.0:1763343038.369889:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3501218a80/2, rc 0, transno 17179871673 00000100:00100000:3.0:1763343038.369895:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3501218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010292736:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343038.369903:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3501218000/2, rc 0, transno 17179871672 00000100:00100000:3.0:1763343038.369907:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3501218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010292864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343038.407309:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.407397:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993639680 00000100:00100000:1.0:1763343038.407414:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993639680 00000100:00100000:1.0:1763343038.407506:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6705 00000100:00100000:1.0:1763343038.407519:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:55941:x1848997993639680:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343038.407550:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.407585:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae7e9a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a35 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343038.407677:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343038.407714:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.407717:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.407731:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae7e9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a35 expref: 15 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.407758:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae7e9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a35 expref: 15 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.407776:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:2.0:1763343038.407912:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:55941:x1848997993639680:12345-192.168.204.21@tcp:101:bash.0 Request processed in 393us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.407921:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6705 00000100:00100000:2.0:1763343038.417768:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.417986:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993639808 00000100:00100000:1.0:1763343038.418002:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993639808 00000100:00100000:1.0:1763343038.418089:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6706 00000100:00100000:1.0:1763343038.418102:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:55941:x1848997993639808:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343038.418130:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.418164:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae7ea1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a3c expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343038.418201:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343038.418232:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.418235:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.418248:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae7ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a3c expref: 22 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.418269:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae7ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a3c expref: 22 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.418285:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:1.0:1763343038.418370:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:55941:x1848997993639808:12345-192.168.204.21@tcp:101:bash.0 Request processed in 270us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.418379:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6706 00000100:00100000:3.0:1763343038.421920:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.422140:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993639936 00000100:00100000:0.0:1763343038.422156:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993639936 00002000:00010000:0.0:1763343038.422220:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/699 (0->18446744073709551615) 00002000:00100000:0.0:1763343038.422226:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a350121b800 with x1848997993639936 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343038.422247:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a350121b800. 00000100:00100000:0.0:1763343038.422303:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1628 00000100:00100000:0.0:1763343038.422316:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2431:x1848997993639936:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343038.422606:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2bb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343038.422610:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2bb:0x0] updating lvb mtime from disk: 0 -> 1763343038 00002000:00010000:0.0:1763343038.422614:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2bb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343038.422617:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2bb:0x0] updating lvb ctime from disk: 0 -> 1763343038 00002000:00010000:0.0:1763343038.422679:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2bb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343038.422928:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2431:x1848997993639936:12345-192.168.204.21@tcp:10:bash.0 Request processed in 612us (1026us total) trans 17179871674 rc 0/0 00000100:00100000:0.0:1763343038.422938:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1628 00002000:00010000:0.0:1763343038.422942:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/699 (0->18446744073709551615) 00002000:00100000:0.0:1763343038.422945:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a350121b800 with x1848997993639936 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343038.422960:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a350121b800. 00000100:00100000:3.0:1763343038.423742:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.423816:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993640064 00000100:00100000:1.0:1763343038.423826:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993640064 00002000:00010000:1.0:1763343038.423874:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/697 (0->18446744073709551615) 00002000:00100000:1.0:1763343038.423879:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3501218380 with x1848997993640064 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343038.423889:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3501218380. 00000100:00100000:1.0:1763343038.423911:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1629 00000100:00100000:1.0:1763343038.423920:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2431:x1848997993640064:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:1.0:1763343038.424144:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343038.424148:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2b9:0x0] updating lvb mtime from disk: 0 -> 1763343038 00002000:00010000:1.0:1763343038.424151:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2b9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343038.424153:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2b9:0x0] updating lvb ctime from disk: 0 -> 1763343038 00002000:00010000:1.0:1763343038.424155:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343038.424219:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2431:x1848997993640064:12345-192.168.204.21@tcp:10:bash.0 Request processed in 299us (482us total) trans 21474838972 rc 0/0 00000100:00100000:1.0:1763343038.424227:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1629 00002000:00010000:1.0:1763343038.424230:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/697 (0->18446744073709551615) 00002000:00100000:1.0:1763343038.424233:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3501218380 with x1848997993640064 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343038.424238:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3501218380. 00000100:00100000:2.0:1763343038.427607:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.427752:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993640320 00000100:00100000:3.0:1763343038.427766:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993640320 00000100:00100000:3.0:1763343038.427832:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3248 00000100:00100000:3.0:1763343038.427843:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350922b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:55941:x1848997993640320:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:3.0:1763343038.428306:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350922b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:55941:x1848997993640320:12345-192.168.204.21@tcp:35:bash.0 Request processed in 463us (715us total) trans 8589940156 rc 0/0 00000100:00100000:3.0:1763343038.428316:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3248 00000100:00100000:2.0:1763343038.430518:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.430614:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993640448 00000100:00100000:3.0:1763343038.430650:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993640448 00000100:00100000:3.0:1763343038.430727:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6707 00000100:00100000:3.0:1763343038.430739:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e9cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2432:x1848997993640448:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:3.0:1763343038.430908:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e9cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2432:x1848997993640448:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 170us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343038.430916:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6707 00000100:00100000:0.0:1763343038.437003:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.437122:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993640576 00000100:00100000:2.0:1763343038.437136:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993640576 00000100:00100000:2.0:1763343038.437217:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9517 00000100:00100000:2.0:1763343038.437229:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56917:x1848997993640576:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:2.0:1763343038.437263:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.437296:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7ea8 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a43 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.437388:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7eaf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437407:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7eaf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437420:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7eaf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437435:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7eb6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437442:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437448:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437549:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7ebd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437560:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7ebd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437566:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7ebd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343038.437656:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f0:0x0]: returning size 5 00000004:00200000:2.0:1763343038.437661:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343038.437688:0:6523:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7ebd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437701:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7ebd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437711:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7eaf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437717:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7eaf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437724:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7eaf lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437730:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7eaf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437736:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.437741:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7eaf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437748:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7eaf lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437762:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935700) 00010000:00010000:2.0:1763343038.437766:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.437772:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7eaf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437779:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7eaf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437796:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437801:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7eb6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437806:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437811:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.437814:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437820:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7eb6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437826:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935000) 00010000:00010000:2.0:1763343038.437829:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.437831:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7eb6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437837:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7eb6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.437882:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7ea8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a43 expref: 259 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.437907:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7ebd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a43 expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.437914:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:2.0:1763343038.437917:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343038.437920:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:2.0:1763343038.438007:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56917:x1848997993640576:12345-192.168.204.21@tcp:101:rm.0 Request processed in 779us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.438016:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9517 00000100:00100000:2.0:1763343038.441993:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.442234:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993640704 00000100:00100000:1.0:1763343038.442248:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993640704 00000100:00100000:1.0:1763343038.442326:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6708 00000100:00100000:1.0:1763343038.442339:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2431:x1848997993640704:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:1.0:1763343038.442505:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2431:x1848997993640704:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 168us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.442513:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6708 00000100:00100000:3.0:1763343038.446253:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.448912:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993640960 00000100:00100000:1.0:1763343038.448933:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993640960 00000100:00100000:2.0:1763343038.449718:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9518 00000100:00100000:2.0:1763343038.449738:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56917:x1848997993640960:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:2.0:1763343038.449814:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343038.449848:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7e93 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a2e expref: 258 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.449884:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7ebd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a43 expref: 257 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.449898:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7e77 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a20 expref: 256 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.449910:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:2.0:1763343038.449923:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343038.449964:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7ec4 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.449983:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7ec4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.449993:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7ec4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.450005:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7ecb lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.450011:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7ecb lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.450017:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7ecb lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.450117:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7ed2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.450124:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7ed2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.450130:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7ed2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:2.0:1763343038.450455:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1481, 64 off124776 00000004:00080000:2.0:1763343038.450466:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232117844574ns, next at 1233117841489ns, rc = 0 00000040:00080000:2.0:1763343038.450494:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1480, 64 off124776 00000004:00080000:2.0:1763343038.450499:0:6523:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232117878734ns, next at 1233117877304ns, rc = 0 00000040:00080000:2.0:1763343038.450508:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1481, 64 off124840 00000040:00080000:2.0:1763343038.450517:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1482, 64 off124840 00010000:00010000:2.0:1763343038.450588:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7ed9 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.450603:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.450613:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.450655:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7ed9 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.450663:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7ed9 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343038.450669:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7ed9 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.451602:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343038.451615:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7ed9 lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.451669:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343038.451674:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7ed9 lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.451684:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7ed9 lrc: 5/0,0 mode: PW/PW res: [0x200000405:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.451703:0:13198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a3518935900) 00010000:00010000:0.0:1763343038.451706:0:13198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343038.451711:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7ed9 lrc: 3/0,0 mode: --/PW res: [0x200000405:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.451723:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343038.451724:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343038.451726:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.452240:0:6523:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1763343038.452250:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7ed9 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.452940:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7ed2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.452960:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7ed2 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.452967:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7ed2 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.452972:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.452977:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7ed2 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.452983:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7ed2 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.452996:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f0:0x0].0x0 (ffff9a3518935900) 00010000:00010000:0.0:1763343038.452998:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343038.453002:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7ed2 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.453007:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7ed2 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.453219:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7ec4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.453226:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7ec4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.453232:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7ec4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.453237:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7ec4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.453241:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.453244:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7ec4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.453249:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7ec4 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.453256:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935700) 00010000:00010000:0.0:1763343038.453259:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.453261:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7ec4 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.453277:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7ec4 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:0.0:1763343038.453291:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007e9655f7 reply state 000000004a52556f transno 8589940157 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7ecb lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.453306:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7ecb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.453315:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935000) 00010000:00010000:0.0:1763343038.453317:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343038.453322:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343038.453459:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56917:x1848997993640960:12345-192.168.204.21@tcp:36:rm.0 Request processed in 3720us (7215us total) trans 8589940157 rc 0/0 00000100:00100000:0.0:1763343038.453470:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9518 00000100:00100000:2.0:1763343038.455199:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.457484:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993641088 00000100:00100000:0.0:1763343038.457508:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993641088 00000100:00100000:0.0:1763343038.457645:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1630 00000100:00100000:0.0:1763343038.457657:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993641088:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:0.0:1763343038.457710:0:24021:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9200/0x607405d401ae7ee0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.457736:0:24021:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.457739:0:24021:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.457747:0:24021:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9200/0x607405d401ae7ee0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.457764:0:24021:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9200/0x607405d401ae7ee0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.457922:0:24021:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9200/0x607405d401ae7ee0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.457932:0:24021:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9200/0x607405d401ae7ee0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.457941:0:24021:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9200/0x607405d401ae7ee0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.457949:0:24021:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343038.458881:0:24021:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9200/0x607405d401ae7ee0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.458895:0:24021:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9200/0x607405d401ae7ee0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.458921:0:24021:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9200/0x607405d401ae7ee0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.458929:0:24021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34049c9200/0x607405d401ae7ee0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343038.459291:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993641088:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 1629us (4096us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763343038.459303:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1630 00000100:00100000:0.0:1763343038.474292:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.476030:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993641216 00000100:00100000:1.0:1763343038.476054:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993641216 00000100:00100000:1.0:1763343038.476151:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9519 00000100:00100000:1.0:1763343038.476163:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56918:x1848997993641216:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343038.476199:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.476232:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7ee7 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a4a expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.476323:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae7eee lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476341:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae7eee lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476357:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae7eee lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476370:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7ef5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476378:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476385:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476446:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae7eee lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476454:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae7eee lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476461:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae7eee lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476468:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae7eee lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476474:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.476479:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae7eee lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476488:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae7eee lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476501:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:1.0:1763343038.476504:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.476509:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae7eee lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476516:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae7eee lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476530:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476535:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7ef5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476541:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476545:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.476547:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476551:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7ef5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476557:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935000) 00010000:00010000:1.0:1763343038.476559:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.476561:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7ef5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476566:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae7ef5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.476593:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7ee7 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a4a expref: 258 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.476603:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:1.0:1763343038.476605:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.476609:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae7ee7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a4a expref: 258 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.476679:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00000100:00100000:1.0:1763343038.476781:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56918:x1848997993641216:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 619us (2503us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343038.476789:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9519 00000100:00100000:3.0:1763343038.477836:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.482768:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993641344 00000100:00100000:1.0:1763343038.482789:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993641344 00000100:00100000:1.0:1763343038.483160:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9520 00000100:00100000:1.0:1763343038.483173:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56914:x1848997993641344:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343038.483200:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.483229:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7efc lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a51 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.483279:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7f03 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.483297:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7f03 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.483312:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7f03 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343038.483460:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae7efc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a51 expref: 259 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.483483:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92200/0x607405d401ae7f03 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a51 expref: 258 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.483499:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:1.0:1763343038.483503:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343038.483507:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92200, rc 0) 00000100:00100000:1.0:1763343038.484233:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56914:x1848997993641344:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1056us (6395us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.484245:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9520 00000100:00100000:3.0:1763343038.485305:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.485765:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993641472 00000100:00100000:1.0:1763343038.485777:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993641472 00000100:00100000:0.0:1763343038.488317:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9521 00000100:00100000:0.0:1763343038.488355:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56918:x1848997993641472:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.488387:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.488424:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f0a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a58 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.488523:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f11 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488540:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f11 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488555:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f11 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488566:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f18 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488573:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488580:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488656:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f11 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488668:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f11 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488674:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f11 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488682:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f11 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488688:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.488693:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f11 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488701:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f11 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488717:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4500) 00010000:00010000:0.0:1763343038.488721:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.488726:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f11 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488733:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f11 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488750:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488755:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f18 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488761:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488765:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.488768:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488774:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f18 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488781:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935000) 00010000:00010000:0.0:1763343038.488784:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.488786:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f18 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488792:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f18 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.488824:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f0a lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a58 expref: 259 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.488834:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4500) 00010000:00010000:0.0:1763343038.488836:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.488840:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f0a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a58 expref: 259 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.488854:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34049c9200, rc 0) 00000100:00100000:0.0:1763343038.494438:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56918:x1848997993641472:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6082us (9119us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343038.494457:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9521 00000100:00100000:2.0:1763343038.496756:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.497040:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993641600 00000100:00100000:0.0:1763343038.497054:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993641600 00000100:00100000:0.0:1763343038.497147:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1631 00000100:00100000:0.0:1763343038.497161:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993641600:12345-192.168.204.21@tcp:4:lfs.0 00002000:00010000:0.0:1763343038.497234:0:24021:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343038.497245:0:24021:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae7f1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.497262:0:24021:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.497265:0:24021:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.497272:0:24021:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae7f1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.497288:0:24021:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae7f1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.500398:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.501547:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993641728 00000100:00100000:3.0:1763343038.501569:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993641728 00000100:00100000:3.0:1763343038.501693:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9522 00000100:00100000:3.0:1763343038.501708:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56918:x1848997993641728:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343038.501739:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343038.501774:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7f26 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a5f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.501876:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7f2d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.501894:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7f2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343038.501906:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7f2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343038.503481:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343038.503497:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343038.503573:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7f26 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a5f expref: 260 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.503599:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7f2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a5f expref: 259 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.503611:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bee00) 00010000:00010000:0.0:1763343038.503614:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343038.503641:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd200, rc 0) 00000100:00100000:0.0:1763343038.503752:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56918:x1848997993641728:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2045us (3369us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.503762:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9522 00000001:00080000:2.0:1763343038.505590:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871675 is committed 00000001:00080000:2.0:1763343038.505617:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871673 is committed 00002000:00010000:0.0:1763343038.508793:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2ba:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763343038.508809:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2ba:0x0] updating lvb mtime from disk: 0 -> 1763343038 00002000:00010000:0.0:1763343038.508812:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2ba:0x0] updating lvb ctime from disk: 0 -> 1763343038 00002000:00010000:0.0:1763343038.508816:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2ba:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763343038.508836:0:24021:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae7f1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.508851:0:24021:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae7f1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.508872:0:24021:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae7f1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.508880:0:24021:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c8600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343038.508886:0:24021:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae7f1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.508897:0:24021:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae7f1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.508923:0:24021:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae7f1f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.508932:0:24021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34049c8600/0x607405d401ae7f1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24021 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343038.511152:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993641600:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 13978us (14393us total) trans 17179871675 rc 0/0 00000100:00100000:0.0:1763343038.511172:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1631 00000100:00100000:1.0:1763343038.526691:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.526780:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993641856 00000100:00100000:0.0:1763343038.526794:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993641856 00000100:00100000:0.0:1763343038.526876:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9523 00000100:00100000:0.0:1763343038.526886:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56918:x1848997993641856:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.526915:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.526941:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7f34 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a66 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.527022:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f3b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527038:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527051:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527061:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f42 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527068:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527073:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527123:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f3b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527130:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f3b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527135:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527141:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f3b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527147:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.527153:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f3b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527160:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f3b lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527173:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bee00) 00010000:00010000:0.0:1763343038.527177:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.527182:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f3b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527188:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f3b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527202:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527208:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527213:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527219:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.527222:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527228:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527234:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935000) 00010000:00010000:0.0:1763343038.527236:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.527239:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f42 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527250:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f42 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.527279:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7f34 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a66 expref: 260 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.527290:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bee00) 00010000:00010000:0.0:1763343038.527293:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.527296:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7f34 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a66 expref: 260 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.527305:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34049c8600, rc 0) 00000100:00100000:0.0:1763343038.527383:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56918:x1848997993641856:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 497us (705us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343038.527392:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9523 00000100:00100000:2.0:1763343038.551367:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.551425:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.551536:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993642368 00000100:00100000:0.0:1763343038.551550:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993642368 00000100:00100000:0.0:1763343038.551664:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993642112 00000100:00100000:0.0:1763343038.551668:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993642112 00000100:00100000:0.0:1763343038.551700:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9524 00000100:00100000:0.0:1763343038.551711:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56914:x1848997993642368:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343038.551787:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343038.551821:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae7e31 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ee:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a04 expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.551847:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:0.0:1763343038.551853:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343038.551956:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7f49 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.551975:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7f49 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.551986:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7f49 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00010000:0.0:1763343038.552141:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006ce62c76 reply state 00000000b7a636a6 transno 8589940158 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7f49 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.552153:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7f49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.552159:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:0.0:1763343038.552162:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343038.552165:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343038.552283:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56914:x1848997993642368:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 572us (934us total) trans 8589940158 rc 0/0 00000100:00100000:0.0:1763343038.552291:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9524 00000100:00100000:0.0:1763343038.552314:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9525 00000100:00100000:0.0:1763343038.552323:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56918:x1848997993642112:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.552334:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.552337:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343038.552350:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7f2d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a5f expref: 260 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.552363:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bee00) 00010000:00010000:0.0:1763343038.552373:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343038.552385:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f50 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a6d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.552475:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f57 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.552484:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.552492:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.552502:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f5e lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.552509:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.552515:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.553010:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7f65 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.553020:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7f65 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.553027:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7f65 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343038.553036:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f2:0x0]: returning size 0 00010000:00010000:0.0:1763343038.553066:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f57 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.553072:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f57 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.553082:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f57 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.553089:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f57 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.553095:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.553100:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f57 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.553108:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f57 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.553116:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343038.553119:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.553123:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f57 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.553130:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9200/0x607405d401ae7f57 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:0.0:1763343038.553141:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002a81112d reply state 0000000040759289 transno 8589940159 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f5e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.553150:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.553156:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935000) 00010000:00010000:0.0:1763343038.553158:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343038.553161:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343038.553186:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9400/0x607405d401ae7f50 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a6d expref: 262 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.553207:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7f65 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a6d expref: 261 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.553214:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a34037c4500) 00010000:00010000:0.0:1763343038.553217:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343038.553219:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d5600, rc 0) 00000100:00100000:0.0:1763343038.553261:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56918:x1848997993642112:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 939us (1835us total) trans 8589940159 rc 0/0 00000100:00100000:0.0:1763343038.553267:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9525 00000100:00100000:3.0:1763343038.558769:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.558896:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993642496 00000100:00100000:1.0:1763343038.558909:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993642496 00000100:00100000:1.0:1763343038.558989:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6709 00000100:00100000:1.0:1763343038.558999:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:56914:x1848997993642496:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343038.559021:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.559047:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae7f73 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a74 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343038.559074:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ba:0x0] initial LVB size: 4096, mtime: 0x691a7abe, atime: 0x0, ctime: 0x691a7abe, blocks: 0x8 00010000:00010000:1.0:1763343038.559101:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.559104:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.559112:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae7f73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a74 expref: 14 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.559129:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae7f73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a74 expref: 14 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.559149:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92a00, rc 0) 00000100:00100000:1.0:1763343038.559232:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:56914:x1848997993642496:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 233us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.559240:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6709 00000100:00100000:1.0:1763343038.564063:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.566564:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993642752 00000100:00100000:3.0:1763343038.566588:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993642752 00000100:00100000:2.0:1763343038.566817:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.566916:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9526 00000100:00100000:3.0:1763343038.566928:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56918:x1848997993642752:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343038.566963:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343038.566993:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f7a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a7b expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.567147:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7f81 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.567165:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7f65 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a6d expref: 263 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.567175:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7f81 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.567225:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7f65 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a6d expref: 263 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.567240:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7f65 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a6d expref: 263 pid: 6523 timeout: 1332 lvb_type: 0 00000100:00100000:3.0:1763343038.567258:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010292992:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343038.567397:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343038.567488:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993642880 00000100:00100000:1.0:1763343038.567494:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993642880 00000100:00100000:1.0:1763343038.567544:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6710 00000100:00100000:1.0:1763343038.567552:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:56914:x1848997993642880:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343038.567563:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.567581:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae7f88 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a82 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343038.567606:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343038.567651:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.567654:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.567661:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae7f88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a82 expref: 24 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.567677:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae7f88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a82 expref: 24 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.567690:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:1.0:1763343038.567726:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:56914:x1848997993642880:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 175us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.567737:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6710 00000100:00100000:3.0:1763343038.573037:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478f480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010292992:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343038.573078:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7f81 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343038.573180:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.573918:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.574017:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.574117:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993643008 00000100:00100000:0.0:1763343038.574128:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993643008 00010000:00010000:0.0:1763343038.574182:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7f65 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a6d expref: 264 pid: 6523 timeout: 1332 lvb_type: 0 00000100:00100000:3.0:1763343038.574699:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993643136 00000100:00100000:3.0:1763343038.574706:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993643136 00002000:00010000:3.0:1763343038.574742:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/698 (5->18446744073709551615) 00002000:00100000:3.0:1763343038.574747:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b8380 with x1848997993643136 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343038.574762:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34095b8380. 00000100:00100000:3.0:1763343038.574802:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993643264 00000100:00100000:3.0:1763343038.574805:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993643264 00002000:00010000:3.0:1763343038.574821:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/696 (0->18446744073709551615) 00002000:00100000:3.0:1763343038.574823:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a354134e300 with x1848997993643264 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343038.574830:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a354134e300. 00000100:00100000:3.0:1763343038.574856:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1632 00000100:00100000:3.0:1763343038.574877:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993643136:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:3.0:1763343038.575331:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2ba:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:3.0:1763343038.575337:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2ba:0x0] updating lvb mtime from disk: 1763343038 -> 1763343038 00002000:00010000:3.0:1763343038.575341:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2ba:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343038.575344:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2ba:0x0] updating lvb ctime from disk: 1763343038 -> 1763343038 00002000:00010000:3.0:1763343038.575346:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2ba:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343038.575426:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993643136:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 550us (1510us total) trans 17179871676 rc 0/0 00000100:00100000:3.0:1763343038.575437:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1632 00002000:00010000:3.0:1763343038.575442:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/698 (5->18446744073709551615) 00002000:00100000:3.0:1763343038.575444:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b8380 with x1848997993643136 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343038.575449:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34095b8380. 00000100:00100000:3.0:1763343038.575471:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1633 00000100:00100000:3.0:1763343038.575479:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2429:x1848997993643264:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:3.0:1763343038.575607:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343038.575610:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2b8:0x0] updating lvb mtime from disk: 0 -> 1763343038 00002000:00010000:3.0:1763343038.575612:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2b8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343038.575614:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2b8:0x0] updating lvb ctime from disk: 0 -> 1763343038 00002000:00010000:3.0:1763343038.575616:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b8:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343038.575689:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2429:x1848997993643264:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 209us (1670us total) trans 21474838973 rc 0/0 00000100:00100000:3.0:1763343038.575696:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1633 00002000:00010000:3.0:1763343038.575700:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/696 (0->18446744073709551615) 00002000:00100000:3.0:1763343038.575703:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a354134e300 with x1848997993643264 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343038.575708:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a354134e300. 00000100:00100000:0.0:1763343038.575881:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3141 00000100:00100000:0.0:1763343038.575892:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:2432:x1848997993643008:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343038.575906:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343038.575915:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7f65 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a6d expref: 264 pid: 6523 timeout: 1332 lvb_type: 0 00010000:00010000:0.0:1763343038.575930:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7f65 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a6d expref: 264 pid: 6523 timeout: 1332 lvb_type: 0 00010000:00010000:0.0:1763343038.575956:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7f65 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a6d expref: 264 pid: 6523 timeout: 1332 lvb_type: 0 00010000:00010000:0.0:1763343038.575980:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a34037c4500) 00010000:00010000:0.0:1763343038.575987:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7f81 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.575998:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7f81 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.576006:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7f81 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.576032:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343038.576057:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:2432:x1848997993643008:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 170us (2878us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.576064:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3141 00010000:00010000:3.0:1763343038.577836:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7f81 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.577856:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7f81 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343038.577904:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f2:0x0]: returning size 0 00000004:00080000:3.0:1763343038.578238:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2bb:0x0], index 0: 0 00000004:00080000:3.0:1763343038.578245:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2bd:0x0], index 1: 0 00000004:00080000:3.0:1763343038.578250:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2be:0x0], index 1: 0 00000004:00080000:3.0:1763343038.578254:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2bc:0x0], index 0: 0 00010000:00010000:3.0:1763343038.578405:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7f81 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.578414:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7f81 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.578421:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7f81 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.578428:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dda00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343038.578433:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7f81 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.578441:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7f81 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.578462:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a34037c4500) 00010000:00010000:3.0:1763343038.578466:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343038.578471:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7f81 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.578477:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7f81 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.578549:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f7a lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a7b expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.578565:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a34037c4500) 00010000:00010000:3.0:1763343038.578568:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343038.578572:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f7a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a7b expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.578588:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc600, rc 0) 00000100:00100000:3.0:1763343038.581083:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56918:x1848997993642752:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 14138us (17015us total) trans 8589940160 rc 301/301 00000100:00100000:3.0:1763343038.581102:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9526 00000100:00100000:1.0:1763343038.581290:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.583236:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993643520 00000100:00100000:3.0:1763343038.583256:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993643520 00000100:00100000:3.0:1763343038.583332:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9527 00000100:00100000:3.0:1763343038.583344:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56914:x1848997993643520:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:3.0:1763343038.583464:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7f96 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.583487:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7f96 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.583501:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7f96 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00010000:3.0:1763343038.583699:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000232ac8ba reply state 0000000057c663c7 transno 8589940161 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7f96 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.583713:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7f96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.583721:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:3.0:1763343038.583726:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343038.583730:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343038.583878:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56914:x1848997993643520:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 535us (2588us total) trans 8589940161 rc 0/0 00000100:00100000:3.0:1763343038.583886:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9527 00000100:00100000:1.0:1763343038.587649:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.588602:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993643776 00000100:00100000:0.0:1763343038.588641:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993643776 00000100:00100000:0.0:1763343038.588722:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3249 00000100:00100000:0.0:1763343038.588732:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56918:x1848997993643776:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343038.589141:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56918:x1848997993643776:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 409us (1526us total) trans 8589940162 rc 0/0 00000100:00100000:0.0:1763343038.589150:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3249 00000100:00100000:2.0:1763343038.589768:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.589900:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993643904 00000100:00100000:3.0:1763343038.589908:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993643904 00000100:00100000:3.0:1763343038.589956:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6711 00000100:00100000:3.0:1763343038.589965:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:56914:x1848997993643904:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343038.589983:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343038.590008:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f9d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a89 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.590041:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7e3f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a12 expref: 26 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343038.590051:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.590053:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.590058:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f9d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a89 expref: 26 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.590096:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7e3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a12 expref: 26 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343038.590112:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7e3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a12 expref: 26 pid: 28995 timeout: 1332 lvb_type: 1 00000100:00100000:3.0:1763343038.590129:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010293120:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343038.590210:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343038.595742:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.596769:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993644160 00000100:00100000:3.0:1763343038.596787:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993644160 00000100:00100000:3.0:1763343038.596873:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3250 00000100:00100000:3.0:1763343038.596885:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56918:x1848997993644160:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343038.597219:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56918:x1848997993644160:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 334us (1492us total) trans 8589940163 rc 0/0 00000100:00100000:3.0:1763343038.597228:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3250 00000100:00100000:1.0:1763343038.597773:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.598935:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993644288 00000100:00100000:0.0:1763343038.598950:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993644288 00010000:00010000:0.0:1763343038.599005:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7e3f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a12 expref: 27 pid: 28995 timeout: 1332 lvb_type: 1 00000100:00100000:0.0:1763343038.599063:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3142 00000100:00100000:0.0:1763343038.599073:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2429:x1848997993644288:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343038.599092:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343038.599119:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7e3f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a12 expref: 27 pid: 28995 timeout: 1332 lvb_type: 1 00010000:00010000:0.0:1763343038.599134:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7e3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a12 expref: 27 pid: 28995 timeout: 1332 lvb_type: 1 00010000:00010000:0.0:1763343038.599164:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.599166:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.599176:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a89 expref: 27 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.599188:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a89 expref: 27 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.599237:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a89 expref: 27 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343038.599255:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1848998010293248:192.168.204.21@tcp:105: 00000100:00100000:0.0:1763343038.599379:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f313c0 going to sleep for 11 seconds 00010000:00010000:3.0:1763343038.600808:0:27835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae7e3f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a12 expref: 27 pid: 28995 timeout: 1332 lvb_type: 1 00000100:00100000:3.0:1763343038.600834:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010293120:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343038.600881:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a89 expref: 26 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.600898:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc600, rc 0) 00000100:00100000:3.0:1763343038.600971:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:56914:x1848997993643904:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 11005us (11204us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343038.600981:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6711 00000100:00100000:1.0:1763343038.606978:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.609583:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993644544 00000100:00100000:2.0:1763343038.609607:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993644544 00000100:00100000:2.0:1763343038.610251:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9528 00000100:00100000:2.0:1763343038.610268:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:55941:x1848997993644544:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343038.610303:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.610337:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7fa4 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a90 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.610522:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7fab lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610540:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7fab lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610554:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7fab lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610567:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7fb2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610574:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610580:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610686:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7fb9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610694:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610701:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343038.610717:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f2:0x0]: returning size 0 00010000:00010000:2.0:1763343038.610817:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7fab lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610826:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7fab lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610832:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7fab lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610845:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7fab lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610851:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.610856:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7fab lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610871:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7fab lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610886:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935500) 00010000:00010000:2.0:1763343038.610891:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.610896:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7fab lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610902:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae7fab lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610918:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610924:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7fb2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610933:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610937:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.610940:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610945:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610951:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935000) 00010000:00010000:2.0:1763343038.610953:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.610956:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7fb2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.610961:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae7fb2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.611008:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae7fa4 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a90 expref: 269 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.611028:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a90 expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.611036:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:2.0:1763343038.611038:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343038.611041:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352ce00, rc 0) 00000100:00100000:2.0:1763343038.611148:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:55941:x1848997993644544:12345-192.168.204.21@tcp:101:bash.0 Request processed in 885us (4186us total) trans 8589940164 rc 0/0 00000100:00100000:2.0:1763343038.611158:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9528 00000100:00100000:0.0:1763343038.614449:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1848998010293248:192.168.204.21@tcp:105: 00010000:00010000:0.0:1763343038.614491:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343038.614573:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2429:x1848997993644288:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 15499us (16799us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.614586:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3142 00000100:00100000:3.0:1763343038.615289:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.622698:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.622844:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993644800 00000100:00100000:3.0:1763343038.622865:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993644800 00000100:00100000:0.0:1763343038.623001:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993644672 00000100:00100000:0.0:1763343038.623007:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993644672 00000100:00100000:3.0:1763343038.623578:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9529 00000100:00100000:3.0:1763343038.623595:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:55941:x1848997993644800:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343038.623676:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343038.623705:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7fc7 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a97 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.623753:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7fce lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.623771:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7fce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.623786:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7fce lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343038.623908:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6712 00000100:00100000:1.0:1763343038.623917:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2430:x1848997993644672:12345-192.168.204.21@tcp:2:lfs.0 00010000:00010000:3.0:1763343038.623946:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7fc7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a97 expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.623974:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7fce lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a97 expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.623984:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:3.0:1763343038.623988:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343038.623993:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd800, rc 0) 00000100:00100000:3.0:1763343038.624072:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:55941:x1848997993644800:12345-192.168.204.21@tcp:101:bash.0 Request processed in 484us (1391us total) trans 0 rc 0/0 00002000:00010000:1.0:1763343038.624077:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343038.624080:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb mtime from disk: 1763343038 -> 1763343038 00000100:00100000:3.0:1763343038.624081:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9529 00002000:00010000:1.0:1763343038.624083:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb atime from disk: 0 -> 1763343037 00002000:00010000:1.0:1763343038.624086:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb ctime from disk: 1763343038 -> 1763343038 00002000:00010000:1.0:1763343038.624088:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343038.624120:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2430:x1848997993644672:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 204us (8836us total) trans 21474838974 rc 0/0 00000100:00100000:1.0:1763343038.624127:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6712 00000100:00100000:1.0:1763343038.640450:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.640513:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.640524:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993645056 00000100:00100000:3.0:1763343038.640539:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993645056 00000100:00100000:3.0:1763343038.640652:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9530 00000100:00100000:0.0:1763343038.640657:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993645312 00000100:00100000:0.0:1763343038.640662:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993645312 00000100:00100000:3.0:1763343038.640664:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:55941:x1848997993645056:12345-192.168.204.21@tcp:36:bash.0 00000100:00100000:0.0:1763343038.640693:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3251 00000100:00100000:0.0:1763343038.640699:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56914:x1848997993645312:12345-192.168.204.21@tcp:35:lfs.0 00010000:00010000:3.0:1763343038.640731:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:0.0:1763343038.640744:0:14879:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1ee:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d6d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99cc expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.640764:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae7fb9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a90 expref: 270 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.640786:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:0.0:1763343038.640791:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343038.640792:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343038.640805:0:14879:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae7df9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99f6 expref: 269 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.640815:0:14879:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343038.640852:0:14879:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae7df9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99f6 expref: 269 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.640879:0:14879:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae7df9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99f6 expref: 269 pid: 6523 timeout: 1332 lvb_type: 0 00000100:00100000:0.0:1763343038.640896:0:14879:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010293376:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343038.641000:0:14879:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f313c0 going to sleep for 11 seconds 00010000:00010000:3.0:1763343038.641027:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7fdc lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.641039:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7fdc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.641049:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7fdc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000001:00080000:3.0:1763343038.641105:0:28422:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940165 00000004:00010000:1.0:1763343038.643548:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000079534c79 reply state 000000008eff0f5f transno 8589940166 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7fdc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.643584:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7fdc lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343038.643594:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:1.0:1763343038.643598:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343038.643605:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343038.643793:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:55941:x1848997993645056:12345-192.168.204.21@tcp:36:bash.0 Request processed in 3125us (3355us total) trans 8589940166 rc 0/0 00000100:00100000:1.0:1763343038.643803:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9530 00000020:00080000:1.0:1763343038.643810:0:28422:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343038.650456:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.654792:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.655586:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993645440 00000100:00100000:2.0:1763343038.655602:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993645440 00010000:00010000:2.0:1763343038.655685:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae7df9 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99f6 expref: 272 pid: 6523 timeout: 1332 lvb_type: 0 00000100:00100000:2.0:1763343038.655740:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3143 00000100:00100000:2.0:1763343038.655750:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:2429:x1848997993645440:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1763343038.655751:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993645568 00000100:00100000:3.0:1763343038.655756:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993645568 00010000:00010000:2.0:1763343038.655771:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343038.655778:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae7df9 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99f6 expref: 273 pid: 6523 timeout: 1332 lvb_type: 0 00010000:00010000:2.0:1763343038.655795:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae7df9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99f6 expref: 273 pid: 6523 timeout: 1332 lvb_type: 0 00000100:00100000:3.0:1763343038.655798:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9531 00000100:00100000:3.0:1763343038.655805:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:55941:x1848997993645568:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343038.655824:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:3.0:1763343038.655830:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.655831:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343038.655842:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343038.655849:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7fe3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9a9e expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.655850:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343038.655893:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343038.655916:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7fe3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a9e expref: 274 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.655928:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7fe3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a9e expref: 274 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.655945:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:3.0:1763343038.655948:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343038.655952:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dce00, rc 0) 00000100:00100000:2.0:1763343038.655965:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:2429:x1848997993645440:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 215us (5525us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.655973:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3143 00000100:00100000:3.0:1763343038.655975:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:55941:x1848997993645568:12345-192.168.204.21@tcp:101:bash.0 Request processed in 171us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343038.655980:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9531 00010000:00010000:0.0:1763343038.657035:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8200/0x607405d401ae7df9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99f6 expref: 272 pid: 6523 timeout: 1332 lvb_type: 0 00000100:00100000:0.0:1763343038.657057:0:14879:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010293376:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343038.657086:0:14879:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343038.657096:0:14879:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343038.657101:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00000040:00080000:0.0:1763343038.657405:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1482, 88 off124928 00000004:00080000:0.0:1763343038.657414:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232324793291ns, next at 1233117877304ns, rc = 0 00000040:00080000:0.0:1763343038.657443:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1483, 88 off124928 00000004:00080000:0.0:1763343038.657448:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232324827371ns, next at 1233117841489ns, rc = 0 00000040:00080000:0.0:1763343038.657475:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1484, 88 off125016 00000004:00080000:0.0:1763343038.657480:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232324858827ns, next at 1233117841489ns, rc = 0 00000040:00080000:0.0:1763343038.657489:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1483, 88 off125016 00000004:00080000:0.0:1763343038.657492:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232324871294ns, next at 1233117877304ns, rc = 0 00000100:00100000:2.0:1763343038.661575:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.661673:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993645824 00000100:00100000:3.0:1763343038.661688:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993645824 00000100:00100000:3.0:1763343038.661770:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9532 00000100:00100000:3.0:1763343038.661781:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:55941:x1848997993645824:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343038.661809:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343038.661814:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343038.661851:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae7fe3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a9e expref: 273 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.661883:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:3.0:1763343038.661890:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343038.661909:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7fea lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9aa5 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.661970:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7ff1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.661986:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7ff1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343038.661997:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7ff1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.663720:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7ecb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663739:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7ecb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663748:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7ecb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663755:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.663760:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7ecb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663768:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7ecb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663790:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935000) 00010000:00010000:0.0:1763343038.663794:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.663799:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7ecb lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663806:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae7ecb lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663832:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7f49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663840:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7f49 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663846:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7f49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663852:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c8600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.663854:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7f49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663872:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7f49 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663882:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:0.0:1763343038.663885:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.663888:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7f49 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663894:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c8600/0x607405d401ae7f49 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663906:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663913:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663918:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663923:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34049c9a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.663926:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663932:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663939:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935000) 00010000:00010000:0.0:1763343038.663942:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.663945:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f5e lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663950:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34049c9a00/0x607405d401ae7f5e lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.663969:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7f96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.663975:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7f96 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.663981:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7f96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.663986:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dcc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.663989:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7f96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.663996:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7f96 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.664003:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:0.0:1763343038.664005:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.664008:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7f96 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.664014:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae7f96 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.664025:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7fdc lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.664031:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7fdc lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.664036:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7fdc lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.664041:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dda00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.664044:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7fdc lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.664049:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7fdc lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.664057:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:0.0:1763343038.664060:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.664063:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7fdc lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.664069:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae7fdc lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000001:00080000:2.0:1763343038.664545:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940167 is committed 00000004:00080000:2.0:1763343038.664558:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 978 committed 00000040:00080000:3.0:1763343038.667373:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1484, 88 off125104 00000004:00080000:3.0:1763343038.667396:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232334773674ns, next at 1233117877304ns, rc = 0 00000100:00100000:0.0:1763343038.667798:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010293504:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343038.667903:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763343038.668008:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 977 committed 00000004:00080000:2.0:1763343038.668029:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 976 committed 00000004:00080000:2.0:1763343038.668031:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 977 committed 00000004:00080000:2.0:1763343038.668060:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 976 committed 00000004:00080000:2.0:1763343038.668062:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 975 committed 00000100:00100000:2.0:1763343038.668229:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010293632:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343038.668275:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343038.668438:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010293504 00000100:00100000:0.0:1763343038.668449:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010293504 00000100:00100000:0.0:1763343038.668516:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6713 00000100:00100000:0.0:1763343038.668528:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3657:x1848998010293504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343038.668566:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:697 count 1 00010000:00010000:0.0:1763343038.668599:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a35029d4c00/0x607405d401ae7ff8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.668647:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae7ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a3c expref: 25 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.668656:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343038.668659:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343038.668663:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a35029d4c00/0x607405d401ae7ff8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.668695:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae7ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a3c expref: 25 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343038.668702:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010293888:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763343038.668711:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae7ea1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a3c expref: 25 pid: 28996 timeout: 1332 lvb_type: 0 00000100:00100000:0.0:1763343038.668725:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010294272:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343038.668736:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343038.668804:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31a80 going to sleep for 11 seconds 00000100:00100000:0.0:1763343038.668822:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010294016:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343038.668891:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010293632 00000100:00100000:2.0:1763343038.668896:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010293632 00000100:00100000:2.0:1763343038.668925:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010293888 00000100:00100000:2.0:1763343038.668928:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010293888 00000100:00100000:2.0:1763343038.668949:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6714 00000100:00100000:2.0:1763343038.668955:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3658:x1848998010293632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343038.668969:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:698 count 1 00002000:00010000:2.0:1763343038.668999:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343038.669005:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7fff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.669013:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1763343038.669014:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1763343038.669015:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1763343038.669020:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010293760:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1763343038.669021:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7fff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.669035:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7fff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343038.669041:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343038.669047:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7fff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.669060:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7fff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343038.669065:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010294144:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763343038.669079:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343038.669085:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343038.669111:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010293760 00000100:00100000:3.0:1763343038.669114:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010293760 00000100:00100000:3.0:1763343038.669137:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010294144 00000100:00100000:3.0:1763343038.669140:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010294144 00000100:00100000:3.0:1763343038.669154:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6715 00000100:00100000:3.0:1763343038.669159:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3660:x1848998010293888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343038.669173:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:700 count 1 00002000:00010000:3.0:1763343038.669196:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343038.669201:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8006 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.669209:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.669210:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.669213:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8006 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.669222:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8006 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.669229:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8006 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.669254:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8006 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.669269:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763343038.669358:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3658:x1848998010293632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 401us (1081us total) trans 21474838975 rc 0/0 00000100:00100000:2.0:1763343038.669366:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6714 00000100:00100000:2.0:1763343038.669386:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6716 00000100:00100000:2.0:1763343038.669392:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3660:x1848998010293760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343038.669402:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:699 count 1 00010000:00010000:2.0:1763343038.669414:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae800d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.669427:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae7e9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a35 expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343038.669428:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3660:x1848998010293888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 268us (691us total) trans 17179871677 rc 0/0 00010000:00010000:2.0:1763343038.669434:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1763343038.669436:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6715 00010000:00010000:2.0:1763343038.669436:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343038.669439:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae800d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343038.669447:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6717 00000100:00100000:3.0:1763343038.669453:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3658:x1848998010294144:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763343038.669461:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae7e9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a35 expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.669470:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae7e9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a35 expref: 14 pid: 28996 timeout: 1332 lvb_type: 0 00000100:00100000:2.0:1763343038.669486:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a354134ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1848998010294400:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343038.669515:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3404726600 going to sleep for 11 seconds 00002000:00010000:3.0:1763343038.669534:0:28995:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2ba:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343038.669537:0:28995:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2ba:0x0] updating lvb mtime from disk: 1763343038 -> 1763343038 00002000:00010000:3.0:1763343038.669540:0:28995:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2ba:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343038.669543:0:28995:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2ba:0x0] updating lvb ctime from disk: 1763343038 -> 1763343038 00002000:00010000:3.0:1763343038.669546:0:28995:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2ba:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343038.669571:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3658:x1848998010294144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (484us total) trans 17179871678 rc 0/0 00000100:00100000:3.0:1763343038.669578:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6717 00010000:00010000:3.0:1763343038.669603:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343038.669610:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7fff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.669645:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343038.669651:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7fff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.669665:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343038.669666:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7fff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.669672:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8006 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.669679:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343038.669682:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8006 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.669685:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7fff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.669689:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8006 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.669693:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae7fff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.669699:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8006 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.669705:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8006 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.669710:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343038.669711:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343038.669713:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343038.669719:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343038.669720:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343038.669722:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343038.669746:0:3658:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871673 gen 2 00000004:00080000:3.0:1763343038.669751:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062f2300, transno 17179871661 00000004:00080000:3.0:1763343038.669760:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062f3480, transno 17179871662 00000004:00080000:3.0:1763343038.669764:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062f0380, transno 17179871663 00000004:00080000:3.0:1763343038.669767:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062f0a80, transno 17179871664 00000004:00080000:3.0:1763343038.669770:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537913100, transno 17179871665 00000004:00080000:3.0:1763343038.669773:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537911f80, transno 17179871666 00000004:00080000:3.0:1763343038.669776:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062ca680, transno 17179871668 00000004:00080000:3.0:1763343038.669779:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062cb800, transno 17179871669 00000004:00080000:3.0:1763343038.669781:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062c8380, transno 17179871670 00000004:00080000:3.0:1763343038.669784:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062cad80, transno 17179871671 00000004:00080000:3.0:1763343038.669786:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3501218000, transno 17179871672 00000004:00080000:3.0:1763343038.669789:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3501218a80, transno 17179871673 00000100:00100000:3.0:1763343038.669797:0:3658:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a3537910000 x1848998010294144/t17179871678(17179871678) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343054 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763343038.669812:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537910000/2, rc 0, transno 17179871678 00000100:00100000:3.0:1763343038.669817:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010294144:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343038.669832:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a4c000/2, rc 0, transno 21474838975 00000100:00100000:3.0:1763343038.669848:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010293632:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343038.669873:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010294656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343038.669899:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343038.669922:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478fb80/2, rc 0, transno 17179871677 00000100:00100000:3.0:1763343038.669927:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010293888:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343038.669934:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343038.669939:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010294528:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343038.669958:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763343038.670100:0:32357:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 4 in progress, 2 in flight, 12 done 00000040:00080000:3.0:1763343038.670134:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1485, 88 off125104 00000004:00080000:3.0:1763343038.670141:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232337520650ns, next at 1233117841489ns, rc = 0 00000040:00080000:3.0:1763343038.670182:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1486, 88 off125192 00000004:00080000:3.0:1763343038.670187:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232337566352ns, next at 1233117841489ns, rc = 0 00000040:00080000:3.0:1763343038.670202:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1485, 88 off125192 00000004:00080000:3.0:1763343038.670205:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232337584362ns, next at 1233117877304ns, rc = 0 00000100:00100000:0.0:1763343038.673150:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343038.674877:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010294656 00000100:00100000:1.0:1763343038.674897:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010294656 00000100:00100000:1.0:1763343038.674925:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010294528 00000100:00100000:1.0:1763343038.674929:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010294528 00000100:00100000:1.0:1763343038.674998:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010294016 00000100:00100000:1.0:1763343038.675002:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010294016 00000100:00100000:1.0:1763343038.675043:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6718 00000100:00100000:1.0:1763343038.675054:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3660:x1848998010294528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763343038.675297:0:8408:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343038.675301:0:8408:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb mtime from disk: 1763343038 -> 1763343038 00002000:00010000:1.0:1763343038.675305:0:8408:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb atime from disk: 1763343037 -> 1763343037 00002000:00010000:1.0:1763343038.675307:0:8408:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb ctime from disk: 1763343038 -> 1763343038 00002000:00010000:1.0:1763343038.675310:0:8408:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b7:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343038.675402:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3660:x1848998010294528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 350us (5442us total) trans 21474838976 rc 0/0 00000100:00100000:1.0:1763343038.675411:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6718 00000100:00100000:1.0:1763343038.675437:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6719 00000100:00100000:1.0:1763343038.675444:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3657:x1848998010294016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763343038.675529:0:8408:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2b9:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1763343038.675529:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6720 00002000:00010000:1.0:1763343038.675532:0:8408:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2b9:0x0] updating lvb mtime from disk: 1763343038 -> 1763343038 00002000:00010000:1.0:1763343038.675534:0:8408:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2b9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343038.675537:0:8408:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2b9:0x0] updating lvb ctime from disk: 1763343038 -> 1763343038 00000100:00100000:0.0:1763343038.675537:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3660:x1848998010294656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763343038.675539:0:8408:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2b9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343038.675574:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010294016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 130us (2436us total) trans 17179871679 rc 0/0 00000100:00100000:1.0:1763343038.675580:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6719 00002000:00010000:0.0:1763343038.675603:0:27833:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2b8:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343038.675606:0:27833:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2b8:0x0] updating lvb mtime from disk: 1763343038 -> 1763343038 00002000:00010000:0.0:1763343038.675608:0:27833:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2b8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343038.675610:0:27833:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2b8:0x0] updating lvb ctime from disk: 1763343038 -> 1763343038 00002000:00010000:0.0:1763343038.675612:0:27833:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2b8:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:1.0:1763343038.675659:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a4d180/2, rc 0, transno 21474838976 00000100:00100000:0.0:1763343038.675661:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3660:x1848998010294656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (5761us total) trans 21474838977 rc 0/0 00000100:00100000:0.0:1763343038.675667:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6720 00000100:00100000:1.0:1763343038.675670:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010294528:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343038.675683:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a4ce00/2, rc 0, transno 21474838977 00000100:00100000:1.0:1763343038.675688:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010294656:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343038.675706:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537912680/2, rc 0, transno 17179871679 00000100:00100000:0.0:1763343038.675887:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010294016:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1763343038.687732:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940168 is committed 00000004:00080000:2.0:1763343038.687751:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 980 committed 00000004:00010000:0.0:1763343038.688593:0:14879:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007294d8f4 reply state 00000000c6e95cca transno 8589940167 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343038.688648:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343038.688659:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:0.0:1763343038.688663:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343038.688669:0:14879:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343038.688681:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:0.0:1763343038.688683:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343038.688694:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae7d6d lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99cc expref: 256 pid: 28422 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1763343038.688872:0:14879:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343038.688888:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56914:x1848997993645312:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 48187us (48374us total) trans 8589940167 rc 0/0 00000100:00100000:0.0:1763343038.688899:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3251 00010000:00010000:0.0:1763343038.688934:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343038.688942:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343038.688950:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343038.688956:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d5600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.688962:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343038.688970:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343038.688981:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:0.0:1763343038.688984:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343038.688987:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343038.688993:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae7fd5 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00000004:00080000:2.0:1763343038.689090:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 979 committed 00000004:00080000:2.0:1763343038.689100:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 978 committed 00000004:00080000:2.0:1763343038.689103:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 979 committed 00000100:00100000:2.0:1763343038.689208:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340a65b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010294912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343038.689292:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343038.689330:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763343038.689336:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340a659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010294784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343038.689354:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343038.689537:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010294912 00000100:00100000:0.0:1763343038.689546:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010294912 00000100:00100000:0.0:1763343038.689589:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010294784 00000100:00100000:0.0:1763343038.689593:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010294784 00000100:00100000:0.0:1763343038.689610:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6721 00000100:00100000:0.0:1763343038.689637:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3658:x1848998010294912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343038.689874:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3658:x1848998010294912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 255us (581us total) trans 17179871680 rc 0/0 00000100:00100000:0.0:1763343038.689880:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6721 00000100:00100000:0.0:1763343038.689893:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6722 00000100:00100000:0.0:1763343038.689899:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3658:x1848998010294784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343038.689961:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a65a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3658:x1848998010294784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (605us total) trans 17179871681 rc 0/0 00000100:00100000:0.0:1763343038.689967:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6722 00000100:00100000:0.0:1763343038.690082:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010295168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343038.690110:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343038.690129:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763343038.690134:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010295040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343038.690149:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343038.690166:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010295168 00000100:00100000:0.0:1763343038.690169:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010295168 00000100:00100000:0.0:1763343038.690187:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010295040 00000100:00100000:0.0:1763343038.690189:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010295040 00000100:00100000:0.0:1763343038.690202:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6723 00000100:00100000:0.0:1763343038.690207:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3660:x1848998010295168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343038.690312:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3660:x1848998010295168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (201us total) trans 21474838978 rc 0/0 00000100:00100000:0.0:1763343038.690318:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6723 00000100:00100000:0.0:1763343038.690328:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6724 00000100:00100000:0.0:1763343038.690333:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3660:x1848998010295040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343038.690389:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3660:x1848998010295040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (238us total) trans 21474838979 rc 0/0 00000100:00100000:0.0:1763343038.690394:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6724 00000004:00080000:0.0:1763343038.690440:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d4380/2, rc 0, transno 21474838979 00000100:00100000:0.0:1763343038.690446:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010295040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343038.690453:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d7b80/2, rc 0, transno 21474838978 00000100:00100000:0.0:1763343038.690456:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010295168:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763343038.690644:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340a659180/2, rc 0, transno 17179871681 00000100:00100000:2.0:1763343038.690651:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340a659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010294784:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343038.690658:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340a65b480/2, rc 0, transno 17179871680 00000100:00100000:2.0:1763343038.690662:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340a65b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010294912:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763343038.691768:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7ff1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aa5 expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.691787:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:2.0:1763343038.691791:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343038.691811:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae7fea lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aa5 expref: 255 pid: 28422 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343038.691832:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7ff1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aa5 expref: 254 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.691881:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:2.0:1763343038.691884:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343038.691886:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403528e00, rc 0) 00000100:00100000:2.0:1763343038.691969:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:55941:x1848997993645824:12345-192.168.204.21@tcp:101:bash.0 Request processed in 30189us (30406us total) trans 8589940168 rc 0/0 00000100:00100000:2.0:1763343038.691978:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9532 00000100:00100000:2.0:1763343038.710125:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.710167:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.710187:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.710213:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.710277:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a354134ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8410:1848998010294400:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343038.710313:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae800d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343038.710353:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993646336 00000100:00100000:2.0:1763343038.710361:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993646336 00000100:00100000:2.0:1763343038.710421:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6725 00000100:00100000:2.0:1763343038.710430:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:55941:x1848997993646336:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343038.710451:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.710476:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae8014 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ab3 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343038.710502:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343038.710527:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343038.710530:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343038.710540:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae8014 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ab3 expref: 27 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.710558:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae8014 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ab3 expref: 27 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.710571:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d600, rc 0) 00000100:00100000:2.0:1763343038.710658:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a65b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:55941:x1848997993646336:12345-192.168.204.21@tcp:101:bash.0 Request processed in 228us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.710665:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6725 00000100:00100000:2.0:1763343038.710694:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993646208 00000100:00100000:2.0:1763343038.710698:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993646208 00000100:00100000:2.0:1763343038.710729:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9533 00000100:00100000:2.0:1763343038.710736:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+254:56914:x1848997993646208:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343038.710751:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.710768:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae801b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9aac expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.710825:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae801b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aac expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.710837:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d200/0x607405d401ae801b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aac expref: 255 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.710852:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:2.0:1763343038.710868:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343038.710873:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d200, rc 0) 00000100:00100000:3.0:1763343038.710890:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993645952 00000100:00100000:3.0:1763343038.710895:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993645952 00000100:00100000:2.0:1763343038.710896:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56914:x1848997993646208:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 160us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.710903:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9533 00010000:00010000:3.0:1763343038.710920:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae7ea1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a3c expref: 27 pid: 28996 timeout: 1332 lvb_type: 0 00000100:00100000:3.0:1763343038.710947:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993646080 00000100:00100000:3.0:1763343038.710950:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993646080 00010000:00010000:3.0:1763343038.710965:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae7e9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a35 expref: 15 pid: 28996 timeout: 1332 lvb_type: 0 00000100:00100000:3.0:1763343038.710985:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3144 00000100:00100000:3.0:1763343038.710991:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a659500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2430:x1848997993645952:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343038.711002:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343038.711008:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae7ea1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a3c expref: 27 pid: 28996 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343038.711020:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae7ea1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a3c expref: 27 pid: 28996 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343038.711042:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.711044:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.711048:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a35029d4c00/0x607405d401ae7ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.711056:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a35029d4c00/0x607405d401ae7ff8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.711075:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343038.711119:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a659500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2430:x1848997993645952:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 127us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343038.711126:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3144 00000100:00100000:3.0:1763343038.711140:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3145 00000100:00100000:3.0:1763343038.711146:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a659c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993646080:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343038.711159:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343038.711164:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae7e9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a35 expref: 15 pid: 28996 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343038.711173:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae7e9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a35 expref: 15 pid: 28996 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343038.711189:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176400/0x607405d401ae7e9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a35 expref: 15 pid: 28996 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343038.711203:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.711205:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.711208:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae800d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.711216:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae800d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.711232:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343038.711252:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a659c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993646080:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 106us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343038.711353:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3145 00010000:00010000:3.0:1763343038.711418:0:28996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177400/0x607405d401ae7ea1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a3c expref: 26 pid: 28996 timeout: 1332 lvb_type: 0 00000100:00100000:3.0:1763343038.711429:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010294272:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343038.711445:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a35029d4c00/0x607405d401ae7ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.711459:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a35029d4c00/0x607405d401ae7ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.711466:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a35029d4c00/0x607405d401ae7ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.711476:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a35029d4c00/0x607405d401ae7ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.711484:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a35029d4c00/0x607405d401ae7ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.711500:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343038.711802:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3657:x1848998010293504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43276us (43898us total) trans 21474838980 rc 0/0 00000100:00100000:3.0:1763343038.711810:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6713 00000004:00080000:3.0:1763343038.711864:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a4d500/2, rc 0, transno 21474838980 00000100:00100000:3.0:1763343038.711872:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010293504:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763343038.714002:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343038.714023:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a35029d4c00/0x607405d401ae7ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.714038:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4c00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343038.714043:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a35029d4c00/0x607405d401ae7ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.714056:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a35029d4c00/0x607405d401ae7ff8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.714081:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a35029d4c00/0x607405d401ae7ff8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.714089:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a35029d4c00/0x607405d401ae7ff8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.714124:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.714126:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.714128:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.714153:0:8410:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae800d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.714163:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae800d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.714178:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae800d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.714187:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae800d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.714225:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343038.714586:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3660:x1848998010293760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 45189us (45538us total) trans 17179871682 rc 0/0 00000100:00100000:2.0:1763343038.714597:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6716 00000004:00080000:2.0:1763343038.714697:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340478e680/2, rc 0, transno 17179871682 00000100:00100000:2.0:1763343038.714704:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010293760:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763343038.715594:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343038.715605:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae800d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.715616:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343038.715746:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae800d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.715762:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae800d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.715781:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae800d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.715788:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae800d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.715792:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343038.715810:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343038.715812:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343038.715813:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343038.715841:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993646464 00000100:00100000:3.0:1763343038.715849:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993646464 00000100:00100000:3.0:1763343038.715910:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6726 00000100:00100000:3.0:1763343038.715920:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:55941:x1848997993646464:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343038.715944:0:8410:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763343038.716215:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.716319:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993646720 00000100:00100000:2.0:1763343038.716325:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993646720 00010000:00010000:3.0:1763343038.716496:0:8410:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae8022 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9aba expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343038.716522:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343038.716546:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.716549:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.716559:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae8022 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aba expref: 15 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.716574:0:8410:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae8022 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aba expref: 15 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.716587:0:8410:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403529800, rc 0) 00000100:00100000:3.0:1763343038.716660:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:55941:x1848997993646464:12345-192.168.204.21@tcp:101:bash.0 Request processed in 741us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343038.716667:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6726 00000100:00100000:3.0:1763343038.718226:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.718270:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.718433:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993646976 00000100:00100000:1.0:1763343038.718433:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993646848 00000100:00100000:2.0:1763343038.718445:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993646976 00000100:00100000:1.0:1763343038.718445:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993646848 00002000:00010000:2.0:1763343038.718486:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/701 (0->18446744073709551615) 00002000:00010000:1.0:1763343038.718486:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/699 (0->18446744073709551615) 00002000:00100000:2.0:1763343038.718492:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537911f80 with x1848997993646976 ext(0->18446744073709551615) 00002000:00100000:1.0:1763343038.718492:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537913100 with x1848997993646848 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343038.718506:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537911f80. 00002000:00010000:1.0:1763343038.718506:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537913100. 00000100:00100000:2.0:1763343038.718541:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1634 00000100:00100000:2.0:1763343038.718551:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2432:x1848997993646976:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:0.0:1763343038.718734:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3252 00000100:00100000:0.0:1763343038.718747:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+255:56914:x1848997993646720:12345-192.168.204.21@tcp:35:lfs.0 00002000:00010000:2.0:1763343038.718801:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2bd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343038.718805:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2bd:0x0] updating lvb mtime from disk: 0 -> 1763343038 00002000:00010000:2.0:1763343038.718808:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2bd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343038.718810:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2bd:0x0] updating lvb ctime from disk: 0 -> 1763343038 00002000:00010000:2.0:1763343038.718813:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2bd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343038.718889:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993646976:12345-192.168.204.21@tcp:10:bash.0 Request processed in 339us (617us total) trans 17179871683 rc 0/0 00000100:00100000:2.0:1763343038.718897:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1634 00002000:00010000:2.0:1763343038.718901:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/701 (0->18446744073709551615) 00002000:00100000:2.0:1763343038.718903:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537911f80 with x1848997993646976 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343038.718908:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537911f80. 00000100:00100000:2.0:1763343038.718929:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1635 00000100:00100000:2.0:1763343038.718935:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2432:x1848997993646848:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343038.719030:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2bb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343038.719034:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2bb:0x0] updating lvb mtime from disk: 0 -> 1763343038 00002000:00010000:2.0:1763343038.719036:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2bb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343038.719038:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2bb:0x0] updating lvb ctime from disk: 0 -> 1763343038 00002000:00010000:2.0:1763343038.719040:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2bb:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:0.0:1763343038.719047:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1ee:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1763343038.719062:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2432:x1848997993646848:12345-192.168.204.21@tcp:10:bash.0 Request processed in 127us (848us total) trans 21474838981 rc 0/0 00000100:00100000:2.0:1763343038.719068:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1635 00002000:00010000:2.0:1763343038.719070:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/699 (0->18446744073709551615) 00002000:00100000:2.0:1763343038.719073:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537913100 with x1848997993646848 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343038.719077:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537913100. 00000040:00080000:0.0:1763343038.719121:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1486, 64 off125256 00000040:00080000:0.0:1763343038.719150:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1487, 64 off125256 00000040:00080000:0.0:1763343038.719161:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1488, 64 off125320 00000040:00080000:0.0:1763343038.719170:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1487, 64 off125320 00010000:00010000:0.0:1763343038.721347:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8029 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.721376:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8029 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.721390:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8029 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.721400:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8029 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.721407:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8029 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.721417:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8029 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343038.721444:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343038.721708:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56914:x1848997993646720:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 2958us (5487us total) trans 8589940169 rc 0/0 00000100:00100000:0.0:1763343038.721719:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3252 00010000:00010000:2.0:1763343038.722970:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343038.722983:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8029 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343038.722994:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343038.723000:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8029 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343038.723010:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8029 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343038.723030:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ee:0x0].0x0 (ffff9a34037c4a00) 00010000:00010000:2.0:1763343038.723033:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343038.723039:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8029 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343038.723046:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8029 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343038.723071:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.723073:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.723075:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343038.725386:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.725494:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993647232 00000100:00100000:2.0:1763343038.725508:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993647232 00000100:00100000:2.0:1763343038.725583:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3253 00000100:00100000:2.0:1763343038.725594:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350922a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:55941:x1848997993647232:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:2.0:1763343038.726021:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350922a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:55941:x1848997993647232:12345-192.168.204.21@tcp:35:bash.0 Request processed in 428us (649us total) trans 8589940170 rc 0/0 00000100:00100000:2.0:1763343038.726030:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3253 00000100:00100000:1.0:1763343038.737788:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.737913:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993647488 00000100:00100000:2.0:1763343038.737928:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993647488 00000100:00100000:2.0:1763343038.738015:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9534 00000100:00100000:2.0:1763343038.738026:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56914:x1848997993647488:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343038.738059:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.738088:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8030 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ac1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.738196:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8037 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738214:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8037 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738227:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8037 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738241:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae803e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738247:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae803e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738253:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae803e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738402:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8045 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738413:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8045 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738420:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8045 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343038.738432:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f2:0x0]: returning size 5 00010000:00010000:2.0:1763343038.738538:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8037 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738546:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8037 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738556:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8037 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738563:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8037 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738570:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.738574:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8037 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738582:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8037 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738596:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:2.0:1763343038.738599:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.738606:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8037 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738612:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8037 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738690:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae803e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738697:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae803e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738703:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae803e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738708:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.738711:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae803e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738721:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae803e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738728:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421400) 00010000:00010000:2.0:1763343038.738731:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.738733:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae803e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.738739:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae803e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.739387:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8030 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ac1 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.739415:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8045 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ac1 expref: 259 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.739424:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:2.0:1763343038.739426:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343038.739430:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c200, rc 0) 00000100:00100000:2.0:1763343038.739530:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56914:x1848997993647488:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1504us (1755us total) trans 8589940171 rc 0/0 00000100:00100000:2.0:1763343038.739540:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9534 00000100:00100000:1.0:1763343038.750185:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.750310:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993647744 00000100:00100000:3.0:1763343038.750325:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993647744 00000100:00100000:3.0:1763343038.750404:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3254 00000100:00100000:3.0:1763343038.750418:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56914:x1848997993647744:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343038.750884:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56914:x1848997993647744:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 438us (683us total) trans 8589940172 rc 0/0 00000100:00100000:3.0:1763343038.750895:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3254 00000100:00100000:1.0:1763343038.761707:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.762355:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993648000 00000100:00100000:2.0:1763343038.762376:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993648000 00000100:00100000:2.0:1763343038.762469:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9535 00000100:00100000:2.0:1763343038.762483:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56919:x1848997993648000:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:2.0:1763343038.762562:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343038.762599:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403528e00/0x607405d401ae7ff1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f2:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aa5 expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.762671:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8045 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ac1 expref: 259 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.762687:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae7fce lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a97 expref: 258 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.762700:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a3518935e00) 00010000:00010000:2.0:1763343038.762713:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343038.762747:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8053 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.762763:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8053 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.762774:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8053 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.762789:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae805a lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.762796:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae805a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.762803:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae805a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.762918:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8061 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.762926:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8061 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.762934:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8061 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000040:00080000:2.0:1763343038.763237:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1488, 64 off125384 00000040:00080000:2.0:1763343038.763261:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1489, 64 off125384 00000040:00080000:2.0:1763343038.763270:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1490, 64 off125448 00000040:00080000:2.0:1763343038.763280:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1489, 64 off125448 00010000:00010000:2.0:1763343038.763342:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8068 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763353:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8068 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763361:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8068 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763368:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8068 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763374:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8068 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763381:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8068 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763408:0:6525:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343038.763438:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343038.763444:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8068 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763451:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343038.763455:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8068 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763467:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8068 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763476:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a3404421d00) 00010000:00010000:2.0:1763343038.763479:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343038.763483:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8068 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763488:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8068 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763499:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.763500:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.763502:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.763535:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8061 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763542:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8061 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763547:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8061 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763552:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.763556:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8061 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763562:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8061 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763569:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f2:0x0].0x0 (ffff9a3404421d00) 00010000:00010000:2.0:1763343038.763572:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343038.763575:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8061 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763580:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8061 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763753:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8053 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763760:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8053 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763765:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8053 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763771:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8053 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763776:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.763779:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8053 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763785:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8053 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763793:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:2.0:1763343038.763796:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.763799:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8053 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763804:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8053 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:2.0:1763343038.763820:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000209d9e30 reply state 00000000ceeb3922 transno 8589940173 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae805a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763836:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae805a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.763842:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421400) 00010000:00010000:2.0:1763343038.763845:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343038.763848:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343038.763972:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56919:x1848997993648000:12345-192.168.204.21@tcp:36:rm.0 Request processed in 1488us (2275us total) trans 8589940173 rc 0/0 00000100:00100000:2.0:1763343038.763983:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9535 00000100:00100000:1.0:1763343038.768294:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.769997:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993648256 00000100:00100000:3.0:1763343038.770018:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993648256 00000100:00100000:0.0:1763343038.770193:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9536 00000100:00100000:0.0:1763343038.770206:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56914:x1848997993648256:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.770454:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.770489:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae806f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ac8 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.770593:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8076 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.770611:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8076 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771331:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8076 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771358:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae807d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771367:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae807d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771374:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae807d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771437:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8076 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771445:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8076 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771452:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8076 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771459:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.771464:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8076 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771471:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8076 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771485:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343038.771489:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.771495:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8076 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771501:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8076 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771516:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae807d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771522:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae807d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771528:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae807d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771534:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.771537:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae807d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771543:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae807d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771550:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421400) 00010000:00010000:0.0:1763343038.771553:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.771556:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae807d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771562:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae807d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343038.771605:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae806f lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ac8 expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.771654:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343038.771658:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343038.771662:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae806f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ac8 expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.771679:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d5600, rc 0) 00000100:00100000:0.0:1763343038.771774:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56914:x1848997993648256:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1568us (3494us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343038.771783:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9536 00000100:00100000:0.0:1763343038.788312:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.788446:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993648384 00000100:00100000:2.0:1763343038.788461:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993648384 00000100:00100000:2.0:1763343038.788544:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9537 00000100:00100000:2.0:1763343038.788557:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56920:x1848997993648384:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343038.788586:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.788667:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8084 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9acf expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.788768:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae808b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788785:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae808b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788800:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae808b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788813:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8092 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788820:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8092 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788828:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8092 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788896:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae808b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788904:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae808b lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788911:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae808b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788918:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.788923:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae808b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788932:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae808b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788947:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:2.0:1763343038.788952:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.788957:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae808b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788964:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae808b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788980:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8092 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788987:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8092 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788992:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8092 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.788998:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.789002:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8092 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.789008:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8092 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.789017:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421400) 00010000:00010000:2.0:1763343038.789019:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.789023:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8092 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.789029:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8092 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.789060:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8084 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9acf expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.789071:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:2.0:1763343038.789073:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.789077:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8084 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9acf expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.789093:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d800, rc 0) 00000100:00100000:2.0:1763343038.789166:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56920:x1848997993648384:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 611us (869us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343038.789175:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9537 00000100:00100000:2.0:1763343038.792118:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.792211:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993648512 00000100:00100000:0.0:1763343038.792223:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993648512 00000100:00100000:0.0:1763343038.792299:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9538 00000100:00100000:0.0:1763343038.792311:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56920:x1848997993648512:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.792342:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.792372:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8099 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ad6 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.792461:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80a0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792477:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80a0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792490:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80a0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792501:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792508:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792514:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792563:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80a0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792570:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80a0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792576:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792583:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80a0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792588:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.792593:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80a0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792601:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80a0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792615:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343038.792646:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.792653:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80a0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792660:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792677:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792682:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80a7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792687:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792691:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.792694:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792698:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792706:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421400) 00010000:00010000:0.0:1763343038.792708:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.792711:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80a7 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792720:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.792749:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8099 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ad6 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.792760:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343038.792762:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.792766:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8099 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ad6 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.792780:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d5600, rc 0) 00000100:00100000:0.0:1763343038.792870:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56920:x1848997993648512:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 560us (764us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343038.792878:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9538 00000100:00100000:1.0:1763343038.798411:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.798796:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993648640 00000100:00100000:2.0:1763343038.798813:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993648640 00000100:00100000:2.0:1763343038.799242:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9539 00000100:00100000:2.0:1763343038.799255:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56920:x1848997993648640:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:3.0:1763343038.799474:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:2.0:1763343038.799510:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.799541:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae80ae lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9add expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.799636:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae80b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.799652:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae80b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.799665:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae80b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343038.799723:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343038.799729:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343038.799768:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae80ae lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9add expref: 261 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.799788:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae80b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9add expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.799797:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:2.0:1763343038.799800:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343038.799804:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c600, rc 0) 00000100:00100000:2.0:1763343038.799881:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56920:x1848997993648640:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 628us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.799888:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9539 00000100:00100000:2.0:1763343038.802743:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993648896 00000100:00100000:2.0:1763343038.802765:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993648896 00000100:00100000:2.0:1763343038.802841:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9540 00000100:00100000:2.0:1763343038.802853:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56921:x1848997993648896:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343038.802894:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.802922:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae80bc lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ae4 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.803020:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae80c3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803037:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae80c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803048:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae80c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803058:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae80ca lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803064:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae80ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803070:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae80ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803113:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae80c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803119:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae80c3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803125:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae80c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803133:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.803137:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae80c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803145:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae80c3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803156:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:2.0:1763343038.803159:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.803163:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae80c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803168:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae80c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803182:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae80ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803187:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae80ca lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803192:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae80ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803196:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.803198:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae80ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803203:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae80ca lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803208:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421400) 00010000:00010000:2.0:1763343038.803210:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343038.803213:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae80ca lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803218:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae80ca lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343038.803246:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae80bc lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ae4 expref: 261 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.803255:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:2.0:1763343038.803257:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343038.803260:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae80bc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ae4 expref: 261 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.803269:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352da00, rc 0) 00000100:00100000:2.0:1763343038.803356:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56921:x1848997993648896:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 505us (3882us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343038.803364:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9540 00000100:00100000:1.0:1763343038.809134:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.810114:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993649024 00000100:00100000:0.0:1763343038.810131:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993649024 00000100:00100000:0.0:1763343038.810216:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9541 00000100:00100000:0.0:1763343038.810228:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56920:x1848997993649024:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.810255:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.810284:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae80d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9aeb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.810386:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80d8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810401:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80d8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810419:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80d8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810431:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80df lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810438:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80df lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810444:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80df lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810493:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80d8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810500:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80d8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810506:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810512:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80d8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810517:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.810522:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80d8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810529:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80d8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810540:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:0.0:1763343038.810544:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.810550:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80d8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810556:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810570:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80df lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810576:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80df lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810582:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80df lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810587:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.810590:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80df lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810596:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80df lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810602:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421400) 00010000:00010000:0.0:1763343038.810605:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.810608:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80df lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810614:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80df lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.810689:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae80d1 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aeb expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.810701:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:0.0:1763343038.810703:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.810707:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae80d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aeb expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.810716:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d5600, rc 0) 00000100:00100000:0.0:1763343038.810800:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56920:x1848997993649024:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 573us (1681us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343038.810809:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9541 00000100:00100000:1.0:1763343038.819935:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.820050:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993649280 00000100:00100000:2.0:1763343038.820064:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993649280 00000100:00100000:0.0:1763343038.820721:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9542 00000100:00100000:0.0:1763343038.820737:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56920:x1848997993649280:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.820765:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.820769:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343038.820806:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae80b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9add expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.820838:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:0.0:1763343038.820851:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343038.820879:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae80e6 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9af2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.821136:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80ed lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821152:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821162:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80ed lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821174:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80f4 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821182:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821187:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821779:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae80fb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821790:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae80fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821796:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae80fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343038.821806:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f4:0x0]: returning size 0 00010000:00010000:0.0:1763343038.821832:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80ed lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821839:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80ed lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821845:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80ed lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821851:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80ed lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821866:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.821870:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80ed lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821877:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80ed lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821890:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343038.821893:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.821897:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80ed lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821903:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae80ed lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:0.0:1763343038.821914:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000072d0a269 reply state 000000005d570fc2 transno 8589940174 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821924:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.821930:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421400) 00010000:00010000:0.0:1763343038.821932:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343038.821934:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343038.821964:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae80e6 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9af2 expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.821980:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae80fb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9af2 expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.821987:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4b00) 00010000:00010000:0.0:1763343038.821989:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343038.821991:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d4c00, rc 0) 00000100:00100000:0.0:1763343038.822946:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56920:x1848997993649280:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2205us (3019us total) trans 8589940174 rc 0/0 00000100:00100000:0.0:1763343038.822958:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9542 00000100:00100000:2.0:1763343038.829521:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.830208:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993649792 00000100:00100000:0.0:1763343038.830223:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993649792 00000100:00100000:0.0:1763343038.830298:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9543 00000100:00100000:0.0:1763343038.830308:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56920:x1848997993649792:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343038.830338:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.830362:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8109 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9af9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.830493:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8110 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.830510:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae80fb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9af2 expref: 263 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.830520:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8110 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.830558:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae80fb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9af2 expref: 263 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.830571:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae80fb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9af2 expref: 263 pid: 6525 timeout: 1332 lvb_type: 0 00000100:00100000:0.0:1763343038.830586:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010295296:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343038.830710:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343038.831030:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.831393:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993649664 00000100:00100000:2.0:1763343038.831401:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993649664 00000100:00100000:2.0:1763343038.831448:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9544 00000100:00100000:2.0:1763343038.831456:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56922:x1848997993649664:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343038.831469:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.831482:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8117 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b00 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.831560:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae811e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343038.831573:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae811e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343038.831586:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae811e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:2.0:1763343038.831597:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f4:0x0]: returning size 0 00010000:00010000:2.0:1763343038.831733:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae811e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343038.831741:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae811e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343038.831747:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae811e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343038.831753:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343038.831757:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae811e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343038.831765:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae811e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343038.831779:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4b00) 00010000:00010000:2.0:1763343038.831782:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763343038.831788:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae811e lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343038.831794:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae811e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343038.831842:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8117 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b00 expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.831867:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4b00) 00010000:00010000:2.0:1763343038.831870:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343038.831874:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8117 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b00 expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.831884:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352ce00, rc 0) 00000100:00100000:2.0:1763343038.831933:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56922:x1848997993649664:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 477us (904us total) trans 8589940175 rc 301/301 00000100:00100000:2.0:1763343038.831941:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9544 00000100:00100000:0.0:1763343038.836764:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010295296:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343038.836806:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8110 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:1.0:1763343038.837733:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.837769:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.837954:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993649920 00000100:00100000:3.0:1763343038.837967:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993649920 00010000:00010000:3.0:1763343038.838020:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae80fb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9af2 expref: 265 pid: 6525 timeout: 1332 lvb_type: 0 00000100:00100000:3.0:1763343038.838077:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3146 00000100:00100000:3.0:1763343038.838088:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:2429:x1848997993649920:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343038.838108:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343038.838115:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae80fb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9af2 expref: 265 pid: 6525 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343038.838129:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae80fb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9af2 expref: 265 pid: 6525 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343038.838159:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae80fb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9af2 expref: 265 pid: 6525 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343038.838177:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4b00) 00010000:00010000:3.0:1763343038.838183:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8110 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.838194:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8110 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.838202:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8110 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.838242:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343038.838505:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993650176 00000100:00100000:2.0:1763343038.838511:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993650176 00000100:00100000:2.0:1763343038.838552:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3255 00000100:00100000:2.0:1763343038.838559:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56922:x1848997993650176:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343038.838847:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56922:x1848997993650176:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 287us (1075us total) trans 8589940176 rc 0/0 00000100:00100000:2.0:1763343038.838865:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3255 00010000:00010000:1.0:1763343038.839131:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8110 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.839140:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8110 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343038.839164:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f4:0x0]: returning size 0 00000004:00080000:1.0:1763343038.839916:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2bf:0x0], index 1: 0 00000004:00080000:1.0:1763343038.839927:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2bd:0x0], index 0: 0 00000004:00080000:1.0:1763343038.839932:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2be:0x0], index 0: 0 00000004:00080000:1.0:1763343038.839938:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2c0:0x0], index 1: 0 00010000:00010000:1.0:1763343038.840066:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8110 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.840077:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8110 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.840084:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8110 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.840091:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.840096:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8110 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.840105:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8110 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.840123:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4b00) 00010000:00010000:1.0:1763343038.840126:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343038.840131:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8110 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.840137:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8110 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.840193:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8109 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9af9 expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.840204:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4b00) 00010000:00010000:1.0:1763343038.840206:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343038.840210:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8109 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9af9 expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.840233:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d5600, rc 0) 00000100:00100000:1.0:1763343038.840321:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56920:x1848997993649792:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 10013us (10812us total) trans 8589940177 rc 301/301 00000100:00100000:1.0:1763343038.840331:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9543 00000100:00100000:2.0:1763343038.842916:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:2429:x1848997993649920:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 4808us (5165us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.842935:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3146 00000100:00100000:2.0:1763343038.844229:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.844489:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993650432 00000100:00100000:1.0:1763343038.844504:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993650432 00000100:00100000:1.0:1763343038.844706:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9545 00000100:00100000:1.0:1763343038.844719:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56922:x1848997993650432:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343038.844748:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.844781:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae8133 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b07 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.844902:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae813a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.844919:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae813a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.844933:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae813a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.844946:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8141 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.844954:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8141 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.844962:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8141 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845111:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8148 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845121:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8148 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845127:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8148 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845242:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae813a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845249:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae813a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845254:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae813a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845261:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae813a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845268:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.845272:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae813a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845281:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae813a lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845294:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343038.845298:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.845304:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae813a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845311:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae813a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845325:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8141 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845330:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8141 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845336:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8141 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845340:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.845343:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8141 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845348:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8141 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845354:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421400) 00010000:00010000:1.0:1763343038.845357:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.845360:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8141 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845366:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8141 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.845407:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92600/0x607405d401ae8133 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b07 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.845425:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8148 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b07 expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.845433:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a3510289700) 00010000:00010000:1.0:1763343038.845436:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343038.845438:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:1.0:1763343038.845514:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56922:x1848997993650432:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 797us (1291us total) trans 8589940178 rc 0/0 00000100:00100000:1.0:1763343038.845522:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9545 00000100:00100000:2.0:1763343038.851112:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.851396:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993650688 00000100:00100000:3.0:1763343038.851412:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993650688 00000100:00100000:3.0:1763343038.851485:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3256 00000100:00100000:3.0:1763343038.851498:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56920:x1848997993650688:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343038.854289:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56920:x1848997993650688:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 2767us (3165us total) trans 8589940179 rc 0/0 00000100:00100000:3.0:1763343038.854310:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3256 00000100:00100000:2.0:1763343038.855408:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.856063:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993650816 00000100:00100000:3.0:1763343038.856077:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993650816 00000100:00100000:3.0:1763343038.856145:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6727 00000100:00100000:3.0:1763343038.856156:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993650816:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343038.856376:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343038.856404:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae8156 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b0e expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343038.856436:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343038.856459:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.856462:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.856475:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae8156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b0e expref: 17 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343038.856493:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae8156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b0e expref: 17 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343038.856510:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403529600, rc 0) 00000100:00100000:3.0:1763343038.856585:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993650816:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 430us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343038.856593:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6727 00000100:00100000:0.0:1763343038.858747:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.859113:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993651072 00000100:00100000:1.0:1763343038.859126:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993651072 00000100:00100000:1.0:1763343038.859376:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3257 00000100:00100000:1.0:1763343038.859388:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56920:x1848997993651072:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343038.859722:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56920:x1848997993651072:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 335us (987us total) trans 8589940180 rc 0/0 00000100:00100000:1.0:1763343038.859731:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3257 00000100:00100000:2.0:1763343038.863500:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.864407:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993651328 00000100:00100000:1.0:1763343038.864423:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993651328 00000100:00100000:1.0:1763343038.864503:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3258 00000100:00100000:1.0:1763343038.864516:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56922:x1848997993651328:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343038.864828:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56922:x1848997993651328:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 314us (1341us total) trans 8589940181 rc 0/0 00000100:00100000:1.0:1763343038.864836:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3258 00000100:00100000:3.0:1763343038.867147:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.868318:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993651584 00000100:00100000:1.0:1763343038.868336:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993651584 00000100:00100000:0.0:1763343038.868993:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9546 00000100:00100000:0.0:1763343038.869012:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:55941:x1848997993651584:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343038.869045:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.869049:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343038.869087:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8148 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b07 expref: 269 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.869141:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a3510289700) 00010000:00010000:0.0:1763343038.869156:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343038.869180:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae815d lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b15 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.869321:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8164 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.869336:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8164 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343038.869347:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8164 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343038.869360:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f4:0x0]: returning size 0 00010000:00010000:0.0:1763343038.869496:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae815d lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b15 expref: 271 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.869512:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8164 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b15 expref: 270 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.869518:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343038.869522:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1763343038.869524:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d4800, rc 0) 00000100:00100000:0.0:1763343038.869614:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:55941:x1848997993651584:12345-192.168.204.21@tcp:101:bash.0 Request processed in 608us (2481us total) trans 8589940182 rc 0/0 00000100:00100000:0.0:1763343038.869651:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9546 00000100:00100000:3.0:1763343038.870528:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.870778:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993651840 00000100:00100000:1.0:1763343038.870789:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993651840 00000100:00100000:1.0:1763343038.870839:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9547 00000100:00100000:1.0:1763343038.870848:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56922:x1848997993651840:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343038.870877:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.870896:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8172 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b1c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.870974:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8179 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.870986:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8179 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.870998:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8179 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.871010:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8180 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.871018:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8180 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.871025:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8180 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.871144:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae8187 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.871158:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae8187 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.871165:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae8187 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.871172:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae8187 lrc: 3/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.871178:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.871183:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae8187 lrc: 3/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.871192:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae8187 lrc: 4/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.871202:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343038.871207:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae8187 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.871213:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae8187 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343038.871229:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f4:0x0]: returning size 0 00010000:00010000:1.0:1763343038.872058:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8179 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.872070:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8179 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.872077:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8179 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.872083:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8179 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.872088:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.872091:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8179 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.872096:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8179 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.872108:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343038.872110:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.872113:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8179 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.872120:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8179 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.872131:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8180 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.872137:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8180 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.872143:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8180 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.872148:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.872151:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8180 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.872156:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8180 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.872162:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421400) 00010000:00010000:1.0:1763343038.872164:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.872167:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8180 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.872172:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8180 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.872211:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8172 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b1c expref: 272 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.872221:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343038.872223:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343038.872227:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8172 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b1c expref: 272 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.872243:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:1.0:1763343038.873518:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56922:x1848997993651840:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2659us (2984us total) trans 8589940183 rc 301/301 00000100:00100000:1.0:1763343038.873531:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9547 00010000:00010000:2.0:1763343038.877429:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343038.878011:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.878061:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.878132:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993652224 00000100:00100000:2.0:1763343038.878147:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993652224 00000100:00100000:2.0:1763343038.878234:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3259 00000100:00100000:2.0:1763343038.878247:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3509229850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56922:x1848997993652224:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343038.878572:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3509229850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56922:x1848997993652224:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 327us (508us total) trans 8589940184 rc 0/0 00000100:00100000:2.0:1763343038.878582:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3259 00000100:00100000:1.0:1763343038.879006:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993651968 00000100:00100000:1.0:1763343038.879013:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993651968 00000100:00100000:1.0:1763343038.879087:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9548 00000100:00100000:1.0:1763343038.879097:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:55941:x1848997993651968:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343038.879110:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.879137:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae8195 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b23 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.879176:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae819c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.879192:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae819c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.879205:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae819c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.879379:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae8195 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b23 expref: 274 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.879400:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae819c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b23 expref: 273 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.879416:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343038.879420:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343038.879424:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:1.0:1763343038.879473:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:55941:x1848997993651968:12345-192.168.204.21@tcp:101:bash.0 Request processed in 377us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.879481:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9548 00000100:00100000:3.0:1763343038.883753:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.883803:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.883940:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993652608 00000100:00100000:1.0:1763343038.883953:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993652608 00000100:00100000:1.0:1763343038.884016:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3260 00000100:00100000:1.0:1763343038.884027:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56922:x1848997993652608:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:1.0:1763343038.884244:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56922:x1848997993652608:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 218us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.884252:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3260 00000100:00100000:0.0:1763343038.884341:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993652480 00000100:00100000:0.0:1763343038.884346:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993652480 00000100:00100000:0.0:1763343038.884392:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9549 00000100:00100000:0.0:1763343038.884400:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:55941:x1848997993652480:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343038.884434:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343038.884470:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8164 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b15 expref: 273 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.884492:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343038.884498:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343038.884750:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae81a3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.884767:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae81a3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.884784:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae81a3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:0.0:1763343038.884841:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940185 00000004:00010000:0.0:1763343038.884876:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000daa45a0 reply state 00000000f9154475 transno 8589940186 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae81a3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.884889:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae81a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.884895:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343038.884898:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343038.884904:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343038.884970:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:55941:x1848997993652480:12345-192.168.204.21@tcp:36:bash.0 Request processed in 570us (1166us total) trans 8589940186 rc 0/0 00000100:00100000:0.0:1763343038.884978:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9549 00000020:00080000:0.0:1763343038.884983:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343038.887950:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.888459:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993652736 00000100:00100000:1.0:1763343038.888474:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993652736 00000100:00100000:1.0:1763343038.888547:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9550 00000100:00100000:1.0:1763343038.888559:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:55941:x1848997993652736:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343038.888590:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.888617:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae81aa lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b2a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.888719:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae81aa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b2a expref: 276 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.888736:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae81aa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b2a expref: 276 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.888758:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343038.888761:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343038.888766:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00000100:00100000:1.0:1763343038.888851:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:55941:x1848997993652736:12345-192.168.204.21@tcp:101:bash.0 Request processed in 294us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.888868:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9550 00000100:00100000:2.0:1763343038.894377:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.894530:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993652992 00000100:00100000:0.0:1763343038.894545:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993652992 00000100:00100000:0.0:1763343038.894647:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9551 00000100:00100000:0.0:1763343038.894659:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:55941:x1848997993652992:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343038.894690:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.894693:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343038.894729:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae81aa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b2a expref: 276 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.894755:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343038.894762:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343038.894780:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae81b1 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b31 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.894840:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae81b8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.894870:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae81b8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.894881:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae81b8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000040:00080000:0.0:1763343038.895172:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1491, 88 off125536 00000004:00080000:0.0:1763343038.895182:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232562561001ns, next at 1233117841489ns, rc = 0 00000040:00080000:0.0:1763343038.895225:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1490, 88 off125536 00000004:00080000:0.0:1763343038.895231:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232562610048ns, next at 1233117877304ns, rc = 0 00000040:00080000:0.0:1763343038.896118:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1491, 88 off125624 00000004:00080000:0.0:1763343038.896130:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232563508731ns, next at 1233117877304ns, rc = 0 00000040:00080000:0.0:1763343038.896147:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1492, 88 off125624 00000004:00080000:0.0:1763343038.896151:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232563530684ns, next at 1233117841489ns, rc = 0 00000100:00100000:3.0:1763343038.898558:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.898673:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993653248 00000100:00100000:1.0:1763343038.898688:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993653248 00000100:00100000:1.0:1763343038.898757:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9552 00000100:00100000:1.0:1763343038.898770:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+278:56923:x1848997993653248:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343038.898798:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.898829:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae81bf lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b38 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.898947:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae81c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.898965:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae81c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.898980:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae81c6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.898994:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae81cd lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899003:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae81cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899010:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae81cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899151:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae81d4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899162:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae81d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899169:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae81d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343038.899181:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f4:0x0]: returning size 2 00000001:00080000:2.0:1763343038.899284:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940187 is committed 00000004:00080000:2.0:1763343038.899295:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 981 committed 00000004:00080000:2.0:1763343038.899317:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 982 committed 00000004:00080000:2.0:1763343038.899329:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 981 committed 00000004:00080000:2.0:1763343038.899332:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 980 committed 00010000:00010000:1.0:1763343038.899432:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae81d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899440:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae81d4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899447:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae81d4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899453:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.899458:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae81d4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899467:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae81d4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899480:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343038.899484:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1763343038.899489:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae81d4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899497:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae81d4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343038.899511:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d1a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010295552:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763343038.899518:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae81c6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899524:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae81c6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899528:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae81c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899533:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae81c6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899537:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.899539:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae81c6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899544:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae81c6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899550:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343038.899552:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.899555:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae81c6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899560:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae81c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899569:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae81cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899574:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae81cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343038.899578:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343038.899580:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae81cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899586:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.899589:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae81cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899594:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae81cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899600:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421400) 00010000:00010000:1.0:1763343038.899602:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.899605:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae81cd lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.899610:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae81cd lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343038.899612:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010296064:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343038.899659:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343038.899683:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1763343038.899690:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010295424:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343038.899712:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343038.899725:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010295936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343038.899741:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343038.899768:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010295680:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343038.899790:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343038.899809:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343038.899814:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010295808:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343038.899835:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343038.899873:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae81bf lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b38 expref: 261 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343038.899879:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010295552 00000100:00100000:2.0:1763343038.899885:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010295552 00010000:00010000:1.0:1763343038.899885:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343038.899888:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343038.899891:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae81bf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b38 expref: 261 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.899906:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:2.0:1763343038.899917:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6728 00000100:00100000:2.0:1763343038.899925:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3658:x1848998010295552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343038.899950:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:696 count 1 00000100:00100000:1.0:1763343038.899965:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56923:x1848997993653248:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1199us (1420us total) trans 8589940188 rc 301/301 00010000:00010000:2.0:1763343038.899972:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae81e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.899973:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9552 00010000:00010000:2.0:1763343038.899988:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae7f88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a82 expref: 26 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.899997:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343038.899999:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343038.900003:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae81e2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.900029:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae7f88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a82 expref: 26 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.900044:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae7f88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a82 expref: 26 pid: 28996 timeout: 1332 lvb_type: 0 00000100:00100000:2.0:1763343038.900056:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010296192:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343038.900106:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35085399c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343038.900122:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010296064 00000100:00100000:2.0:1763343038.900126:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010296064 00000100:00100000:2.0:1763343038.900155:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010295424 00000100:00100000:2.0:1763343038.900159:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010295424 00000100:00100000:1.0:1763343038.900165:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010295936 00000100:00100000:1.0:1763343038.900169:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010295936 00000100:00100000:2.0:1763343038.900176:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010295680 00000100:00100000:2.0:1763343038.900178:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010295680 00000100:00100000:1.0:1763343038.900187:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010295808 00000100:00100000:1.0:1763343038.900189:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010295808 00000100:00100000:2.0:1763343038.900193:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6729 00000100:00100000:2.0:1763343038.900199:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3658:x1848998010296064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343038.900205:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6730 00000100:00100000:1.0:1763343038.900211:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3658:x1848998010295424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343038.900221:0:27833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:695 count 1 00010000:00010000:1.0:1763343038.900234:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae81e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.900247:0:27833:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a89 expref: 26 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.900252:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343038.900254:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343038.900256:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae81e9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343038.900350:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3658:x1848998010296064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 150us (689us total) trans 21474838982 rc 0/0 00000100:00100000:2.0:1763343038.900356:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6729 00000100:00100000:2.0:1763343038.900371:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6731 00000100:00100000:2.0:1763343038.900376:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3658:x1848998010295936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343038.900444:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3658:x1848998010295936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (701us total) trans 21474838983 rc 0/0 00000100:00100000:2.0:1763343038.900451:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6731 00000100:00100000:2.0:1763343038.900463:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6732 00000100:00100000:2.0:1763343038.900468:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3659:x1848998010295680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343038.900479:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:699 count 1 00010000:00010000:1.0:1763343038.900482:0:27833:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a89 expref: 26 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.900489:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae81f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.900491:0:27833:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a89 expref: 26 pid: 27835 timeout: 1332 lvb_type: 0 00000100:00100000:1.0:1763343038.900501:0:27833:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27833:1848998010296320:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343038.900507:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae8014 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ab3 expref: 26 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.900514:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343038.900516:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343038.900518:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae81f0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.900528:0:27833:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b600 going to sleep for 11 seconds 00010000:00010000:2.0:1763343038.900537:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae8014 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ab3 expref: 26 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.900548:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6733 00010000:00010000:2.0:1763343038.900550:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae8014 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ab3 expref: 26 pid: 28995 timeout: 1332 lvb_type: 0 00000100:00100000:1.0:1763343038.900555:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3659:x1848998010295808:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343038.900560:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010296448:192.168.204.21@tcp:104: 00002000:00080000:1.0:1763343038.900567:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:700 count 1 00000100:00100000:2.0:1763343038.900583:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3508539e40 going to sleep for 11 seconds 00002000:00010000:1.0:1763343038.900589:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343038.900594:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae81f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.900602:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.900604:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.900609:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae81f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.900644:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae81f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763343038.900652:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052ad880/2, rc 0, transno 21474838983 00010000:00010000:1.0:1763343038.900652:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae81f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343038.900658:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010295936:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343038.900659:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae81f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763343038.900670:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052adc00/2, rc 0, transno 21474838982 00000100:00100000:2.0:1763343038.900673:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010296064:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343038.900675:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343038.900835:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343038.900845:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae81f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.900849:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3659:x1848998010295808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 294us (1012us total) trans 21474838984 rc 0/0 00010000:00010000:3.0:1763343038.900865:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3ea00 already unused, calling callback (ffffffffc0d8ab40) 00000100:00100000:1.0:1763343038.900866:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6733 00010000:00010000:3.0:1763343038.900870:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae81f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.900878:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae81f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763343038.900892:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052ac000/2, rc 0, transno 21474838984 00010000:00010000:3.0:1763343038.900894:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae81f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.900896:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010295808:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1763343038.900901:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae81f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.900917:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343038.900919:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343038.900920:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343038.900954:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae81b8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b31 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.900963:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343038.900965:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343038.900978:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae81b1 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b31 expref: 260 pid: 6525 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343038.900993:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae81b8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b31 expref: 259 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.901021:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343038.901024:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343038.901027:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d4c00, rc 0) 00000100:00100000:3.0:1763343038.901038:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010296704:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343038.901055:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:55941:x1848997993652992:12345-192.168.204.21@tcp:101:bash.0 Request processed in 6400us (6696us total) trans 8589940187 rc 0/0 00000100:00100000:1.0:1763343038.901063:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9551 00000100:00100000:3.0:1763343038.901070:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343038.901089:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010297216:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343038.901113:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343038.901126:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010296704 00000100:00100000:3.0:1763343038.901130:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1763343038.901131:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010296704 00000100:00100000:3.0:1763343038.901135:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010296576:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343038.901155:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010297216 00000100:00100000:3.0:1763343038.901156:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343038.901157:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010297216 00000100:00100000:3.0:1763343038.901165:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010297088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343038.901167:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010296576 00000100:00100000:1.0:1763343038.901169:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010296576 00000100:00100000:1.0:1763343038.901179:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6734 00000100:00100000:3.0:1763343038.901182:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343038.901184:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3660:x1848998010296704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763343038.901198:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:698 count 1 00000100:00100000:3.0:1763343038.901200:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010297088 00000100:00100000:3.0:1763343038.901202:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010297088 00010000:00010000:1.0:1763343038.901215:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae81fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343038.901219:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6735 00000100:00100000:3.0:1763343038.901225:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3660:x1848998010297216:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1763343038.901229:0:28993:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae7f73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a74 expref: 16 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.901235:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343038.901237:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343038.901241:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae81fe lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.901261:0:28993:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae7f73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a74 expref: 16 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.901271:0:28993:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae7f73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a74 expref: 16 pid: 27835 timeout: 1332 lvb_type: 0 00000100:00100000:1.0:1763343038.901281:0:28993:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:28993:1848998010297344:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343038.901318:0:28993:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1763343038.901324:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3660:x1848998010297216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (210us total) trans 17179871684 rc 0/0 00000100:00100000:3.0:1763343038.901331:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6735 00000100:00100000:3.0:1763343038.901345:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6736 00000100:00100000:1.0:1763343038.901349:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6737 00000100:00100000:3.0:1763343038.901351:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3660:x1848998010296576:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343038.901355:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3660:x1848998010297088:12345-0@lo:2:osp-syn-1-0.0 00002000:00080000:3.0:1763343038.901362:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:697 count 1 00010000:00010000:3.0:1763343038.901373:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403528c00/0x607405d401ae8205 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.901384:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae7cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a9 expref: 16 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.901391:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343038.901393:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343038.901396:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403528c00/0x607405d401ae8205 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343038.901414:0:15756:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:3.0:1763343038.901415:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae7cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a9 expref: 16 pid: 28995 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343038.901417:0:15756:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343038.901420:0:15756:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343038.901422:0:15756:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb ctime from disk: 0 -> 0 00010000:00010000:3.0:1763343038.901425:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae7cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a9 expref: 16 pid: 28995 timeout: 1332 lvb_type: 0 00002000:00010000:1.0:1763343038.901425:0:15756:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343038.901434:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010297472:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343038.901451:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3660:x1848998010297088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (267us total) trans 17179871685 rc 0/0 00000100:00100000:1.0:1763343038.901457:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6737 00000100:00100000:3.0:1763343038.901458:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133ca80 going to sleep for 11 seconds 00000004:00080000:3.0:1763343038.901484:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3538756680/2, rc 0, transno 17179871685 00000100:00100000:3.0:1763343038.901489:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010297088:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343038.901497:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3538755500/2, rc 0, transno 17179871684 00000100:00100000:3.0:1763343038.901501:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010297216:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343038.901516:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010296960:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343038.901540:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343038.901575:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343038.901581:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010296832:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343038.901600:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343038.901662:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010296960 00000100:00100000:3.0:1763343038.901666:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010296960 00000100:00100000:3.0:1763343038.901685:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010296832 00000100:00100000:3.0:1763343038.901687:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010296832 00000100:00100000:3.0:1763343038.901701:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6738 00000100:00100000:3.0:1763343038.901705:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3658:x1848998010296960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343038.901716:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:702 count 1 00002000:00010000:3.0:1763343038.901732:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343038.901737:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae820c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.901745:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.901747:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.901750:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae820c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.901760:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae820c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.901768:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae820c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.901775:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae820c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.901788:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343038.901938:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010296960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 231us (396us total) trans 17179871686 rc 0/0 00000100:00100000:3.0:1763343038.901945:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6738 00000100:00100000:3.0:1763343038.901958:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6739 00000100:00100000:3.0:1763343038.901964:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3658:x1848998010296832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343038.901981:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:701 count 1 00010000:00010000:3.0:1763343038.901992:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8213 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.902004:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae8022 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aba expref: 16 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.902011:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343038.902012:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343038.902015:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8213 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.902020:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae805a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.902028:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae805a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.902033:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae8022 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aba expref: 16 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.902034:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae805a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.902041:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.902045:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae805a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343038.902049:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae8022 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aba expref: 16 pid: 8410 timeout: 1332 lvb_type: 0 00010000:00010000:0.0:1763343038.902052:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae805a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343038.902059:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010297600:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343038.902064:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421400) 00010000:00010000:0.0:1763343038.902067:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.902071:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae805a lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.902077:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae805a lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343038.902090:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133ccc0 going to sleep for 11 seconds 00010000:00010000:0.0:1763343038.902092:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.902097:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.902103:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.902107:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.902110:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.902116:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.902123:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421400) 00010000:00010000:0.0:1763343038.902126:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.902129:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80f4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00080000:3.0:1763343038.902134:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3538757480/2, rc 0, transno 17179871686 00010000:00010000:0.0:1763343038.902134:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae80f4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343038.902139:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010296960:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763343038.902150:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae81a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.902156:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae81a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.902161:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae81a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.902165:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d5a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343038.902168:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae81a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.902174:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae81a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.902182:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343038.902185:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343038.902188:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae81a3 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.902194:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae81a3 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.902772:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343038.902782:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae820c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.902790:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403528e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343038.902794:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae820c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.902801:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae820c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.902816:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae820c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.902822:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae820c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.902842:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.902843:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.902845:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343038.907754:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.907789:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.908041:0:27833:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:27833:1848998010296320:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343038.908090:0:27833:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae81e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343038.908141:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993653376 00000100:00100000:0.0:1763343038.908150:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993653376 00010000:00010000:0.0:1763343038.908204:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae7f88 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a82 expref: 27 pid: 28996 timeout: 1332 lvb_type: 0 00000100:00100000:3.0:1763343038.908229:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993653504 00000100:00100000:3.0:1763343038.908234:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993653504 00000100:00100000:0.0:1763343038.908250:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3147 00010000:00010000:3.0:1763343038.908253:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a89 expref: 28 pid: 27835 timeout: 1332 lvb_type: 0 00000100:00100000:0.0:1763343038.908260:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3542052050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2432:x1848997993653376:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343038.908280:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343038.908286:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae7f88 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a82 expref: 28 pid: 28996 timeout: 1332 lvb_type: 0 00000100:00100000:3.0:1763343038.908291:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3148 00000100:00100000:3.0:1763343038.908299:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2432:x1848997993653504:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343038.908301:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae7f88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a82 expref: 28 pid: 28996 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343038.908307:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343038.908311:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a89 expref: 28 pid: 27835 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343038.908319:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a89 expref: 28 pid: 27835 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343038.908332:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dc600/0x607405d401ae7f9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a89 expref: 28 pid: 27835 timeout: 1332 lvb_type: 0 00010000:00010000:0.0:1763343038.908337:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.908340:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.908344:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.908346:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae81e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.908347:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.908350:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae81e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.908359:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae81e9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.908359:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae81e2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.908379:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343038.908382:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343038.908442:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2432:x1848997993653504:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 143us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343038.908449:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3148 00000100:00100000:1.0:1763343038.908919:0:28993:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:28993:1848998010297344:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343038.908939:0:28993:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae81fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343038.908948:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3542052050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2432:x1848997993653376:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 688us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.908955:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3147 00010000:00010000:0.0:1763343038.909023:0:27833:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae81e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.909032:0:27833:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae81e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.909043:0:27833:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae81e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.909052:0:27833:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae81e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.909072:0:27833:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343038.909958:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343038.909970:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae81e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.909981:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343038.909986:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae81e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.909997:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae81e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.910020:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae81e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.910028:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3e800/0x607405d401ae81e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.910052:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343038.910054:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343038.910056:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343038.910511:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010297600:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343038.910537:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8213 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343038.910575:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.910595:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.910595:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3658:x1848998010295424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10381us (10878us total) trans 21474838985 rc 0/0 00000100:00100000:0.0:1763343038.910607:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6730 00000100:00100000:3.0:1763343038.910610:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.910654:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993653760 00000100:00100000:3.0:1763343038.910661:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993653760 00000100:00100000:0.0:1763343038.910667:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993653632 00000100:00100000:0.0:1763343038.910670:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993653632 00010000:00010000:0.0:1763343038.910697:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae7f73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a74 expref: 18 pid: 27835 timeout: 1332 lvb_type: 0 00000100:00100000:0.0:1763343038.910722:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993653888 00000100:00100000:0.0:1763343038.910725:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993653888 00000100:00100000:1.0:1763343038.910745:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010297472:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343038.910759:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3403528c00/0x607405d401ae8205 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.910801:0:28995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92000/0x607405d401ae7f88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a82 expref: 25 pid: 28996 timeout: 1332 lvb_type: 0 00000004:00080000:1.0:1763343038.910803:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a4ea00/2, rc 0, transno 21474838985 00000100:00100000:1.0:1763343038.910809:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010295424:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343038.910813:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:28995:1848998010296192:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343038.910828:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae81e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.910835:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3149 00010000:00010000:2.0:1763343038.910837:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae81e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.910843:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae81e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343038.910844:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2431:x1848997993653632:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343038.910865:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae81e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.910872:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343038.910873:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae81e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.910879:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae7f73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a74 expref: 19 pid: 27835 timeout: 1332 lvb_type: 0 00010000:00010000:2.0:1763343038.910889:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343038.910889:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae7f73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a74 expref: 19 pid: 27835 timeout: 1332 lvb_type: 0 00010000:00010000:1.0:1763343038.910908:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92a00/0x607405d401ae7f73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9a74 expref: 19 pid: 27835 timeout: 1332 lvb_type: 0 00010000:00010000:1.0:1763343038.910921:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.910922:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343038.910928:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae81fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.910938:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae81fe lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.910960:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343038.910998:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2431:x1848997993653632:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 155us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.911006:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3149 00010000:00010000:3.0:1763343038.911047:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae7cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a9 expref: 18 pid: 28995 timeout: 1332 lvb_type: 0 00000100:00100000:2.0:1763343038.911052:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3658:x1848998010295552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11128us (11473us total) trans 21474838986 rc 0/0 00000100:00100000:2.0:1763343038.911059:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6728 00000100:00100000:3.0:1763343038.911070:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3150 00000100:00100000:3.0:1763343038.911077:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2431:x1848997993653760:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343038.911086:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343038.911090:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae7cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a9 expref: 18 pid: 28995 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343038.911100:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae7cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a9 expref: 18 pid: 28995 timeout: 1332 lvb_type: 0 00010000:00010000:2.0:1763343038.911100:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343038.911106:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae81e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.911113:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae7cf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac99a9 expref: 18 pid: 28995 timeout: 1332 lvb_type: 0 00010000:00010000:2.0:1763343038.911115:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343038.911119:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae81e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.911124:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.911125:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343038.911127:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae81e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.911128:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3403528c00/0x607405d401ae8205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.911137:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403528c00/0x607405d401ae8205 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.911140:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae81e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.911148:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae81e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.911153:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343038.911162:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.911165:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.911166:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343038.911171:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2431:x1848997993653760:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 95us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343038.911178:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3150 00000004:00080000:2.0:1763343038.911184:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d1a5c00/2, rc 0, transno 21474838986 00000100:00100000:2.0:1763343038.911189:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d1a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010295552:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1763343038.911198:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3403528c00/0x607405d401ae8205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.911206:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3403528c00/0x607405d401ae8205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.911213:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403528c00/0x607405d401ae8205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.911225:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403528c00/0x607405d401ae8205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.911237:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343038.911284:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.911394:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.911424:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.911458:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010296448:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343038.911474:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae81f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343038.911497:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993654272 00000100:00100000:2.0:1763343038.911501:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993654272 00000100:00100000:3.0:1763343038.911894:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3660:x1848998010296576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10540us (10733us total) trans 17179871687 rc 0/0 00000100:00100000:3.0:1763343038.911902:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6736 00000100:00100000:3.0:1763343038.911923:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6740 00000100:00100000:3.0:1763343038.911930:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993654272:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343038.911945:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343038.911960:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b46 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.911982:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae8156 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b0e expref: 18 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343038.911989:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.911990:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.911994:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 18 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.912027:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae8156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b0e expref: 18 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343038.912041:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae8156 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b0e expref: 18 pid: 28996 timeout: 1332 lvb_type: 1 00000100:00100000:3.0:1763343038.912060:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010297728:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343038.912403:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae8022 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aba expref: 18 pid: 8410 timeout: 1332 lvb_type: 0 00000100:00100000:0.0:1763343038.912440:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993654016 00000100:00100000:0.0:1763343038.912445:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993654016 00010000:00010000:0.0:1763343038.912463:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae8014 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ab3 expref: 25 pid: 28995 timeout: 1332 lvb_type: 0 00000100:00100000:0.0:1763343038.912475:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3151 00000100:00100000:0.0:1763343038.912481:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2431:x1848997993653888:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763343038.912611:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3152 00000100:00100000:2.0:1763343038.912635:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2429:x1848997993654016:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343038.912647:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343038.912652:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae8014 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ab3 expref: 25 pid: 28995 timeout: 1332 lvb_type: 0 00010000:00010000:2.0:1763343038.912663:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae8014 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ab3 expref: 25 pid: 28995 timeout: 1332 lvb_type: 0 00010000:00010000:2.0:1763343038.912683:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d600/0x607405d401ae8014 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ab3 expref: 25 pid: 28995 timeout: 1332 lvb_type: 0 00010000:00010000:2.0:1763343038.912695:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343038.912696:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343038.912700:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae81f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.912708:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae81f0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.912725:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343038.912945:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343038.912950:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae8022 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aba expref: 18 pid: 8410 timeout: 1332 lvb_type: 0 00010000:00010000:0.0:1763343038.912960:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae8022 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aba expref: 18 pid: 8410 timeout: 1332 lvb_type: 0 00010000:00010000:0.0:1763343038.912973:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3403529800/0x607405d401ae8022 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9aba expref: 18 pid: 8410 timeout: 1332 lvb_type: 0 00010000:00010000:0.0:1763343038.912982:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.912984:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343038.912987:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.913000:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8213 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343038.913017:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c900 going to sleep for 11 seconds 00010000:00010000:0.0:1763343038.913021:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343038.913035:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343038.913042:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3403528c00/0x607405d401ae8205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.913099:0:28993:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae81fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.913114:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae81fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.913124:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae81fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.913132:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae81fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.913148:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343038.913470:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3660:x1848998010296704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12283us (12398us total) trans 17179871688 rc 0/0 00000100:00100000:1.0:1763343038.913478:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6734 00000100:00100000:1.0:1763343038.913507:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993654144 00000100:00100000:1.0:1763343038.913512:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993654144 00000100:00100000:1.0:1763343038.913544:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9553 00000100:00100000:1.0:1763343038.913551:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56923:x1848997993654144:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343038.913567:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.913586:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8221 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b3f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.913718:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae8228 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.913732:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae8228 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.913743:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae8228 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343038.913772:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f4:0x0]: returning size 2 00000004:00200000:1.0:1763343038.913777:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343038.913798:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae8228 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343038.913821:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8221 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b3f expref: 258 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.913835:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae8228 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b3f expref: 257 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.913844:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343038.913847:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343038.913862:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f000, rc 0) 00010000:00010000:3.0:1763343038.914000:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403528c00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343038.914006:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403528c00/0x607405d401ae8205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.914016:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403528c00/0x607405d401ae8205 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.914029:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3403528c00/0x607405d401ae8205 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.914037:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3403528c00/0x607405d401ae8205 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.914055:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343038.914059:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae81fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.914065:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fa00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343038.914068:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae81fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.914077:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae81fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.914085:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae81fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.914091:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3fa00/0x607405d401ae81fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.914102:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343038.914104:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343038.914106:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343038.914149:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3538756300/2, rc 0, transno 17179871687 00000100:00100000:3.0:1763343038.914155:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010296576:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763343038.914163:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3538755180/2, rc 0, transno 17179871688 00000100:00100000:3.0:1763343038.914166:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010296704:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343038.914660:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2429:x1848997993654016:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 2038us (3372us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.914670:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3152 00010000:00010000:2.0:1763343038.914697:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.914710:0:8410:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae81f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.914718:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae81f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.914726:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae81f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.914732:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae81f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.914756:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343038.915486:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3659:x1848998010295680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14514us (15191us total) trans 21474838987 rc 0/0 00000100:00100000:0.0:1763343038.915486:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2431:x1848997993653888:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 3000us (4870us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343038.915498:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6732 00000100:00100000:0.0:1763343038.915498:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3151 00010000:00010000:0.0:1763343038.915531:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.915540:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.915549:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.915555:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763343038.915557:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052af800/2, rc 0, transno 21474838987 00000100:00100000:2.0:1763343038.915563:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010295680:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1763343038.915572:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1763343038.915579:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343038.915586:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae81f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.915593:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343038.915597:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae81f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.915604:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae81f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.915650:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae81f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.915658:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae81f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.915689:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343038.915693:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.915700:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403529e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343038.915703:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.915710:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8213 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.915721:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8213 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.915727:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3403529e00/0x607405d401ae8213 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.915740:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.915742:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343038.915744:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343038.915784:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010296832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13820us (14182us total) trans 17179871689 rc 0/0 00000100:00100000:0.0:1763343038.915791:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6739 00010000:00010000:0.0:1763343038.915808:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343038.916095:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56923:x1848997993654144:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2541us (4698us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.916104:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9553 00000004:00080000:0.0:1763343038.917263:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3538754e00/2, rc 0, transno 17179871689 00000100:00100000:0.0:1763343038.917277:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010296832:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343038.922227:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.922357:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993654528 00000100:00100000:2.0:1763343038.922372:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993654528 00000100:00100000:2.0:1763343038.922447:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3261 00000100:00100000:3.0:1763343038.922457:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010297728:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343038.922458:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56923:x1848997993654528:12345-192.168.204.21@tcp:35:lfs.0 00010000:00010000:3.0:1763343038.922497:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 15 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.922521:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403528e00, rc 0) 00000100:00100000:3.0:1763343038.922944:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:55941:x1848997993654272:12345-192.168.204.21@tcp:101:bash.0 Request processed in 11010us (11515us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343038.922955:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6740 00000100:00100000:2.0:1763343038.923201:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56923:x1848997993654528:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 742us (986us total) trans 8589940189 rc 0/0 00000100:00100000:2.0:1763343038.923209:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3261 00000100:00100000:1.0:1763343038.930124:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.934231:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993654656 00000100:00100000:3.0:1763343038.934254:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993654656 00010000:00010000:3.0:1763343038.934318:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae8156 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b0e expref: 15 pid: 28996 timeout: 1332 lvb_type: 1 00000100:00100000:3.0:1763343038.934384:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3153 00000100:00100000:3.0:1763343038.934397:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993654656:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343038.934420:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343038.934427:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae8156 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b0e expref: 15 pid: 28996 timeout: 1332 lvb_type: 1 00010000:00010000:3.0:1763343038.934442:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae8156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b0e expref: 15 pid: 28996 timeout: 1332 lvb_type: 1 00010000:00010000:3.0:1763343038.934472:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3403529600/0x607405d401ae8156 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b0e expref: 15 pid: 28996 timeout: 1332 lvb_type: 1 00010000:00010000:3.0:1763343038.934494:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.934496:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.934507:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.934519:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.934571:0:27834:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343038.934594:0:27834:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:27834:1848998010297856:192.168.204.21@tcp:105: 00000100:00100000:3.0:1763343038.934777:0:27834:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c900 going to sleep for 11 seconds 00000100:00100000:0.0:1763343038.935496:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.935671:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993654784 00000100:00100000:1.0:1763343038.935680:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993654784 00000100:00100000:1.0:1763343038.935737:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9554 00000100:00100000:1.0:1763343038.935746:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56923:x1848997993654784:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343038.935771:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343038.935800:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae822f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b4d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.935885:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8236 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.935901:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8236 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.935915:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8236 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.935929:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae823d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.935935:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae823d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.935942:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae823d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936049:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae8244 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936059:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae8244 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936065:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae8244 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343038.936118:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f4:0x0]: returning size 2 00000004:00200000:1.0:1763343038.936124:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343038.936149:0:6523:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae8244 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936161:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae8244 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936171:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8236 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936181:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8236 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936187:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8236 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936194:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8236 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936201:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.936206:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8236 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936214:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8236 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936226:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343038.936229:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.936235:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8236 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936241:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8236 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936255:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae823d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936261:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae823d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936266:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae823d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936272:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fa00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343038.936275:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae823d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936287:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae823d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936295:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289300) 00010000:00010000:1.0:1763343038.936297:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343038.936300:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae823d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936305:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae823d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343038.936335:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae822f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b4d expref: 260 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.936351:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae8244 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b4d expref: 259 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343038.936358:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343038.936361:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343038.936363:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3e200, rc 0) 00000100:00100000:1.0:1763343038.936444:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56923:x1848997993654784:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 699us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343038.936453:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9554 00000100:00100000:3.0:1763343038.940549:0:27834:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:27834:1848998010297856:192.168.204.21@tcp:105: 00010000:00010000:3.0:1763343038.940583:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343038.940693:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993654656:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 6297us (10585us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343038.940707:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3153 00000100:00100000:2.0:1763343038.944212:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343038.944378:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993654912 00000100:00100000:3.0:1763343038.944392:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993654912 00000100:00100000:3.0:1763343038.944465:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6741 00000100:00100000:3.0:1763343038.944477:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:55941:x1848997993654912:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343038.944505:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343038.944542:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae824b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b54 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343038.944572:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343038.944598:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.944601:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343038.944611:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae824b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b54 expref: 25 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.944795:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae824b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b54 expref: 25 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343038.944813:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92600, rc 0) 00000100:00100000:0.0:1763343038.945062:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:55941:x1848997993654912:12345-192.168.204.21@tcp:101:bash.0 Request processed in 586us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.945071:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6741 00000100:00100000:2.0:1763343038.949324:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343038.955238:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993655040 00000100:00100000:0.0:1763343038.955264:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993655040 00000100:00100000:0.0:1763343038.955381:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 411 00000100:00100000:0.0:1763343038.955400:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3542052c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:2432:x1848997993655040:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343038.955424:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343038.955461:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae8244 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b4d expref: 259 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.955495:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343038.955502:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343038.955592:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3542052c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:2432:x1848997993655040:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 202us (6283us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343038.955601:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 411 00000100:00100000:1.0:1763343038.960043:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.960098:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.960164:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993655168 00000100:00100000:2.0:1763343038.960179:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993655168 00002000:00010000:2.0:1763343038.960239:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/703 (0->18446744073709551615) 00002000:00100000:2.0:1763343038.960245:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a353876c380 with x1848997993655168 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343038.960262:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a353876c380. 00000100:00100000:2.0:1763343038.960307:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993655296 00000100:00100000:2.0:1763343038.960311:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993655296 00002000:00010000:2.0:1763343038.960336:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/701 (0->18446744073709551615) 00002000:00100000:2.0:1763343038.960340:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a353876f480 with x1848997993655296 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343038.960349:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a353876f480. 00000100:00100000:2.0:1763343038.960387:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1636 00000100:00100000:2.0:1763343038.960399:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993655168:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343038.960685:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343038.960690:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb mtime from disk: 0 -> 1763343038 00002000:00010000:2.0:1763343038.960693:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343038.960695:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb ctime from disk: 0 -> 1763343038 00002000:00010000:2.0:1763343038.960698:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343038.960770:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993655168:12345-192.168.204.21@tcp:10:bash.0 Request processed in 373us (742us total) trans 17179871690 rc 0/0 00000100:00100000:2.0:1763343038.960780:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1636 00002000:00010000:2.0:1763343038.960784:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/703 (0->18446744073709551615) 00002000:00100000:2.0:1763343038.960786:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a353876c380 with x1848997993655168 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343038.960790:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a353876c380. 00000100:00100000:2.0:1763343038.960810:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1637 00000100:00100000:2.0:1763343038.960818:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2429:x1848997993655296:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343038.960933:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2bd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343038.960936:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2bd:0x0] updating lvb mtime from disk: 0 -> 1763343038 00002000:00010000:2.0:1763343038.960938:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2bd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343038.960940:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2bd:0x0] updating lvb ctime from disk: 0 -> 1763343038 00002000:00010000:2.0:1763343038.960942:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2bd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343038.960966:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2429:x1848997993655296:12345-192.168.204.21@tcp:10:bash.0 Request processed in 149us (868us total) trans 21474838988 rc 0/0 00000100:00100000:2.0:1763343038.960972:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1637 00002000:00010000:2.0:1763343038.960975:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/701 (0->18446744073709551615) 00002000:00100000:2.0:1763343038.960978:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a353876f480 with x1848997993655296 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343038.960982:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a353876f480. 00000100:00100000:3.0:1763343038.977907:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343038.977935:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.978035:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993655552 00000100:00100000:0.0:1763343038.978035:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993655808 00000100:00100000:2.0:1763343038.978051:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993655552 00000100:00100000:0.0:1763343038.978051:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993655808 00000100:00100000:2.0:1763343038.978113:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3262 00000100:00100000:0.0:1763343038.978118:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9555 00000100:00100000:0.0:1763343038.978124:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56924:x1848997993655808:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:2.0:1763343038.978125:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:55941:x1848997993655552:12345-192.168.204.21@tcp:35:bash.0 00010000:00010000:0.0:1763343038.978152:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343038.978180:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8252 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b5b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.978276:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8259 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.978295:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8259 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343038.978309:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8259 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343038.978321:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f4:0x0]: returning size 2 00010000:00010000:0.0:1763343038.978440:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8252 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b5b expref: 263 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.978459:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8259 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b5b expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343038.978468:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343038.978471:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763343038.978475:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d5600, rc 0) 00000100:00100000:2.0:1763343038.979778:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993655552:12345-192.168.204.21@tcp:35:bash.0 Request processed in 1643us (1876us total) trans 8589940190 rc 0/0 00000100:00100000:2.0:1763343038.979794:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3262 00000100:00100000:0.0:1763343038.979962:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56924:x1848997993655808:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1836us (2025us total) trans 8589940191 rc 0/0 00000100:00100000:0.0:1763343038.979971:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9555 00000100:00100000:1.0:1763343038.992832:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343038.993483:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993656064 00000100:00100000:2.0:1763343038.993499:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993656064 00000100:00100000:2.0:1763343038.993577:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9556 00000100:00100000:2.0:1763343038.993588:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56924:x1848997993656064:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343038.993617:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343038.993674:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8267 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b62 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.993819:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.993838:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae8228 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b3f expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.993848:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343038.993906:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae8228 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b3f expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343038.993919:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae8228 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b3f expref: 262 pid: 6525 timeout: 1332 lvb_type: 0 00000100:00100000:2.0:1763343038.993935:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010297984:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343038.994050:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35167c1900 going to sleep for 11 seconds 00000100:00100000:2.0:1763343039.004310:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.004938:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.005152:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993656320 00000100:00100000:0.0:1763343039.005165:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993656320 00000100:00100000:0.0:1763343039.005258:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3263 00000100:00100000:0.0:1763343039.005270:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56925:x1848997993656320:12345-192.168.204.21@tcp:35:rm.0 00000100:00100000:0.0:1763343039.005712:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56925:x1848997993656320:12345-192.168.204.21@tcp:35:rm.0 Request processed in 442us (1416us total) trans 8589940192 rc 0/0 00000100:00100000:0.0:1763343039.005722:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3263 00000100:00100000:2.0:1763343039.006004:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993656448 00000100:00100000:2.0:1763343039.006011:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993656448 00010000:00010000:2.0:1763343039.006044:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae8228 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b3f expref: 264 pid: 6525 timeout: 1332 lvb_type: 0 00000100:00100000:2.0:1763343039.006082:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3154 00000100:00100000:2.0:1763343039.006091:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:2430:x1848997993656448:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343039.006104:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343039.006112:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae8228 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b3f expref: 264 pid: 6525 timeout: 1332 lvb_type: 0 00010000:00010000:2.0:1763343039.006125:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae8228 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b3f expref: 264 pid: 6525 timeout: 1332 lvb_type: 0 00010000:00010000:2.0:1763343039.006153:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:2.0:1763343039.006158:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.006171:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.006179:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.006201:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343039.006225:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:2430:x1848997993656448:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 136us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.006232:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3154 00010000:00010000:1.0:1763343039.006915:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae8228 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b3f expref: 263 pid: 6525 timeout: 1332 lvb_type: 0 00000100:00100000:1.0:1763343039.006936:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010297984:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343039.006962:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.006973:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.006979:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343039.007006:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f4:0x0]: returning size 5 00010000:00010000:1.0:1763343039.007153:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8267 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b62 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.007171:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b62 expref: 263 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.007179:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343039.007182:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763343039.007185:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352de00, rc 0) 00000100:00100000:1.0:1763343039.007238:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56924:x1848997993656064:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 13652us (14423us total) trans 8589940193 rc 0/0 00000100:00100000:1.0:1763343039.007953:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9556 00000100:00080000:2.0:1763343039.008658:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1763343039.010131:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.014181:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993656832 00000100:00100000:1.0:1763343039.014206:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993656832 00000100:00100000:1.0:1763343039.014318:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9557 00000100:00100000:1.0:1763343039.014331:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56925:x1848997993656832:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:1.0:1763343039.014416:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343039.014456:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8259 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b5b expref: 263 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.014486:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae81b8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b31 expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.014501:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae819c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b23 expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.014515:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343039.014521:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343039.014561:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae827c lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.014575:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae827c lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.014586:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae827c lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.014600:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8283 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.014605:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8283 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.014611:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8283 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.014747:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.014765:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b62 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.014774:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.014816:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b62 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.014830:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b62 expref: 260 pid: 6525 timeout: 1332 lvb_type: 0 00000100:00100000:1.0:1763343039.014847:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010298112:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343039.017874:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343039.017911:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.017952:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993656960 00000100:00100000:1.0:1763343039.017964:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993656960 00000100:00100000:1.0:1763343039.018037:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9558 00000100:00100000:1.0:1763343039.018047:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56924:x1848997993656960:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343039.018076:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.018104:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae8291 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b69 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.018669:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8298 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.018689:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.018699:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8298 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.018722:0:10041:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.018733:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8298 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343039.027526:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.027635:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993657088 00000100:00100000:0.0:1763343039.027648:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993657088 00010000:00010000:0.0:1763343039.027704:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b62 expref: 263 pid: 6525 timeout: 1332 lvb_type: 0 00000100:00100000:0.0:1763343039.027756:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3155 00000100:00100000:0.0:1763343039.027767:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:2429:x1848997993657088:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343039.027785:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343039.027793:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b62 expref: 263 pid: 6525 timeout: 1332 lvb_type: 0 00010000:00010000:0.0:1763343039.027807:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b62 expref: 263 pid: 6525 timeout: 1332 lvb_type: 0 00010000:00010000:0.0:1763343039.027836:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343039.027842:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.027864:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.027873:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.027882:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8298 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.027888:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8298 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.027895:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8298 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.027917:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343039.027979:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:2429:x1848997993657088:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 214us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.027987:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3155 00010000:00010000:1.0:1763343039.029201:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae826e lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b62 expref: 262 pid: 6525 timeout: 1332 lvb_type: 0 00000100:00100000:1.0:1763343039.029233:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010298112:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343039.029260:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029270:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029276:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00000004:00080000:1.0:1763343039.029670:0:6525:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1f4:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1763343039.029784:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029793:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029801:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029812:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3ea00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.029817:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029827:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029843:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343039.029846:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343039.029859:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8298 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.029870:0:6525:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8298 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.029877:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8298 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.029912:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029919:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae828a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029935:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae827c lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029941:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae827c lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029946:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae827c lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029952:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae827c lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029956:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fa00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.029959:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae827c lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029965:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae827c lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029973:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343039.029975:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.029977:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae827c lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.029982:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae827c lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:1.0:1763343039.029997:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f4d9e04a reply state 000000001b4a7eb2 transno 8589940194 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8283 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.030008:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8283 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.030013:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289300) 00010000:00010000:1.0:1763343039.030015:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343039.030019:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343039.030223:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8298 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.030232:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8298 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:2.0:1763343039.030266:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f4:0x0]: returning size 5 00000004:00200000:2.0:1763343039.030272:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343039.030292:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8298 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.030326:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae8291 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b69 expref: 264 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.030343:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8298 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b69 expref: 263 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.030351:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:2.0:1763343039.030353:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343039.030356:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f800, rc 0) 00000100:00100000:1.0:1763343039.032109:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56925:x1848997993656832:12345-192.168.204.21@tcp:36:rm.0 Request processed in 17764us (21986us total) trans 8589940194 rc 0/0 00000100:00100000:1.0:1763343039.032125:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9557 00000100:00100000:2.0:1763343039.038520:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56924:x1848997993656960:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 20454us (20594us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.038538:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9558 00000100:00100000:0.0:1763343039.048371:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.048481:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993657344 00000100:00100000:1.0:1763343039.048495:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993657344 00000100:00100000:1.0:1763343039.048571:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9559 00000100:00100000:1.0:1763343039.048583:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56924:x1848997993657344:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343039.048614:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.048685:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae829f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b70 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.048843:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae82a6 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.048874:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae82a6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.048888:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae82a6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343039.048904:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f4:0x0]: returning size 5 00010000:00010000:1.0:1763343039.049056:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae829f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b70 expref: 265 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.049082:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae82a6 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b70 expref: 264 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.049093:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343039.049097:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343039.049103:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3fc00, rc 0) 00000100:00100000:1.0:1763343039.049183:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56924:x1848997993657344:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 601us (828us total) trans 8589940195 rc 0/0 00000100:00100000:1.0:1763343039.049192:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9559 00000100:00100000:0.0:1763343039.052905:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.052971:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993657472 00000100:00100000:3.0:1763343039.052985:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993657472 00000100:00100000:3.0:1763343039.053061:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9560 00000100:00100000:3.0:1763343039.053073:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56926:x1848997993657472:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.053107:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.053138:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae82b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b77 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.053222:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae82bb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053239:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae82bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053252:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae82bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053329:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae82c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053338:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae82c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053346:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae82c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053405:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae82bb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053412:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae82bb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053420:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae82bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053427:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae82bb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053434:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.053439:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae82bb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053448:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae82bb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053462:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bec00) 00010000:00010000:3.0:1763343039.053465:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.053470:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae82bb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053476:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae82bb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053490:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae82c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053495:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae82c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053500:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae82c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053505:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.053507:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae82c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053516:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae82c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053522:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289300) 00010000:00010000:3.0:1763343039.053525:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.053528:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae82c2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053534:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae82c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.053563:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae82b4 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b77 expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.053572:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bec00) 00010000:00010000:3.0:1763343039.053575:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.053578:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae82b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b77 expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.053591:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:3.0:1763343039.053701:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56926:x1848997993657472:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 629us (811us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343039.053710:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9560 00000100:00100000:0.0:1763343039.056192:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.056337:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993657600 00000100:00100000:3.0:1763343039.056355:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993657600 00000100:00100000:3.0:1763343039.056425:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9561 00000100:00100000:3.0:1763343039.056437:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56926:x1848997993657600:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.056463:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.056491:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae82c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b7e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.056580:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae82d0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056595:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae82d0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056606:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae82d0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056617:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056686:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056692:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056742:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae82d0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056749:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae82d0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056755:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae82d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056761:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae82d0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056766:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.056770:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae82d0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056779:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae82d0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056792:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bef00) 00010000:00010000:3.0:1763343039.056795:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.056799:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae82d0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056805:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae82d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056819:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056824:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82d7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056830:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056834:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.056836:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056841:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82d7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056846:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289300) 00010000:00010000:3.0:1763343039.056848:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.056859:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82d7 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056864:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.056890:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae82c9 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b7e expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.056900:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bef00) 00010000:00010000:3.0:1763343039.056902:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.056905:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae82c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b7e expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.056918:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343039.056992:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56926:x1848997993657600:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 557us (813us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343039.057001:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9561 00000100:00100000:0.0:1763343039.063260:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.063325:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.063439:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993657728 00000100:00100000:3.0:1763343039.063455:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993657728 00000100:00100000:1.0:1763343039.063609:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993657856 00000100:00100000:1.0:1763343039.063614:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993657856 00000100:00100000:1.0:1763343039.063689:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6742 00000100:00100000:1.0:1763343039.063698:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e9ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993657856:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:1.0:1763343039.063757:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae82de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.063787:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 15 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.063797:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343039.063800:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343039.063804:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae82de lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.063845:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 15 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.063868:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 15 pid: 28996 timeout: 1332 lvb_type: 0 00000100:00100000:1.0:1763343039.063886:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010298240:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343039.063977:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343039.064076:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9562 00000100:00100000:3.0:1763343039.064084:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56926:x1848997993657728:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.064098:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.064120:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae82e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b85 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.064186:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae82ec lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.064200:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae82ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.064215:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae82ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343039.064294:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343039.064301:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343039.064346:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae82e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b85 expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.064368:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae82ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b85 expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.064378:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bec00) 00010000:00010000:3.0:1763343039.064381:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343039.064385:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501481200, rc 0) 00000100:00100000:3.0:1763343039.064488:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56926:x1848997993657728:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 403us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.064496:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9562 00000100:00080000:0.0:1763343039.064559:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763343039.068253:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.068572:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010298240:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343039.068608:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae82de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.069190:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993657984 00000100:00100000:3.0:1763343039.069202:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993657984 00002000:00100000:3.0:1763343039.069267:0:28425:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x2bf:0x0] (0->4) req@ffff9a34062ca680 x1848997993657984/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:535/0 lens 496/0 e 0 to 0 dl 1763343050 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343039.069279:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062ca680 with x1848997993657984 ext(0->4) 00010000:00010000:3.0:1763343039.069288:0:28425:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 16 pid: 28996 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343039.069407:0:28425:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 16 pid: 28996 timeout: 1332 lvb_type: 0 00002000:00010000:3.0:1763343039.069417:0:28425:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a34062ca680 00000100:00100000:3.0:1763343039.070062:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 110 00000100:00100000:3.0:1763343039.070078:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993657984:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:3.0:1763343039.071686:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993657984:12345-192.168.204.21@tcp:4:bash.0 Request processed in 1600us (3437us total) trans 17179871691 rc 0/0 00000100:00100000:3.0:1763343039.071702:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 110 00002000:00100000:3.0:1763343039.071715:0:28425:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x2bf:0x0] (0->4) req@ffff9a34062ca680 x1848997993657984/t17179871691(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:535/0 lens 496/448 e 0 to 0 dl 1763343050 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343039.071726:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062ca680 with x1848997993657984 ext(0->4) 00010000:00010000:3.0:1763343039.071738:0:28425:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 18 pid: 28996 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343039.071757:0:28425:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 18 pid: 28996 timeout: 1332 lvb_type: 0 00002000:00010000:3.0:1763343039.071766:0:28425:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a34062ca680 00000100:00100000:1.0:1763343039.076089:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.076187:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.076347:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993658240 00000100:00100000:2.0:1763343039.076362:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993658240 00010000:00010000:2.0:1763343039.076416:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 18 pid: 28996 timeout: 1332 lvb_type: 0 00000100:00100000:2.0:1763343039.076470:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3156 00000100:00100000:2.0:1763343039.076482:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2432:x1848997993658240:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343039.076502:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763343039.076528:0:27834:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763343039.076532:0:27834:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343039.076541:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 18 pid: 28996 timeout: 1332 lvb_type: 0 00010000:00010000:2.0:1763343039.076557:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 18 pid: 28996 timeout: 1332 lvb_type: 0 00010000:00010000:2.0:1763343039.076590:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3403528e00/0x607405d401ae821a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b46 expref: 18 pid: 28996 timeout: 1332 lvb_type: 0 00010000:00010000:2.0:1763343039.076610:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.076613:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.076670:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae82de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.076683:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae82de lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.076713:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343039.076781:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2432:x1848997993658240:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 300us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.076790:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3156 00010000:00010000:1.0:1763343039.077818:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae82de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.077835:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae82de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.077876:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae82de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.077885:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae82de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.077892:0:28996:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae82de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.077899:0:28996:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343039.077903:0:28996:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae82de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.077911:0:28996:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae82de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.077927:0:28996:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae82de lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.077934:0:28996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae82de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343039.078031:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e9ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993657856:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 14331us (14703us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343039.078040:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6742 00000100:00100000:3.0:1763343039.078542:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993658112 00000100:00100000:3.0:1763343039.078554:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993658112 00000100:00100000:3.0:1763343039.078640:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9563 00000100:00100000:3.0:1763343039.078651:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56926:x1848997993658112:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.078676:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.078701:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae82f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b8c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.078775:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82fa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078790:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078806:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82fa lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078818:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae8301 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078825:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae8301 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078831:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae8301 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078889:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82fa lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078896:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82fa lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078902:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82fa lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078908:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82fa lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078913:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.078918:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82fa lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078924:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82fa lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078936:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bec00) 00010000:00010000:3.0:1763343039.078940:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.078945:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82fa lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078951:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae82fa lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078965:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae8301 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078971:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae8301 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078977:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae8301 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078982:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.078985:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae8301 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078991:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae8301 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.078998:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289300) 00010000:00010000:3.0:1763343039.079001:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.079004:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae8301 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.079010:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae8301 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.079042:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae82f3 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b8c expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.079053:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bec00) 00010000:00010000:3.0:1763343039.079056:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.079060:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae82f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b8c expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.079070:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480a00, rc 0) 00000100:00100000:3.0:1763343039.079109:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56926:x1848997993658112:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 460us (3035us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343039.079117:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9563 00000100:00100000:1.0:1763343039.083130:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.083425:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.083865:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993658624 00000100:00100000:2.0:1763343039.083880:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993658624 00000100:00100000:3.0:1763343039.084051:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993658752 00000100:00100000:3.0:1763343039.084056:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993658752 00000100:00100000:2.0:1763343039.084452:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9564 00000100:00100000:2.0:1763343039.084466:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56924:x1848997993658624:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:2.0:1763343039.084536:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343039.084573:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8298 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b69 expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.084605:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:2.0:1763343039.084613:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343039.084719:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9565 00000100:00100000:0.0:1763343039.084732:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56926:x1848997993658752:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343039.084744:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.084746:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343039.084762:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae82ec lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b85 expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.084778:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bec00) 00010000:00010000:0.0:1763343039.084790:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343039.084811:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8308 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b93 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.084937:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae830f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.084953:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae830f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.084967:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae830f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.084980:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8316 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.084988:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8316 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.084994:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8316 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.085516:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae831d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.085528:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae831d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.085536:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae831d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343039.085547:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f5:0x0]: returning size 0 00010000:00010000:0.0:1763343039.085578:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae830f lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.085586:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae830f lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.085594:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae830f lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.085602:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae830f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.085609:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.085614:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae830f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.085664:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae830f lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.085674:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4000) 00010000:00010000:0.0:1763343039.085678:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.085683:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae830f lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.085690:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae830f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:0.0:1763343039.085703:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006bba4fd8 reply state 000000008d8399b2 transno 8589940196 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8316 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.085715:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8316 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.085722:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289300) 00010000:00010000:0.0:1763343039.085724:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343039.085727:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343039.085758:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8308 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b93 expref: 267 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.085778:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae831d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b93 expref: 266 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.085786:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a34037c4c00) 00010000:00010000:0.0:1763343039.085789:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343039.085792:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d5600, rc 0) 00000100:00100000:0.0:1763343039.085907:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56926:x1848997993658752:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1178us (2481us total) trans 8589940196 rc 0/0 00000100:00100000:0.0:1763343039.085917:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9565 00010000:00010000:2.0:1763343039.086037:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae832b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.086049:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae832b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.086059:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae832b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000040:00080000:2.0:1763343039.086252:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1493, 88 off125712 00000004:00080000:2.0:1763343039.086265:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232753643133ns, next at 1233117841489ns, rc = 0 00000040:00080000:2.0:1763343039.086316:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1492, 88 off125712 00000004:00080000:2.0:1763343039.086324:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232753702880ns, next at 1233117877304ns, rc = 0 00000040:00080000:2.0:1763343039.086348:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1493, 88 off125800 00000004:00080000:2.0:1763343039.086353:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232753732073ns, next at 1233117877304ns, rc = 0 00000040:00080000:2.0:1763343039.086364:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1494, 88 off125800 00000004:00080000:2.0:1763343039.086369:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232753748118ns, next at 1233117841489ns, rc = 0 00000100:00100000:2.0:1763343039.091615:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.092528:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993659008 00000100:00100000:1.0:1763343039.092546:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993659008 00000100:00100000:1.0:1763343039.092657:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9566 00000100:00100000:1.0:1763343039.092669:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56926:x1848997993659008:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343039.092696:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.092724:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae8332 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9b9a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.092880:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8339 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.092897:0:6523:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae831d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b93 expref: 269 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.092905:0:6523:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8339 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.092947:0:6523:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae831d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b93 expref: 269 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.092963:0:6523:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae831d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b93 expref: 269 pid: 6523 timeout: 1332 lvb_type: 0 00000100:00100000:1.0:1763343039.092980:0:6523:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010298368:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343039.093094:0:6523:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b9c0 going to sleep for 11 seconds 00000001:00080000:3.0:1763343039.094331:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940197 is committed 00000004:00080000:3.0:1763343039.094345:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 983 committed 00010000:00010000:2.0:1763343039.094562:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8283 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.094575:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8283 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.094583:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8283 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.094591:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.094598:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8283 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.094606:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8283 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.094666:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289300) 00010000:00010000:2.0:1763343039.094671:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.094677:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8283 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.094684:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8283 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.094704:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8316 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.094712:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8316 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.094718:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8316 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.094723:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.094727:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8316 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.094733:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8316 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.094741:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289300) 00010000:00010000:2.0:1763343039.094744:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.094747:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8316 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.094757:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae8316 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00080000:3.0:1763343039.094926:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 984 committed 00000004:00080000:3.0:1763343039.094944:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 983 committed 00000004:00080000:3.0:1763343039.094947:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 982 committed 00000100:00100000:0.0:1763343039.095293:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010298496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343039.095373:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.095740:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010298880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.095776:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.095801:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343039.095808:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010298752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.095828:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343039.095933:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343039.095941:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010298624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343039.095966:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343039.096014:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010298496 00000100:00100000:0.0:1763343039.096023:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010298496 00000100:00100000:0.0:1763343039.096088:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010298880 00000100:00100000:0.0:1763343039.096092:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010298880 00000100:00100000:0.0:1763343039.096113:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010298752 00000100:00100000:0.0:1763343039.096115:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010298752 00000100:00100000:0.0:1763343039.096131:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010298624 00000100:00100000:0.0:1763343039.096134:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010298624 00000100:00100000:0.0:1763343039.096158:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6743 00000100:00100000:0.0:1763343039.096167:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3657:x1848998010298496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343039.096398:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3657:x1848998010298496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 231us (1024us total) trans 17179871692 rc 0/0 00000100:00100000:0.0:1763343039.096407:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6743 00000100:00100000:0.0:1763343039.096427:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6744 00000100:00100000:0.0:1763343039.096433:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3660:x1848998010298880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343039.096532:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+48:3660:x1848998010298880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (755us total) trans 21474838989 rc 0/0 00000100:00100000:0.0:1763343039.096539:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6744 00000100:00100000:0.0:1763343039.096550:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6745 00000100:00100000:0.0:1763343039.096556:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3660:x1848998010298752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343039.096615:0:28996:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2bd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343039.096645:0:28996:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2bd:0x0] updating lvb mtime from disk: 1763343038 -> 1763343038 00002000:00010000:0.0:1763343039.096648:0:28996:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2bd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343039.096651:0:28996:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2bd:0x0] updating lvb ctime from disk: 1763343038 -> 1763343038 00002000:00010000:0.0:1763343039.096653:0:28996:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2bd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343039.096682:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+48:3660:x1848998010298752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (852us total) trans 21474838990 rc 0/0 00000100:00100000:0.0:1763343039.096689:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6745 00000100:00100000:0.0:1763343039.096701:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6746 00000100:00100000:0.0:1763343039.096708:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3657:x1848998010298624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343039.096774:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3657:x1848998010298624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (806us total) trans 17179871693 rc 0/0 00000100:00100000:0.0:1763343039.096780:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6746 00000100:00080000:0.0:1763343039.096815:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1763343039.096820:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1763343039.096889:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d10f800/2, rc 0, transno 21474838990 00000100:00100000:0.0:1763343039.096896:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010298752:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343039.096907:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d10dc00/2, rc 0, transno 21474838989 00000100:00100000:0.0:1763343039.096910:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010298880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343039.096936:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a353876c700/2, rc 0, transno 17179871693 00000100:00100000:0.0:1763343039.096941:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010298624:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343039.096949:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a353876ca80/2, rc 0, transno 17179871692 00000100:00100000:0.0:1763343039.096952:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010298496:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1763343039.097106:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000c822d50 reply state 000000002924cc50 transno 8589940197 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae832b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.097132:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae832b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.097143:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:2.0:1763343039.097146:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1763343039.097151:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1763343039.097274:0:10041:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1763343039.097290:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56924:x1848997993658624:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 12826us (14175us total) trans 8589940197 rc 0/0 00000100:00100000:2.0:1763343039.097298:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9564 00010000:00010000:0.0:1763343039.097539:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae832b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.097549:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae832b lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.097557:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae832b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.097563:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.097569:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae832b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.097577:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae832b lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.097588:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343039.097591:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343039.097595:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae832b lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.097601:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae832b lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000100:00100000:1.0:1763343039.103387:0:6523:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1848998010298368:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343039.103431:0:6523:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8339 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000100:00100000:2.0:1763343039.103724:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.103823:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993659264 00000100:00100000:0.0:1763343039.103833:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993659264 00000100:00100000:0.0:1763343039.103916:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9567 00000100:00100000:0.0:1763343039.103926:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:56924:x1848997993659264:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343039.103962:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.103991:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8340 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ba1 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.104063:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8340 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ba1 expref: 258 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.104084:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8340 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ba1 expref: 258 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.104105:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343039.104108:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343039.104112:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d5a00, rc 0) 00000100:00100000:0.0:1763343039.104188:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56924:x1848997993659264:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 262us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.104201:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9567 00000100:00100000:1.0:1763343039.104676:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.106016:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993659136 00000100:00100000:0.0:1763343039.106031:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993659136 00010000:00010000:0.0:1763343039.106076:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae831d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b93 expref: 258 pid: 6523 timeout: 1332 lvb_type: 0 00000100:00100000:0.0:1763343039.106125:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3157 00000100:00100000:0.0:1763343039.106136:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:2429:x1848997993659136:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343039.106154:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343039.106162:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae831d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b93 expref: 258 pid: 6523 timeout: 1332 lvb_type: 0 00010000:00010000:0.0:1763343039.106175:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae831d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b93 expref: 258 pid: 6523 timeout: 1332 lvb_type: 0 00010000:00010000:0.0:1763343039.106202:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae831d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b93 expref: 258 pid: 6523 timeout: 1332 lvb_type: 0 00010000:00010000:0.0:1763343039.106222:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a34037c4c00) 00010000:00010000:0.0:1763343039.106229:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8339 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.106238:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8339 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.106245:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8339 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.110045:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343039.110752:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+257:2429:x1848997993659136:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 4607us (6066us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343039.110770:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3157 00010000:00010000:1.0:1763343039.110831:0:6523:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8339 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.110842:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8339 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343039.110886:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f5:0x0]: returning size 0 00000004:00080000:1.0:1763343039.111129:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2bf:0x0], index 0: 0 00000004:00080000:1.0:1763343039.111135:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2c1:0x0], index 1: 0 00000004:00080000:1.0:1763343039.111141:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2c2:0x0], index 1: 0 00000004:00080000:1.0:1763343039.111145:0:6523:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2c0:0x0], index 0: 0 00010000:00010000:1.0:1763343039.111285:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8339 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.111295:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8339 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.111303:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8339 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.111310:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fa00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.111316:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8339 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.111324:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8339 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.111350:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a34037c4c00) 00010000:00010000:1.0:1763343039.111353:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343039.111358:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8339 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.111364:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8339 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.111428:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae8332 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b9a expref: 257 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.111440:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a34037c4c00) 00010000:00010000:1.0:1763343039.111443:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343039.111447:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae8332 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b9a expref: 257 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.111462:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f000, rc 0) 00000100:00100000:1.0:1763343039.111518:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56926:x1848997993659008:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 18851us (19916us total) trans 8589940198 rc 301/301 00000100:00100000:1.0:1763343039.111526:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9566 00000100:00100000:2.0:1763343039.114838:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.114949:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.115060:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993659648 00000100:00100000:3.0:1763343039.115074:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993659648 00000100:00100000:3.0:1763343039.115148:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3264 00000100:00100000:3.0:1763343039.115161:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+256:56926:x1848997993659648:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343039.115914:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993659392 00000100:00100000:1.0:1763343039.115923:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993659392 00000100:00100000:1.0:1763343039.115976:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9568 00000100:00100000:1.0:1763343039.115985:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56924:x1848997993659392:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343039.116000:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.116025:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae834e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ba8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.116111:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae8355 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.116132:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae8355 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.116147:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae8355 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343039.116182:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f4:0x0]: returning size 5 00000004:00200000:1.0:1763343039.116188:0:6523:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343039.116206:0:6523:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae8355 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.116233:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae834e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ba8 expref: 260 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.116251:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae8355 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ba8 expref: 259 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.116262:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343039.116279:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763343039.116284:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3e200, rc 0) 00000100:00100000:1.0:1763343039.117617:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56924:x1848997993659392:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1619us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343039.117654:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9568 00000100:00100000:2.0:1763343039.118957:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56926:x1848997993659648:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 3787us (3995us total) trans 8589940199 rc 0/0 00000100:00100000:2.0:1763343039.118976:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3264 00000100:00100000:2.0:1763343039.123194:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.123325:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.123456:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993660032 00000100:00100000:1.0:1763343039.123471:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993660032 00000100:00100000:3.0:1763343039.124086:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993659776 00000100:00100000:3.0:1763343039.124094:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993659776 00000100:00100000:3.0:1763343039.124156:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6747 00000100:00100000:3.0:1763343039.124168:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993659776:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.124193:0:8410:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.124223:0:8410:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae835c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9baf expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343039.124255:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bf:0x0] initial LVB size: 5, mtime: 0x691a7abe, atime: 0x0, ctime: 0x691a7abe, blocks: 0x8 00010000:00010000:3.0:1763343039.124291:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.124294:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.124308:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae835c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9baf expref: 17 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343039.124328:0:8410:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae835c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9baf expref: 17 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343039.124343:0:8410:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480e00, rc 0) 00000100:00100000:3.0:1763343039.124418:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993659776:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 252us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.124426:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6747 00000100:00100000:1.0:1763343039.124535:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3265 00000100:00100000:1.0:1763343039.124547:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56926:x1848997993660032:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343039.124795:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56926:x1848997993660032:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 250us (1468us total) trans 8589940200 rc 0/0 00000100:00100000:1.0:1763343039.124802:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3265 00000100:00100000:2.0:1763343039.133916:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.136068:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993660288 00000100:00100000:1.0:1763343039.136089:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993660288 00000100:00100000:1.0:1763343039.136179:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9569 00000100:00100000:1.0:1763343039.136192:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:55941:x1848997993660288:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343039.136224:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.136258:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae8363 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9bb6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.136462:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae836a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136480:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae836a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136494:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae836a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136509:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8371 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136515:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8371 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136522:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8371 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136598:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8378 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136611:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8378 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136617:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8378 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:1.0:1763343039.136666:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f5:0x0]: returning size 0 00010000:00010000:1.0:1763343039.136779:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae836a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136787:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae836a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136793:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae836a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136800:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae836a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136806:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.136811:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae836a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136820:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae836a lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136834:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343039.136838:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.136844:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae836a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136861:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f000/0x607405d401ae836a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136880:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8371 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136886:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8371 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136891:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8371 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136895:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3fa00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.136898:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8371 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136904:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8371 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136911:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289100) 00010000:00010000:1.0:1763343039.136914:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.136917:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8371 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136923:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae8371 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:1.0:1763343039.136972:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae8363 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bb6 expref: 262 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.136990:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8378 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bb6 expref: 261 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.136998:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a3510289a00) 00010000:00010000:1.0:1763343039.137001:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343039.137004:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f800, rc 0) 00000100:00100000:1.0:1763343039.137099:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:55941:x1848997993660288:12345-192.168.204.21@tcp:101:bash.0 Request processed in 909us (3200us total) trans 8589940201 rc 0/0 00000100:00100000:1.0:1763343039.137107:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9569 00000100:00100000:0.0:1763343039.143128:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.143268:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993660416 00000100:00100000:2.0:1763343039.143284:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993660416 00000100:00100000:2.0:1763343039.143569:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9570 00000100:00100000:2.0:1763343039.143580:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:55941:x1848997993660416:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343039.143612:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.143767:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8386 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9bbd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.143815:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae838d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.143834:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae838d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.143846:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae838d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.143995:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8386 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bbd expref: 263 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.144015:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae838d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bbd expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.144025:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a3510289a00) 00010000:00010000:2.0:1763343039.144029:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343039.144033:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352da00, rc 0) 00000100:00100000:2.0:1763343039.144113:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993660416:12345-192.168.204.21@tcp:101:bash.0 Request processed in 536us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.144121:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9570 00000100:00100000:3.0:1763343039.149513:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.149739:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993660672 00000100:00100000:0.0:1763343039.149755:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993660672 00000100:00100000:0.0:1763343039.149831:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9571 00000100:00100000:0.0:1763343039.149843:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993660672:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343039.150010:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343039.150047:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8378 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bb6 expref: 262 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.150073:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a3510289a00) 00010000:00010000:0.0:1763343039.150080:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343039.150326:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae8394 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.150344:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae8394 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.150357:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae8394 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:0.0:1763343039.150417:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940202 00000004:00010000:0.0:1763343039.150441:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ec657106 reply state 00000000df403c65 transno 8589940203 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae8394 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.150456:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae8394 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.150463:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a3510289a00) 00010000:00010000:0.0:1763343039.150467:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343039.150469:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343039.150602:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993660672:12345-192.168.204.21@tcp:36:bash.0 Request processed in 760us (1106us total) trans 8589940203 rc 0/0 00000100:00100000:0.0:1763343039.150612:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9571 00000020:00080000:0.0:1763343039.150676:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343039.153442:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.153535:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993660800 00000100:00100000:2.0:1763343039.153550:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993660800 00000100:00100000:2.0:1763343039.153660:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9572 00000100:00100000:2.0:1763343039.153672:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993660800:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343039.153708:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.153735:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae839b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9bc4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.153811:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae839b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bc4 expref: 265 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.153829:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae839b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bc4 expref: 265 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.153858:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a3510289a00) 00010000:00010000:2.0:1763343039.153862:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343039.153867:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c600, rc 0) 00000100:00100000:2.0:1763343039.153935:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993660800:12345-192.168.204.21@tcp:101:bash.0 Request processed in 265us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.153943:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9572 00000100:00100000:2.0:1763343039.156758:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.157040:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993661056 00000100:00100000:0.0:1763343039.157054:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993661056 00000100:00100000:0.0:1763343039.157126:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9573 00000100:00100000:0.0:1763343039.157137:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993661056:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343039.157163:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.157167:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343039.157202:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae839b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bc4 expref: 265 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.157224:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a3510289a00) 00010000:00010000:0.0:1763343039.157230:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343039.157246:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae83a2 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9bcb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.157384:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae83a9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.157399:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae83a9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.157411:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae83a9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000040:00080000:0.0:1763343039.157798:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1494, 88 off125888 00000004:00080000:0.0:1763343039.157809:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232825187671ns, next at 1233117877304ns, rc = 0 00000040:00080000:0.0:1763343039.157860:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1495, 88 off125888 00000004:00080000:0.0:1763343039.157867:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232825246163ns, next at 1233117841489ns, rc = 0 00000040:00080000:0.0:1763343039.157883:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1496, 88 off125976 00000004:00080000:0.0:1763343039.157887:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232825266665ns, next at 1233117841489ns, rc = 0 00000040:00080000:0.0:1763343039.157896:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1495, 88 off125976 00000004:00080000:0.0:1763343039.157900:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232825279343ns, next at 1233117877304ns, rc = 0 00000001:00080000:0.0:1763343039.160454:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940204 is committed 00000004:00080000:0.0:1763343039.160473:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 986 committed 00010000:00010000:1.0:1763343039.160600:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae8394 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.160616:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae8394 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.160644:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae8394 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.160652:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.160658:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae8394 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.160668:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae8394 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.160691:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a3510289a00) 00010000:00010000:1.0:1763343039.160695:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.160701:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae8394 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.160709:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae8394 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00080000:0.0:1763343039.161504:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 985 committed 00000004:00080000:0.0:1763343039.161527:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 984 committed 00000004:00080000:0.0:1763343039.161530:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 985 committed 00000100:00100000:2.0:1763343039.161753:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010299136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343039.161859:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343039.161908:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763343039.161915:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010299008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343039.161939:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343039.161980:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010299136 00000100:00100000:2.0:1763343039.161990:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010299136 00000100:00100000:2.0:1763343039.162045:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010299008 00000100:00100000:2.0:1763343039.162048:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010299008 00000100:00100000:2.0:1763343039.162074:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6748 00000100:00100000:2.0:1763343039.162083:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3658:x1848998010299136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343039.162677:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a350121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010299392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343039.162720:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343039.162750:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343039.162756:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3501218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010299264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343039.162778:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343039.162808:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010299392 00000100:00100000:1.0:1763343039.162812:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010299392 00000100:00100000:1.0:1763343039.162841:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010299264 00000100:00100000:1.0:1763343039.162844:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010299264 00000100:00100000:1.0:1763343039.162878:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6749 00000100:00100000:1.0:1763343039.162887:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3658:x1848998010299008:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763343039.163688:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae83a9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f5:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bcb expref: 259 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.163706:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a3510289a00) 00010000:00010000:0.0:1763343039.163709:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343039.163731:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae83a2 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bcb expref: 259 pid: 6525 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343039.163755:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae83a9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bcb expref: 258 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.163789:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a3510289a00) 00010000:00010000:0.0:1763343039.163793:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343039.163796:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d4e00, rc 0) 00000100:00100000:0.0:1763343039.163887:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:55941:x1848997993661056:12345-192.168.204.21@tcp:101:bash.0 Request processed in 6749us (7144us total) trans 8589940204 rc 0/0 00000100:00100000:0.0:1763343039.163897:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9573 00000100:00100000:0.0:1763343039.163969:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6750 00000100:00100000:0.0:1763343039.163981:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3660:x1848998010299392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343039.164165:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3660:x1848998010299392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (1443us total) trans 17179871694 rc 0/0 00000100:00100000:0.0:1763343039.164173:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6750 00000100:00100000:0.0:1763343039.164189:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6751 00000100:00100000:0.0:1763343039.164197:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3660:x1848998010299264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343039.164286:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3660:x1848998010299264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (1506us total) trans 17179871695 rc 0/0 00000100:00100000:0.0:1763343039.164293:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6751 00000004:00080000:0.0:1763343039.164524:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3501218000/2, rc 0, transno 17179871695 00000100:00100000:0.0:1763343039.164532:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3501218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010299264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343039.164543:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a350121b100/2, rc 0, transno 17179871694 00000100:00100000:0.0:1763343039.164546:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a350121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010299392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343039.166088:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3658:x1848998010299136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3993us (4225us total) trans 21474838991 rc 0/0 00000100:00100000:2.0:1763343039.166105:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6748 00000004:00080000:3.0:1763343039.166243:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f3b100/2, rc 0, transno 21474838991 00000100:00100000:3.0:1763343039.166253:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010299136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343039.166354:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3658:x1848998010299008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3466us (4412us total) trans 21474838992 rc 0/0 00000100:00100000:1.0:1763343039.166362:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6749 00000004:00080000:3.0:1763343039.166583:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f38000/2, rc 0, transno 21474838992 00000100:00100000:3.0:1763343039.166588:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010299008:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.169909:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.170441:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993661184 00000100:00100000:1.0:1763343039.170457:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993661184 00000100:00100000:1.0:1763343039.172471:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6752 00000100:00100000:1.0:1763343039.172490:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:55941:x1848997993661184:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343039.172515:0:10294:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.172545:0:10294:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae83b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9bd2 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343039.172576:0:10294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343039.172603:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.172606:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.172617:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae83b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd2 expref: 27 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.172651:0:10294:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae83b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd2 expref: 27 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.172672:0:10294:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3fa00, rc 0) 00000100:00100000:1.0:1763343039.172744:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:55941:x1848997993661184:12345-192.168.204.21@tcp:101:bash.0 Request processed in 259us (2851us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343039.172752:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6752 00000100:00100000:2.0:1763343039.172974:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00080000:0.0:1763343039.173069:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763343039.173142:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993661312 00000100:00100000:3.0:1763343039.173152:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993661312 00000100:00100000:3.0:1763343039.173196:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6753 00000100:00100000:3.0:1763343039.173204:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2431:x1848997993661312:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:3.0:1763343039.173803:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2431:x1848997993661312:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 596us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.173811:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6753 00000100:00100000:3.0:1763343039.177833:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.178327:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993661440 00000100:00100000:1.0:1763343039.178342:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993661440 00000100:00100000:1.0:1763343039.178412:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6754 00000100:00100000:1.0:1763343039.178423:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993661440:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343039.178447:0:10294:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.178476:0:10294:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae83b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9bd9 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343039.178504:0:10294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343039.178531:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.178534:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.178544:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae83b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd9 expref: 18 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.178560:0:10294:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae83b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd9 expref: 18 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.178573:0:10294:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3f000, rc 0) 00000100:00100000:1.0:1763343039.178678:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:55941:x1848997993661440:12345-192.168.204.21@tcp:101:bash.0 Request processed in 256us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343039.178685:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6754 00000100:00100000:1.0:1763343039.180410:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.181221:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993661568 00000100:00100000:3.0:1763343039.181235:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993661568 00000100:00100000:3.0:1763343039.181304:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6755 00000100:00100000:3.0:1763343039.181314:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993661568:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:3.0:1763343039.181459:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993661568:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 145us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.181466:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6755 00000100:00100000:2.0:1763343039.181780:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.181887:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.181911:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993661696 00000100:00100000:2.0:1763343039.181916:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993661696 00002000:00010000:2.0:1763343039.181939:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/703 (0->18446744073709551615) 00002000:00100000:2.0:1763343039.181944:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406ab2300 with x1848997993661696 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343039.181958:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406ab2300. 00000100:00100000:2.0:1763343039.181974:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993661824 00000100:00100000:2.0:1763343039.181977:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993661824 00002000:00010000:2.0:1763343039.181985:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/705 (0->18446744073709551615) 00002000:00100000:2.0:1763343039.181988:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406ab3b80 with x1848997993661824 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343039.181994:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3406ab3b80. 00000100:00100000:2.0:1763343039.182007:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1638 00000100:00100000:2.0:1763343039.182013:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2429:x1848997993661696:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343039.182211:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2bf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343039.182215:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2bf:0x0] updating lvb mtime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343039.182218:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2bf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343039.182220:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2bf:0x0] updating lvb ctime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343039.182223:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2bf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343039.182253:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2429:x1848997993661696:12345-192.168.204.21@tcp:10:bash.0 Request processed in 240us (475us total) trans 21474838993 rc 0/0 00000100:00100000:2.0:1763343039.182259:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1638 00002000:00010000:2.0:1763343039.182276:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/703 (0->18446744073709551615) 00002000:00100000:2.0:1763343039.182279:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406ab2300 with x1848997993661696 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343039.182283:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406ab2300. 00000100:00100000:2.0:1763343039.182298:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1639 00000100:00100000:2.0:1763343039.182304:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993661824:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343039.182385:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2c1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343039.182388:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2c1:0x0] updating lvb mtime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343039.182390:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343039.182392:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2c1:0x0] updating lvb ctime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343039.182395:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2c1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343039.182413:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993661824:12345-192.168.204.21@tcp:10:bash.0 Request processed in 109us (526us total) trans 17179871696 rc 0/0 00000100:00100000:2.0:1763343039.182418:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1639 00002000:00010000:2.0:1763343039.182421:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/705 (0->18446744073709551615) 00002000:00100000:2.0:1763343039.182424:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406ab3b80 with x1848997993661824 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343039.182427:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3406ab3b80. 00000100:00100000:2.0:1763343039.188170:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.188871:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.189239:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993662208 00000100:00100000:3.0:1763343039.189255:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993662208 00000100:00100000:1.0:1763343039.189421:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993662080 00000100:00100000:1.0:1763343039.189427:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993662080 00000100:00100000:1.0:1763343039.189507:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3266 00000100:00100000:1.0:1763343039.189519:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:55941:x1848997993662080:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:1.0:1763343039.189961:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:55941:x1848997993662080:12345-192.168.204.21@tcp:35:bash.0 Request processed in 442us (1804us total) trans 8589940205 rc 0/0 00000100:00100000:1.0:1763343039.189970:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3266 00000100:00100000:3.0:1763343039.190261:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1640 00000100:00100000:3.0:1763343039.190270:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993662208:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:3.0:1763343039.190310:0:28425:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae83be lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.190329:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.190331:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.190339:0:28425:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae83be lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.190355:0:28425:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae83be lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.190483:0:28425:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae83be lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.190493:0:28425:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae83be lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.190501:0:28425:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae83be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.190508:0:28425:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343039.190513:0:28425:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae83be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.190521:0:28425:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae83be lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.190539:0:28425:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae83be lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.190546:0:28425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3501480a00/0x607405d401ae83be lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.190582:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993662208:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 314us (1715us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763343039.190589:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1640 00000100:00100000:2.0:1763343039.195407:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.195506:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993662336 00000100:00100000:0.0:1763343039.195521:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993662336 00000100:00100000:0.0:1763343039.195602:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9574 00000100:00100000:0.0:1763343039.195614:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56924:x1848997993662336:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343039.195688:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.195717:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae83c5 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9be0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.195762:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae83cc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.195780:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae83cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.195794:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae83cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.196405:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae83c5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9be0 expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.196430:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4c00/0x607405d401ae83cc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9be0 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.196440:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343039.196444:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343039.196448:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d4c00, rc 0) 00000100:00100000:0.0:1763343039.196544:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56924:x1848997993662336:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 932us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.196553:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9574 00000100:00100000:1.0:1763343039.201095:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.201678:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993662464 00000100:00100000:2.0:1763343039.201693:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993662464 00000100:00100000:2.0:1763343039.201978:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1641 00000100:00100000:2.0:1763343039.201990:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2429:x1848997993662464:12345-192.168.204.21@tcp:4:lfs.0 00002000:00010000:2.0:1763343039.202053:0:28424:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343039.202063:0:28424:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae83d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.202082:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.202084:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.202091:0:28424:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae83d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.202107:0:28424:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae83d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1763343039.206347:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838994 is committed 00000001:00080000:3.0:1763343039.206372:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838992 is committed 00002000:00010000:2.0:1763343039.206840:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2be:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:2.0:1763343039.206855:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2be:0x0] updating lvb mtime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343039.206859:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2be:0x0] updating lvb ctime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343039.206861:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2be:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1763343039.206879:0:28424:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae83d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.206892:0:28424:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae83d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.206901:0:28424:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae83d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.206909:0:28424:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343039.206914:0:28424:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae83d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.206923:0:28424:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae83d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.206946:0:28424:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae83d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.206953:0:28424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae83d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343039.207082:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2429:x1848997993662464:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 5086us (5996us total) trans 21474838994 rc 0/0 00000100:00100000:2.0:1763343039.207094:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1641 00000100:00100000:2.0:1763343039.210328:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.210465:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993662592 00000100:00100000:0.0:1763343039.210478:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993662592 00000100:00100000:0.0:1763343039.210550:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9575 00000100:00100000:0.0:1763343039.210561:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56927:x1848997993662592:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:0.0:1763343039.210585:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.210613:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae83da lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9be7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.210970:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae83e1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.210987:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae83e1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211001:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae83e1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211016:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae83e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211024:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae83e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211030:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae83e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211155:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae83ef lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211165:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae83ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211172:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae83ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343039.211223:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f5:0x0]: returning size 5 00000004:00200000:0.0:1763343039.211228:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343039.211254:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae83ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211282:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae83ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211293:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae83e1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211300:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae83e1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211306:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae83e1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211314:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae83e1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211320:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.211325:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae83e1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211334:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae83e1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211348:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4600) 00010000:00010000:0.0:1763343039.211352:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.211358:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae83e1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211365:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae83e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211379:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae83e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211386:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae83e8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211392:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae83e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211399:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.211401:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae83e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211407:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae83e8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211414:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4900) 00010000:00010000:0.0:1763343039.211416:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.211419:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae83e8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211424:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae83e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.211461:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae83da lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9be7 expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.211477:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae83ef lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9be7 expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.211484:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a3510289a00) 00010000:00010000:0.0:1763343039.211487:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343039.211491:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:0.0:1763343039.211579:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56927:x1848997993662592:12345-192.168.204.21@tcp:101:rm.0 Request processed in 1018us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.211588:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9575 00000100:00100000:0.0:1763343039.217519:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.217652:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993662848 00000100:00100000:2.0:1763343039.217667:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993662848 00000100:00100000:2.0:1763343039.217736:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9576 00000100:00100000:2.0:1763343039.217746:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56927:x1848997993662848:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:2.0:1763343039.217818:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343039.217865:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4e00/0x607405d401ae83a9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bcb expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.217891:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae83ef lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9be7 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.217903:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae838d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bbd expref: 259 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.217914:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a3510289a00) 00010000:00010000:2.0:1763343039.217928:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343039.217961:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae83f6 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.217976:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae83f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.217988:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae83f6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218001:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae83fd lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218006:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae83fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218012:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae83fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218123:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8404 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218131:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8404 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218137:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8404 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000040:00080000:2.0:1763343039.218459:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1496, 64 off126040 00000040:00080000:2.0:1763343039.218487:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1497, 64 off126040 00000040:00080000:2.0:1763343039.218497:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1498, 64 off126104 00000040:00080000:2.0:1763343039.218506:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1497, 64 off126104 00010000:00010000:2.0:1763343039.218569:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae840b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218579:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae840b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218587:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae840b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218597:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae840b lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218603:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae840b lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218610:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae840b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218673:0:6523:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343039.218699:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8404 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218705:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8404 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218711:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8404 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218717:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.218722:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8404 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218730:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8404 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218739:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:2.0:1763343039.218742:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343039.218746:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8404 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218752:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8404 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218904:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae83f6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218911:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae83f6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218916:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae83f6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218921:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae83f6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218925:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.218928:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae83f6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218933:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae83f6 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218940:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421e00) 00010000:00010000:2.0:1763343039.218942:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.218945:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae83f6 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218950:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae83f6 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:2.0:1763343039.218961:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b4f12878 reply state 0000000064d78ff6 transno 8589940206 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae83fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218972:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae83fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.218977:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:2.0:1763343039.218980:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343039.218983:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343039.219084:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56927:x1848997993662848:12345-192.168.204.21@tcp:36:rm.0 Request processed in 1335us (1579us total) trans 8589940206 rc 0/0 00000100:00100000:2.0:1763343039.219092:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9576 00010000:00010000:3.0:1763343039.220382:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343039.220396:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae840b lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1f5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343039.220413:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343039.220417:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae840b lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1f5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343039.220426:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae840b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343039.220446:0:13198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f5:0x0].0x0 (ffff9a3404421c00) 00010000:00010000:3.0:1763343039.220449:0:13198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343039.220453:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae840b lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1f5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343039.220460:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae840b lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343039.220484:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343039.220487:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343039.220489:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343039.233425:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.234402:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.235413:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993662976 00000100:00100000:0.0:1763343039.235429:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993662976 00000100:00100000:0.0:1763343039.235671:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993663232 00000100:00100000:0.0:1763343039.235675:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993663232 00000100:00100000:1.0:1763343039.235739:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9577 00000100:00100000:1.0:1763343039.235751:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56928:x1848997993662976:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343039.235779:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.235810:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae8412 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9bee expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.235906:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8419 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.235924:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8419 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.235939:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8419 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.235950:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8420 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.235958:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8420 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.235966:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8420 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236019:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8419 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236025:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8419 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236032:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8419 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236038:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8419 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236044:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3f800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.236048:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8419 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236056:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8419 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236068:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873bf00) 00010000:00010000:1.0:1763343039.236072:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.236076:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8419 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236081:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3f800/0x607405d401ae8419 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236096:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8420 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236101:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8420 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236108:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8420 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236113:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340ad3e800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.236116:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8420 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236121:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8420 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236126:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:1.0:1763343039.236129:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.236131:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8420 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236137:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e800/0x607405d401ae8420 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.236162:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae8412 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bee expref: 262 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.236172:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873bf00) 00010000:00010000:1.0:1763343039.236174:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.236177:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3ea00/0x607405d401ae8412 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bee expref: 262 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.236190:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340ad3ea00, rc 0) 00000100:00100000:2.0:1763343039.236603:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9578 00000100:00100000:2.0:1763343039.236616:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56924:x1848997993663232:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:2.0:1763343039.236665:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343039.236681:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3e200/0x607405d401ae8355 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ba8 expref: 261 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.236692:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:2.0:1763343039.236696:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343039.236759:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8427 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.236769:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8427 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.236777:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8427 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00010000:2.0:1763343039.236917:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000061b57c8b reply state 00000000b68e5fe2 transno 8589940207 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8427 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.236931:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8427 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.236937:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:2.0:1763343039.236939:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343039.236942:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343039.238224:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56924:x1848997993663232:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 1602us (3817us total) trans 8589940207 rc 0/0 00000100:00100000:2.0:1763343039.238236:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9578 00000100:00100000:1.0:1763343039.238342:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56928:x1848997993662976:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2593us (4932us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343039.238348:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9577 00000100:00100000:1.0:1763343039.243888:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.243930:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.243995:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993663488 00000100:00100000:2.0:1763343039.244009:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993663488 00000100:00100000:2.0:1763343039.244080:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9579 00000100:00100000:2.0:1763343039.244091:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56928:x1848997993663488:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343039.244125:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.244156:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae842e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9bfc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.244242:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8435 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244260:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8435 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244284:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8435 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244295:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae843c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244303:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae843c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244308:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae843c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244367:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8435 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244375:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8435 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244382:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8435 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244388:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8435 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244394:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.244399:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8435 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244407:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8435 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244421:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421e00) 00010000:00010000:2.0:1763343039.244425:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.244430:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8435 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244436:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8435 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244452:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae843c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244458:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae843c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244463:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae843c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244469:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.244472:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae843c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244482:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae843c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244488:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:2.0:1763343039.244491:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.244494:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae843c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244499:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae843c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.244530:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae842e lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bfc expref: 262 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.244541:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404421e00) 00010000:00010000:2.0:1763343039.244543:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.244547:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae842e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bfc expref: 262 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.244561:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c800, rc 0) 00000100:00100000:2.0:1763343039.244666:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56928:x1848997993663488:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 575us (733us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343039.244673:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9579 00000100:00100000:0.0:1763343039.244979:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993663360 00000100:00100000:0.0:1763343039.244986:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993663360 00000100:00100000:0.0:1763343039.245036:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6756 00000100:00100000:0.0:1763343039.245044:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:56924:x1848997993663360:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343039.245055:0:10294:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.245072:0:10294:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8443 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9bf5 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343039.245095:0:10294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2be:0x0] initial LVB size: 4096, mtime: 0x691a7abf, atime: 0x0, ctime: 0x691a7abf, blocks: 0x8 00010000:00010000:0.0:1763343039.245114:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.245117:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.245125:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8443 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bf5 expref: 12 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.245138:0:10294:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8443 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bf5 expref: 12 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.245148:0:10294:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:0.0:1763343039.245174:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:56924:x1848997993663360:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 131us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.245180:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6756 00000100:00100000:3.0:1763343039.252881:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.253012:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.253158:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993663616 00000100:00100000:2.0:1763343039.253172:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993663616 00000100:00100000:2.0:1763343039.253247:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6757 00000100:00100000:2.0:1763343039.253258:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:56924:x1848997993663616:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343039.253296:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.253326:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae844a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c03 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343039.253360:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343039.253390:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.253393:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.253403:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae844a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c03 expref: 20 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.253421:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae844a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c03 expref: 20 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.253437:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c800, rc 0) 00000100:00100000:2.0:1763343039.253509:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:56924:x1848997993663616:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 253us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.253516:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6757 00000100:00100000:0.0:1763343039.255838:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993663744 00000100:00100000:0.0:1763343039.255888:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993663744 00000100:00100000:0.0:1763343039.256004:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9580 00000100:00100000:0.0:1763343039.256017:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56928:x1848997993663744:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343039.256048:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.256080:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8451 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c0a expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.256167:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8458 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.256185:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8458 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.256200:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8458 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343039.256261:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343039.256283:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343039.256329:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8451 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c0a expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.256352:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8458 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c0a expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.256362:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4100) 00010000:00010000:0.0:1763343039.256366:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343039.256370:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:0.0:1763343039.256448:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56928:x1848997993663744:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 433us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.256456:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9580 00000100:00100000:1.0:1763343039.265241:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.266677:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.266836:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993663872 00000100:00100000:2.0:1763343039.266861:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993663872 00002000:00010000:2.0:1763343039.266926:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/702 (5->18446744073709551615) 00002000:00100000:2.0:1763343039.266932:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060adf80 with x1848997993663872 ext(5->18446744073709551615) 00002000:00010000:2.0:1763343039.266949:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34060adf80. 00000100:00100000:2.0:1763343039.266976:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993664000 00000100:00100000:2.0:1763343039.266980:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993664000 00002000:00010000:2.0:1763343039.266993:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/704 (0->18446744073709551615) 00002000:00100000:2.0:1763343039.266996:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060af480 with x1848997993664000 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343039.267003:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34060af480. 00000100:00100000:2.0:1763343039.267037:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1642 00000100:00100000:2.0:1763343039.267048:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993663872:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:2.0:1763343039.267509:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2be:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:2.0:1763343039.267515:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2be:0x0] updating lvb mtime from disk: 1763343039 -> 1763343039 00002000:00010000:2.0:1763343039.267517:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2be:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343039.267520:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2be:0x0] updating lvb ctime from disk: 1763343039 -> 1763343039 00002000:00010000:2.0:1763343039.267523:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2be:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343039.267612:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993663872:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 563us (2384us total) trans 21474838995 rc 0/0 00000100:00100000:2.0:1763343039.267672:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1642 00002000:00010000:2.0:1763343039.267678:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/702 (5->18446744073709551615) 00002000:00100000:2.0:1763343039.267682:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060adf80 with x1848997993663872 ext(5->18446744073709551615) 00002000:00010000:2.0:1763343039.267688:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34060adf80. 00000100:00100000:2.0:1763343039.267711:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1643 00000100:00100000:2.0:1763343039.267719:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993664000:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:2.0:1763343039.267870:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2c0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343039.267873:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2c0:0x0] updating lvb mtime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343039.267875:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2c0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343039.267877:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2c0:0x0] updating lvb ctime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343039.267879:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2c0:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343039.267910:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993664000:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 192us (2613us total) trans 17179871697 rc 0/0 00000100:00100000:2.0:1763343039.267916:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1643 00002000:00010000:2.0:1763343039.267919:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/704 (0->18446744073709551615) 00002000:00100000:2.0:1763343039.267922:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060af480 with x1848997993664000 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343039.267926:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34060af480. 00000100:00100000:1.0:1763343039.268996:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.269171:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993664128 00000100:00100000:0.0:1763343039.269183:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993664128 00000100:00100000:0.0:1763343039.269252:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9581 00000100:00100000:0.0:1763343039.269264:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56928:x1848997993664128:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343039.269290:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.269318:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae845f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c11 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.269409:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8466 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269428:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8466 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269443:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8466 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269455:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae846d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269462:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae846d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269468:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae846d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269525:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8466 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269533:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8466 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269539:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8466 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269546:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8466 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269556:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.269562:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8466 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269570:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8466 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269583:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4100) 00010000:00010000:0.0:1763343039.269587:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.269592:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8466 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269598:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8466 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269615:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae846d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269685:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae846d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269692:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae846d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269697:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.269700:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae846d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269706:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae846d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269713:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:0.0:1763343039.269716:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.269719:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae846d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269724:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae846d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.269756:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae845f lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c11 expref: 263 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.269767:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4100) 00010000:00010000:0.0:1763343039.269770:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.269774:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae845f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c11 expref: 263 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.269784:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:0.0:1763343039.269842:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56928:x1848997993664128:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 579us (855us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343039.269861:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9581 00000100:00100000:1.0:1763343039.281896:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.282268:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993664384 00000100:00100000:0.0:1763343039.282284:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993664384 00000100:00100000:0.0:1763343039.282367:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9582 00000100:00100000:0.0:1763343039.282379:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56924:x1848997993664384:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343039.282498:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8474 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.282535:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8474 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.282551:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8474 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00010000:0.0:1763343039.282767:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007105d55f reply state 000000009d8b765f transno 8589940208 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8474 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.282782:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8474 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343039.282791:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343039.282794:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343039.282799:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343039.282923:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56924:x1848997993664384:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 546us (1045us total) trans 8589940208 rc 0/0 00000100:00100000:0.0:1763343039.282931:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9582 00000100:00100000:1.0:1763343039.283137:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.283739:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993664640 00000100:00100000:3.0:1763343039.283750:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993664640 00000100:00100000:3.0:1763343039.283807:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9583 00000100:00100000:3.0:1763343039.283817:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56928:x1848997993664640:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.283834:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.283837:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343039.283874:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8458 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c0a expref: 264 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.283896:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4100) 00010000:00010000:3.0:1763343039.283907:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343039.283923:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae847b lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c18 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.284052:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8482 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284064:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8482 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284073:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8482 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284084:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae8489 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284092:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae8489 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284098:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae8489 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284592:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae8490 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284603:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae8490 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284611:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae8490 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343039.284691:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f7:0x0]: returning size 0 00010000:00010000:3.0:1763343039.284724:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8482 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284736:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8482 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284743:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8482 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284749:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.284753:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8482 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284761:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8482 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284769:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873ac00) 00010000:00010000:3.0:1763343039.284772:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.284776:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8482 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284783:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8482 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:3.0:1763343039.284793:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000017567cec reply state 000000004fb41e9c transno 8589940209 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae8489 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284803:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae8489 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.284808:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:3.0:1763343039.284811:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343039.284814:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343039.284844:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae847b lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c18 expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.284875:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae8490 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c18 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.284882:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a353873a100) 00010000:00010000:3.0:1763343039.284885:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343039.284887:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343039.284954:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56928:x1848997993664640:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1139us (1818us total) trans 8589940209 rc 0/0 00000100:00100000:3.0:1763343039.284962:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9583 00000100:00100000:1.0:1763343039.289799:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.290215:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.290400:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993664896 00000100:00100000:0.0:1763343039.290414:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993664896 00000100:00100000:0.0:1763343039.290493:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9584 00000100:00100000:0.0:1763343039.290505:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56928:x1848997993664896:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343039.290539:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.290566:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae849e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c1f expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.290733:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84a5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.290753:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae8490 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c18 expref: 267 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.290762:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84a5 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.290803:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae8490 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c18 expref: 267 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.290819:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae8490 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c18 expref: 267 pid: 28422 timeout: 1332 lvb_type: 0 00000100:00100000:0.0:1763343039.290835:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010299520:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343039.290948:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f316c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343039.295478:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.295585:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010299520:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343039.295647:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84a5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:2.0:1763343039.295834:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993665024 00000100:00100000:2.0:1763343039.295855:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993665024 00000100:00100000:2.0:1763343039.295937:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6758 00000100:00100000:2.0:1763343039.295947:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:56924:x1848997993665024:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343039.295969:0:10294:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.295993:0:10294:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae84ac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c26 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.296030:0:10294:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae835c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9baf expref: 22 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343039.296039:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.296042:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.296047:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae84ac lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c26 expref: 22 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.296086:0:10294:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae835c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9baf expref: 22 pid: 8410 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343039.296097:0:10294:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae835c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9baf expref: 22 pid: 8410 timeout: 1332 lvb_type: 1 00000100:00100000:2.0:1763343039.296113:0:10294:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406ab2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10294:1848998010299648:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343039.296224:0:10294:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a353c6bc840 going to sleep for 11 seconds 00000100:00100000:3.0:1763343039.296597:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993665152 00000100:00100000:3.0:1763343039.296604:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993665152 00010000:00010000:3.0:1763343039.296665:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae8490 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c18 expref: 268 pid: 28422 timeout: 1332 lvb_type: 0 00000100:00100000:3.0:1763343039.296692:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3158 00000100:00100000:3.0:1763343039.296700:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:2430:x1848997993665152:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343039.296714:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343039.296721:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae8490 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c18 expref: 268 pid: 28422 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343039.296734:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae8490 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c18 expref: 268 pid: 28422 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343039.296759:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92000/0x607405d401ae8490 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c18 expref: 268 pid: 28422 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343039.296781:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a353873a100) 00010000:00010000:3.0:1763343039.296787:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84a5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.296796:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84a5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.296803:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84a5 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.296825:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343039.296873:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:2430:x1848997993665152:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 173us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.296881:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3158 00010000:00010000:0.0:1763343039.296971:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84a5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.296980:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84a5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343039.297016:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f7:0x0]: returning size 0 00000004:00080000:0.0:1763343039.297266:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2c3:0x0], index 1: 0 00000004:00080000:0.0:1763343039.298875:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2c1:0x0], index 0: 0 00000004:00080000:0.0:1763343039.298894:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2c2:0x0], index 0: 0 00000004:00080000:0.0:1763343039.298900:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2c4:0x0], index 1: 0 00010000:00010000:0.0:1763343039.299107:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84a5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.299119:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84a5 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.299127:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84a5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.299139:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.299145:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84a5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.299154:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84a5 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.299176:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a353873a100) 00010000:00010000:0.0:1763343039.299181:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343039.299187:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84a5 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.299193:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84a5 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.299271:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae849e lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c1f expref: 267 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.299292:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a353873a100) 00010000:00010000:0.0:1763343039.299307:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343039.299311:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae849e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c1f expref: 267 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.299328:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:0.0:1763343039.299415:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56928:x1848997993664896:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8910us (9629us total) trans 8589940210 rc 301/301 00000100:00100000:0.0:1763343039.299426:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9584 00000100:00100000:1.0:1763343039.307273:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.307381:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.307436:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993665536 00000100:00100000:0.0:1763343039.307448:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993665536 00000100:00100000:0.0:1763343039.307525:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3267 00000100:00100000:0.0:1763343039.307537:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56928:x1848997993665536:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343039.307943:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993665280 00000100:00100000:3.0:1763343039.307949:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993665280 00000100:00100000:0.0:1763343039.307967:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56928:x1848997993665536:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 432us (585us total) trans 8589940211 rc 0/0 00000100:00100000:0.0:1763343039.307975:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3267 00010000:00010000:3.0:1763343039.307978:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae835c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9baf expref: 23 pid: 8410 timeout: 1332 lvb_type: 1 00000100:00100000:3.0:1763343039.308015:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3159 00000100:00100000:3.0:1763343039.308023:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2429:x1848997993665280:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343039.308038:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343039.308066:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae835c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9baf expref: 23 pid: 8410 timeout: 1332 lvb_type: 1 00000100:00100000:2.0:1763343039.308067:0:10294:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406ab2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10294:1848998010299648:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343039.308081:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae835c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9baf expref: 23 pid: 8410 timeout: 1332 lvb_type: 1 00010000:00010000:3.0:1763343039.308123:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3501480e00/0x607405d401ae835c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9baf expref: 23 pid: 8410 timeout: 1332 lvb_type: 1 00010000:00010000:2.0:1763343039.309861:0:10294:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae84ac lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c26 expref: 22 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.309898:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.309901:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.309913:0:10294:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae84ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c26 expref: 22 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.309926:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae84ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c26 expref: 22 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.309991:0:10294:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae84ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c26 expref: 22 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343039.310011:0:10294:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406ab2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10294:1848998010299776:192.168.204.21@tcp:105: 00000100:00100000:2.0:1763343039.310139:0:10294:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a353c6bc840 going to sleep for 11 seconds 00010000:00010000:3.0:1763343039.311589:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343039.311717:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993665280:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 3684us (4450us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.311733:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3159 00000100:00100000:1.0:1763343039.311946:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.311995:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993665792 00000100:00100000:0.0:1763343039.312007:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993665792 00000100:00100000:0.0:1763343039.312071:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3268 00000100:00100000:0.0:1763343039.312082:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56928:x1848997993665792:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343039.312831:0:10294:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406ab2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10294:1848998010299776:192.168.204.21@tcp:105: 00010000:00010000:2.0:1763343039.312868:0:10294:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352dc00, rc 0) 00000100:00100000:2.0:1763343039.312914:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:56924:x1848997993665024:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 16966us (22699us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.312925:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6758 00000100:00100000:0.0:1763343039.313982:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56928:x1848997993665792:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1892us (2027us total) trans 8589940212 rc 0/0 00000100:00100000:0.0:1763343039.313995:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3268 00000100:00100000:2.0:1763343039.317505:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.318741:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993665920 00000100:00100000:0.0:1763343039.318760:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993665920 00000100:00100000:0.0:1763343039.318842:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6759 00000100:00100000:0.0:1763343039.318859:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993665920:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:0.0:1763343039.319062:0:10294:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763343039.319066:0:10294:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb mtime from disk: 1763343038 -> 1763343038 00002000:00010000:0.0:1763343039.319069:0:10294:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb atime from disk: 0 -> 1763343038 00002000:00010000:0.0:1763343039.319071:0:10294:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb ctime from disk: 1763343038 -> 1763343039 00002000:00010000:0.0:1763343039.319073:0:10294:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343039.319163:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993665920:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 303us (1672us total) trans 17179871698 rc 0/0 00000100:00100000:0.0:1763343039.319171:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6759 00000100:00100000:1.0:1763343039.321568:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.321966:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993666176 00000100:00100000:0.0:1763343039.321980:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993666176 00000100:00100000:0.0:1763343039.322064:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9585 00000100:00100000:0.0:1763343039.322077:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:55941:x1848997993666176:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343039.322115:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.322232:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae84ba lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c2d expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343039.322252:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.322308:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993666432 00000100:00100000:2.0:1763343039.322314:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993666432 00000100:00100000:2.0:1763343039.322357:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3269 00000100:00100000:2.0:1763343039.322365:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56924:x1848997993666432:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:2.0:1763343039.322428:0:6527:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1f4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae82a6 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b70 expref: 270 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.322487:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343039.322506:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8340 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ba1 expref: 270 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.322516:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343039.322571:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8340 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ba1 expref: 270 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.322586:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8340 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ba1 expref: 270 pid: 10041 timeout: 1332 lvb_type: 0 00000100:00100000:2.0:1763343039.322601:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406ab0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010299904:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343039.322659:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84c8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.322670:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84c8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.322682:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84c8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.322692:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae84cf lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.322699:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae84cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.322705:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae84cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:2.0:1763343039.322718:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a353c6bc840 going to sleep for 11 seconds 00010000:00010000:0.0:1763343039.322773:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae84d6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.322780:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae84d6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.322787:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae84d6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343039.322801:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f7:0x0]: returning size 0 00010000:00010000:0.0:1763343039.322919:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84c8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.322926:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84c8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.322932:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84c8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.322938:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84c8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.322944:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.322949:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84c8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.322957:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84c8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.322969:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4d00) 00010000:00010000:0.0:1763343039.322972:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.322979:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84c8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.322984:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.322998:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae84cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.323004:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae84cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.323013:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae84cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.323018:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.323020:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae84cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.323026:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae84cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.323032:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:0.0:1763343039.323035:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.323037:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae84cf lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.323043:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae84cf lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.323084:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae84ba lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c2d expref: 272 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.323103:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae84d6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c2d expref: 271 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.323110:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343039.323112:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343039.323115:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00000100:00100000:0.0:1763343039.323173:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:55941:x1848997993666176:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1098us (1618us total) trans 8589940213 rc 0/0 00000100:00100000:0.0:1763343039.323182:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9585 00000100:00100000:2.0:1763343039.329243:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406ab0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010299904:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343039.329285:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00000100:00100000:2.0:1763343039.330661:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.330717:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.330827:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993666688 00000100:00100000:3.0:1763343039.330839:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993666688 00010000:00010000:3.0:1763343039.330902:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8340 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ba1 expref: 271 pid: 10041 timeout: 1332 lvb_type: 0 00000100:00100000:3.0:1763343039.330953:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3160 00000100:00100000:3.0:1763343039.330963:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35129b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:2430:x1848997993666688:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343039.330982:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343039.330991:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8340 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ba1 expref: 271 pid: 10041 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343039.331006:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8340 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ba1 expref: 271 pid: 10041 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343039.331044:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8340 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ba1 expref: 271 pid: 10041 timeout: 1332 lvb_type: 0 00010000:00010000:3.0:1763343039.331066:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00000100:00100000:0.0:1763343039.331070:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993666560 00010000:00010000:3.0:1763343039.331075:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00000100:00100000:0.0:1763343039.331075:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993666560 00010000:00010000:3.0:1763343039.331089:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343039.331098:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343039.331138:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343039.331203:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35129b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:2430:x1848997993666688:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 241us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.331211:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3160 00010000:00010000:2.0:1763343039.331435:0:6527:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343039.331445:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00000040:00080000:2.0:1763343039.331812:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1499, 88 off126192 00000004:00080000:2.0:1763343039.331822:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232999201057ns, next at 1233117841489ns, rc = 0 00000040:00080000:2.0:1763343039.331869:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1498, 88 off126192 00000004:00080000:2.0:1763343039.331875:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232999254093ns, next at 1233117877304ns, rc = 0 00000040:00080000:2.0:1763343039.331893:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1499, 88 off126280 00000004:00080000:2.0:1763343039.331898:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232999277036ns, next at 1233117877304ns, rc = 0 00000040:00080000:2.0:1763343039.331907:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1500, 88 off126280 00000004:00080000:2.0:1763343039.331911:0:6527:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232999290061ns, next at 1233117841489ns, rc = 0 00000100:00100000:0.0:1763343039.333222:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9586 00000100:00100000:0.0:1763343039.333237:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:55941:x1848997993666560:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343039.333278:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.333310:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae84e4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c34 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.333359:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae84eb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.333377:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae84eb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.333391:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae84eb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.333525:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae84e4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c34 expref: 273 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.333545:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae84eb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c34 expref: 272 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.333555:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343039.333559:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343039.333563:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:0.0:1763343039.333673:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:55941:x1848997993666560:12345-192.168.204.21@tcp:101:bash.0 Request processed in 438us (3064us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.333682:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9586 00000100:00100000:2.0:1763343039.340318:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.340545:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993666944 00000100:00100000:0.0:1763343039.340561:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993666944 00000100:00100000:0.0:1763343039.340671:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9587 00000100:00100000:0.0:1763343039.340684:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:55941:x1848997993666944:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343039.340764:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343039.340802:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae84d6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c2d expref: 272 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.340826:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343039.340833:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343039.341103:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84f2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.341120:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84f2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.341131:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84f2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000001:00080000:0.0:1763343039.341188:0:10041:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940215 00000004:00010000:0.0:1763343039.341212:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000f86ef4b reply state 00000000465498d4 transno 8589940216 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84f2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.341226:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.341232:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343039.341235:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343039.341237:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343039.341360:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:55941:x1848997993666944:12345-192.168.204.21@tcp:36:bash.0 Request processed in 677us (1058us total) trans 8589940216 rc 0/0 00000100:00100000:0.0:1763343039.341368:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9587 00000020:00080000:0.0:1763343039.341374:0:10041:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:0.0:1763343039.342457:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940214 is committed 00000004:00080000:0.0:1763343039.342471:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 987 committed 00000004:00080000:0.0:1763343039.342489:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 988 committed 00000100:00100000:3.0:1763343039.342674:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010300032:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1763343039.342783:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae83fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342794:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae83fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342801:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae83fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342808:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.342813:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae83fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342822:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae83fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342838:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:2.0:1763343039.342841:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.342854:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae83fd lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342865:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae83fd lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342886:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8427 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342892:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8427 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342897:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8427 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342902:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.342904:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8427 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342909:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8427 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342917:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:2.0:1763343039.342920:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.342923:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8427 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342928:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8427 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342938:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8474 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342944:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8474 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342949:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8474 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342954:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.342957:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8474 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342962:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8474 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342970:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:2.0:1763343039.342972:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.342975:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8474 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342980:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8474 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343039.342991:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae8489 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.342995:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae8489 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.343001:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae8489 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.343006:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501481200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.343008:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae8489 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.343014:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae8489 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.343021:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404421700) 00010000:00010000:2.0:1763343039.343024:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.343026:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae8489 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.343031:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae8489 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00080000:0.0:1763343039.343102:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 987 committed 00000100:00100000:3.0:1763343039.343277:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343039.343376:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010300032 00000100:00100000:1.0:1763343039.343387:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010300032 00000100:00100000:1.0:1763343039.343448:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6760 00000100:00100000:1.0:1763343039.343458:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3657:x1848998010300032:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343039.343462:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010300544:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343039.343492:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:705 count 1 00000100:00100000:3.0:1763343039.343495:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.343516:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1763343039.343523:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010300160:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763343039.343537:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae84f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.343545:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.343560:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010300672:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763343039.343560:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae83b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd9 expref: 21 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.343569:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343039.343572:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343039.343577:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae84f9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.343578:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.343602:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010300288:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1763343039.343606:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae83b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd9 expref: 21 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.343640:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae83b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd9 expref: 21 pid: 10294 timeout: 1333 lvb_type: 0 00000100:00100000:3.0:1763343039.343649:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343039.343653:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010301056:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343039.343666:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010300800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343039.343815:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010300544 00000100:00100000:2.0:1763343039.343821:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010300544 00000100:00100000:2.0:1763343039.343856:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010300160 00000100:00100000:2.0:1763343039.343859:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010300160 00000100:00100000:2.0:1763343039.343877:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010300672 00000100:00100000:2.0:1763343039.343880:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010300672 00000100:00100000:2.0:1763343039.343896:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010300288 00000100:00100000:2.0:1763343039.343899:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010300288 00000100:00100000:2.0:1763343039.343917:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6761 00000100:00100000:2.0:1763343039.343924:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3657:x1848998010300544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343039.343937:0:10294:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:703 count 1 00010000:00010000:2.0:1763343039.343955:0:10294:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8500 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.343968:0:10294:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae83b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd2 expref: 12 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.343974:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343039.343976:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343039.343978:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8500 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.343999:0:10294:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae83b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd2 expref: 12 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.344012:0:10294:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae83b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd2 expref: 12 pid: 10294 timeout: 1333 lvb_type: 0 00000100:00100000:2.0:1763343039.344023:0:10294:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10294:1848998010301184:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343039.344449:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b600 going to sleep for 11 seconds 00000004:00080000:0.0:1763343039.344784:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 986 committed 00000100:00100000:0.0:1763343039.344883:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6762 00000100:00100000:0.0:1763343039.344897:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3657:x1848998010300160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343039.344918:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:706 count 1 00002000:00010000:0.0:1763343039.344951:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343039.344958:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae8507 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.344967:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.344969:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.344975:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae8507 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.344991:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae8507 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.345002:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae8507 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.345010:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae8507 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.345030:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343039.346492:0:10294:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509bdff00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343039.346637:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.346692:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1763343039.346708:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010300416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343039.346717:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010300800 00000100:00100000:2.0:1763343039.346726:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010300800 00000100:00100000:3.0:1763343039.346743:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.346763:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010300928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343039.346768:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010300416 00000100:00100000:2.0:1763343039.346770:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010300416 00000100:00100000:3.0:1763343039.346784:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343039.346788:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010300928 00000100:00100000:2.0:1763343039.346790:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010300928 00000100:00100000:2.0:1763343039.346804:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6763 00000100:00100000:3.0:1763343039.346809:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6764 00000100:00100000:2.0:1763343039.346811:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3657:x1848998010300672:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.346817:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3659:x1848998010300288:12345-0@lo:2:osp-syn-1-0.0 00002000:00080000:2.0:1763343039.346841:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:704 count 1 00002000:00010000:2.0:1763343039.346893:0:15756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343039.346901:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae850e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.346914:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.346916:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.346921:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae850e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.346938:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae850e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.346947:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae850e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.346954:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae850e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.346974:0:15756:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1763343039.346987:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343039.346990:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb mtime from disk: 1763343038 -> 1763343038 00002000:00010000:3.0:1763343039.346993:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb atime from disk: 1763343038 -> 1763343038 00002000:00010000:3.0:1763343039.346995:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb ctime from disk: 1763343039 -> 1763343039 00002000:00010000:3.0:1763343039.346998:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2bf:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343039.347031:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3659:x1848998010300288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 214us (3380us total) trans 17179871700 rc 0/0 00000100:00100000:3.0:1763343039.347039:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6764 00000100:00100000:3.0:1763343039.347060:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6765 00000100:00100000:3.0:1763343039.347065:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3659:x1848998010300800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343039.347118:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2bd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343039.347121:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2bd:0x0] updating lvb mtime from disk: 1763343038 -> 1763343038 00002000:00010000:3.0:1763343039.347123:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2bd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343039.347125:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2bd:0x0] updating lvb ctime from disk: 1763343038 -> 1763343038 00002000:00010000:3.0:1763343039.347127:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2bd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343039.347150:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3659:x1848998010300800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (533us total) trans 21474838997 rc 0/0 00000100:00100000:2.0:1763343039.347150:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3657:x1848998010300672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 340us (3571us total) trans 21474838996 rc 0/0 00000100:00100000:3.0:1763343039.347157:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6765 00000100:00100000:2.0:1763343039.347160:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6763 00000100:00100000:3.0:1763343039.347169:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6766 00000100:00100000:3.0:1763343039.347174:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3659:x1848998010300416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343039.347178:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6767 00000100:00100000:2.0:1763343039.347183:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3659:x1848998010300928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343039.347224:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2c0:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343039.347224:0:15756:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2be:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763343039.347227:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2c0:0x0] updating lvb mtime from disk: 1763343039 -> 1763343039 00002000:00010000:2.0:1763343039.347227:0:15756:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2be:0x0] updating lvb mtime from disk: 1763343039 -> 1763343039 00002000:00010000:3.0:1763343039.347230:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2c0:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343039.347230:0:15756:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2be:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343039.347233:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2c0:0x0] updating lvb ctime from disk: 1763343039 -> 1763343039 00002000:00010000:2.0:1763343039.347233:0:15756:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2be:0x0] updating lvb ctime from disk: 1763343039 -> 1763343039 00002000:00010000:3.0:1763343039.347236:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2c0:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1763343039.347236:0:15756:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2be:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1763343039.347260:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3659:x1848998010300416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (515us total) trans 17179871701 rc 0/0 00000100:00100000:2.0:1763343039.347260:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3659:x1848998010300928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (474us total) trans 21474838998 rc 0/0 00000100:00100000:3.0:1763343039.347265:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6766 00000004:00080000:3.0:1763343039.347337:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d10d880/2, rc 0, transno 17179871701 00000100:00100000:3.0:1763343039.347344:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010300416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343039.347344:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3657:x1848998010300160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2451us (3796us total) trans 17179871699 rc 0/0 00000100:00100000:0.0:1763343039.347352:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6762 00000100:00100000:3.0:1763343039.347355:0:3659:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838992 gen 2 00000004:00080000:3.0:1763343039.347374:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34034f3800, transno 21474838936 00000004:00080000:3.0:1763343039.347378:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3503522a00, transno 21474838937 00000004:00080000:3.0:1763343039.347381:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3503523480, transno 21474838938 00000004:00080000:3.0:1763343039.347383:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34034f1180, transno 21474838939 00000004:00080000:3.0:1763343039.347386:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095ba300, transno 21474838940 00010000:00010000:0.0:1763343039.347387:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000004:00080000:3.0:1763343039.347389:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b9c00, transno 21474838941 00000004:00080000:3.0:1763343039.347393:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406550700, transno 21474838943 00010000:00010000:0.0:1763343039.347395:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae8507 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343039.347396:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406552680, transno 21474838944 00000004:00080000:3.0:1763343039.347399:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035ea300, transno 21474838945 00000004:00080000:3.0:1763343039.347402:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035e9f80, transno 21474838946 00000004:00080000:3.0:1763343039.347404:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035e9180, transno 21474838947 00010000:00010000:0.0:1763343039.347404:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc0d8ab40) 00000004:00080000:3.0:1763343039.347407:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035ead80, transno 21474838948 00010000:00010000:0.0:1763343039.347409:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae8507 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343039.347410:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a354134df80, transno 21474838951 00000004:00080000:3.0:1763343039.347413:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a354134c000, transno 21474838952 00000004:00080000:3.0:1763343039.347416:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478f800, transno 21474838953 00000004:00080000:3.0:1763343039.347419:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c3bce00, transno 21474838954 00010000:00010000:0.0:1763343039.347419:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae8507 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343039.347422:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478d500, transno 21474838958 00000004:00080000:3.0:1763343039.347425:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478d180, transno 21474838959 00000004:00080000:3.0:1763343039.347428:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478d880, transno 21474838960 00000004:00080000:3.0:1763343039.347431:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478c000, transno 21474838961 00000004:00080000:3.0:1763343039.347433:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537910700, transno 21474838962 00000004:00080000:3.0:1763343039.347436:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537913b80, transno 21474838963 00000004:00080000:3.0:1763343039.347438:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478e300, transno 21474838966 00010000:00010000:0.0:1763343039.347439:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae8507 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343039.347441:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478c700, transno 21474838967 00000004:00080000:3.0:1763343039.347444:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062f1500, transno 21474838968 00010000:00010000:0.0:1763343039.347446:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177400/0x607405d401ae8507 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343039.347447:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062f1880, transno 21474838969 00000004:00080000:3.0:1763343039.347450:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a6d80, transno 21474838970 00000004:00080000:3.0:1763343039.347453:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a7b80, transno 21474838971 00000004:00080000:3.0:1763343039.347456:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3409a4c000, transno 21474838975 00000004:00080000:3.0:1763343039.347459:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3409a4d180, transno 21474838976 00000004:00080000:3.0:1763343039.347462:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3409a4ce00, transno 21474838977 00010000:00010000:0.0:1763343039.347464:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:3.0:1763343039.347465:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d7b80, transno 21474838978 00010000:00010000:0.0:1763343039.347467:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae850e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343039.347468:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d4380, transno 21474838979 00000004:00080000:3.0:1763343039.347471:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3409a4d500, transno 21474838980 00000004:00080000:3.0:1763343039.347474:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052adc00, transno 21474838982 00010000:00010000:0.0:1763343039.347474:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc0d8ab40) 00000004:00080000:3.0:1763343039.347477:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052ad880, transno 21474838983 00010000:00010000:0.0:1763343039.347477:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae850e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343039.347481:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052ac000, transno 21474838984 00010000:00010000:0.0:1763343039.347483:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae850e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343039.347484:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3409a4ea00, transno 21474838985 00000004:00080000:3.0:1763343039.347486:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d1a5c00, transno 21474838986 00000004:00080000:3.0:1763343039.347489:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052af800, transno 21474838987 00000004:00080000:3.0:1763343039.347492:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d10dc00, transno 21474838989 00010000:00010000:0.0:1763343039.347492:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae850e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763343039.347494:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d10f800, transno 21474838990 00000004:00080000:3.0:1763343039.347497:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f3b100, transno 21474838991 00000004:00080000:3.0:1763343039.347499:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f38000, transno 21474838992 00010000:00010000:0.0:1763343039.347499:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae850e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.347505:0:3659:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a3537b0fb80 x1848998010300928/t21474838998(21474838998) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343055 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1763343039.347510:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343039.347511:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343039.347513:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343039.347514:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537b0fb80/2, rc 0, transno 21474838998 00000100:00100000:3.0:1763343039.347519:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010300928:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343039.347530:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d10f100/2, rc 0, transno 17179871700 00000100:00100000:3.0:1763343039.347534:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010300288:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343039.347542:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537b0f480/2, rc 0, transno 21474838997 00000100:00100000:3.0:1763343039.347545:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010300800:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.347699:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000004:00080000:0.0:1763343039.348472:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d10ea00/2, rc 0, transno 17179871699 00000100:00100000:0.0:1763343039.348482:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010300160:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1763343039.348493:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537b0ea00/2, rc 0, transno 21474838996 00000100:00100000:0.0:1763343039.348497:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010300672:0@lo:6:osp-syn-0-0.0 00000004:00010000:0.0:1763343039.348594:0:6527:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000466b4284 reply state 00000000eb0924e2 transno 8589940214 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343039.348617:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343039.348643:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343039.348648:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343039.348652:0:6527:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343039.348659:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343039.348662:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343039.348668:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340ad3fc00/0x607405d401ae82a6 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b70 expref: 259 pid: 10041 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1763343039.348772:0:6527:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343039.348792:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56924:x1848997993666432:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 26426us (26538us total) trans 8589940214 rc 0/0 00000100:00100000:0.0:1763343039.348802:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3269 00000100:00100000:0.0:1763343039.348835:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993667072 00000100:00100000:0.0:1763343039.348843:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993667072 00000100:00100000:0.0:1763343039.348907:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9588 00000100:00100000:0.0:1763343039.348914:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:55941:x1848997993667072:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343039.348934:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.348952:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8515 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c3b expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.349012:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8515 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c3b expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.349025:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8515 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c3b expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.349041:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343039.349044:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343039.349047:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:0.0:1763343039.349069:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:55941:x1848997993667072:12345-192.168.204.21@tcp:101:bash.0 Request processed in 156us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.349076:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9588 00000100:00100000:2.0:1763343039.349359:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6767 00010000:00010000:2.0:1763343039.349390:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343039.350375:0:32355:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 4 in progress, 2 in flight, 44 done 00010000:00010000:3.0:1763343039.351571:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343039.351592:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343039.351599:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343039.351605:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.351611:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343039.356311:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343039.356356:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:3.0:1763343039.356360:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343039.356370:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343039.356379:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae84c1 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00000100:00100000:2.0:1763343039.358138:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.358437:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010301056:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343039.358476:0:8408:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae84f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.359277:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993667200 00000100:00100000:3.0:1763343039.359293:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993667200 00010000:00010000:3.0:1763343039.359358:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae83b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd9 expref: 22 pid: 10294 timeout: 1333 lvb_type: 0 00000100:00100000:3.0:1763343039.359402:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3161 00000100:00100000:3.0:1763343039.359413:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993667200:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343039.359433:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343039.359439:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae83b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd9 expref: 22 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:3.0:1763343039.359453:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae83b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd9 expref: 22 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:3.0:1763343039.359484:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340ad3f000/0x607405d401ae83b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd9 expref: 22 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:3.0:1763343039.359504:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.359507:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.359512:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae84f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.359524:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae84f9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.359553:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343039.359652:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993667200:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 240us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.359661:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3161 00000100:00100000:3.0:1763343039.359790:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.359890:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.360667:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993667456 00000100:00100000:0.0:1763343039.360678:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993667456 00010000:00010000:1.0:1763343039.360717:0:8408:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae84f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343039.360727:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993667584 00010000:00010000:1.0:1763343039.360730:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae84f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343039.360730:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993667584 00010000:00010000:1.0:1763343039.360742:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae84f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.360750:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae84f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343039.360755:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9589 00000100:00100000:0.0:1763343039.360762:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:55941:x1848997993667456:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343039.360776:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343039.360788:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.360790:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343039.360816:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8515 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c3b expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.360833:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343039.360838:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343039.360866:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae851c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c42 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.360926:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8523 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.360941:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8523 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.360949:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8523 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:1.0:1763343039.361108:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3657:x1848998010300032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17650us (17831us total) trans 17179871702 rc 0/0 00000100:00100000:1.0:1763343039.361117:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6760 00010000:00010000:1.0:1763343039.361147:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343039.361155:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae84f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.361163:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3500031600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343039.361167:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae84f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.361177:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae84f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.361192:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae84f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.361199:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3500031600/0x607405d401ae84f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1763343039.361204:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1501, 88 off126368 00000004:00080000:0.0:1763343039.361212:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1233028590695ns, next at 1233117841489ns, rc = 0 00010000:00010000:1.0:1763343039.361217:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343039.361219:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343039.361221:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343039.361268:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d10c380/2, rc 0, transno 17179871702 00000040:00080000:0.0:1763343039.361278:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1500, 88 off126368 00000100:00100000:1.0:1763343039.361281:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010300032:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1763343039.361283:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233028662390ns, next at 1233117877304ns, rc = 0 00000040:00080000:0.0:1763343039.361323:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1501, 88 off126456 00000004:00080000:0.0:1763343039.361328:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233028707747ns, next at 1233117877304ns, rc = 0 00000040:00080000:0.0:1763343039.361347:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1502, 88 off126456 00000004:00080000:0.0:1763343039.361351:0:10041:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1233028730565ns, next at 1233117841489ns, rc = 0 00000100:00100000:0.0:1763343039.361734:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9590 00000100:00100000:0.0:1763343039.361745:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56924:x1848997993667584:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343039.361762:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.361775:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae852a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c49 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.361819:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae852a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c49 expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.361832:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176000/0x607405d401ae852a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c49 expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.361865:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:0.0:1763343039.361869:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343039.361873:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176000, rc 0) 00000100:00100000:2.0:1763343039.364808:0:10294:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10294:1848998010301184:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343039.364858:0:10294:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8500 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343039.365637:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56924:x1848997993667584:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3869us (5721us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.365652:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9590 00000100:00100000:2.0:1763343039.366853:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.367523:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993667712 00000100:00100000:0.0:1763343039.367538:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993667712 00010000:00010000:0.0:1763343039.367592:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae83b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd2 expref: 13 pid: 10294 timeout: 1333 lvb_type: 0 00000100:00100000:0.0:1763343039.367654:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3162 00000100:00100000:0.0:1763343039.367666:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993667712:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343039.367685:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343039.367692:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae83b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd2 expref: 13 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.367713:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae83b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd2 expref: 13 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.367744:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340ad3fa00/0x607405d401ae83b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bd2 expref: 13 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.367763:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.367766:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.367773:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8500 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.367785:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8500 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.367814:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343039.367889:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2430:x1848997993667712:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 224us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.367898:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3162 00010000:00010000:2.0:1763343039.368970:0:10294:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8500 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.368987:0:10294:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8500 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.368998:0:10294:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8500 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.369007:0:10294:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8500 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.369038:0:10294:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343039.369394:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010300544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25466us (25893us total) trans 21474838999 rc 0/0 00000100:00100000:2.0:1763343039.369405:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6761 00010000:00010000:3.0:1763343039.369655:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343039.369665:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8500 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.369675:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343039.369680:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8500 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.369690:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8500 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.369713:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8500 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.369721:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8500 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.369744:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343039.369746:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343039.369748:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343039.369935:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537b0e300/2, rc 0, transno 21474838999 00000100:00100000:1.0:1763343039.369953:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010300544:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.371688:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000001:00080000:1.0:1763343039.372016:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940217 is committed 00000004:00080000:1.0:1763343039.372027:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 989 committed 00000004:00080000:1.0:1763343039.372042:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 990 committed 00000004:00080000:1.0:1763343039.372045:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 989 committed 00000004:00080000:1.0:1763343039.372048:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 988 committed 00000100:00100000:1.0:1763343039.372208:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010301312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343039.372279:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343039.372327:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343039.372334:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010301440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343039.372359:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343039.372396:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010301312 00000100:00100000:1.0:1763343039.372405:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010301312 00000100:00100000:1.0:1763343039.372455:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010301440 00000100:00100000:1.0:1763343039.372458:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010301440 00000100:00100000:1.0:1763343039.372480:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6768 00000100:00100000:1.0:1763343039.372489:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3657:x1848998010301312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343039.372683:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993667968 00000100:00100000:0.0:1763343039.372689:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993667968 00000100:00100000:0.0:1763343039.372729:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3270 00000100:00100000:0.0:1763343039.372737:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56924:x1848997993667968:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343039.372754:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3657:x1848998010301312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 266us (475us total) trans 17179871703 rc 0/0 00000100:00100000:2.0:1763343039.372758:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6769 00000100:00100000:1.0:1763343039.372768:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6768 00000100:00100000:2.0:1763343039.372774:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3657:x1848998010301440:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763343039.372822:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537b0c380/2, rc 0, transno 17179871703 00000100:00100000:1.0:1763343039.372828:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010301312:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343039.373020:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1f4:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343039.373093:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1503, 64 off126520 00000040:00080000:0.0:1763343039.373116:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1502, 64 off126520 00010000:00010000:3.0:1763343039.373124:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00000040:00080000:0.0:1763343039.373126:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1503, 64 off126584 00000040:00080000:0.0:1763343039.373135:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1504, 64 off126584 00010000:00010000:3.0:1763343039.373138:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.373147:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.373154:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.373159:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.373169:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.373187:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343039.373189:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8531 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343039.373190:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.373195:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84f2 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.373201:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae84f2 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.373204:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8531 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343039.373215:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8531 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343039.373223:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8531 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343039.373229:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8531 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343039.373234:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8531 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343039.373264:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343039.373318:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3657:x1848998010301440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 547us (955us total) trans 17179871704 rc 0/0 00000100:00100000:2.0:1763343039.373327:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6769 00000004:00080000:3.0:1763343039.373338:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537b0c700/2, rc 0, transno 17179871704 00000100:00100000:3.0:1763343039.373353:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010301440:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1763343039.373432:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343039.373440:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8531 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343039.373452:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343039.373456:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8531 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00000100:00100000:2.0:1763343039.373460:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010301568:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343039.373464:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8531 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343039.373480:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f4:0x0].0x0 (ffff9a34037c4e00) 00010000:00010000:1.0:1763343039.373483:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343039.373487:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8531 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343039.373492:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8531 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00000100:00100000:0.0:1763343039.373493:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56924:x1848997993667968:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 757us (1818us total) trans 8589940218 rc 0/0 00000100:00100000:0.0:1763343039.373501:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3270 00010000:00010000:1.0:1763343039.373504:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343039.373506:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343039.373507:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343039.373546:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010301696:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763343039.373582:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8523 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f7:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c42 expref: 259 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.373590:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343039.373593:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1763343039.373594:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343039.373610:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae851c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c42 expref: 259 pid: 10041 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1763343039.373655:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010301696 00000100:00100000:2.0:1763343039.373662:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010301696 00010000:00010000:0.0:1763343039.373664:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8523 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c42 expref: 258 pid: 10041 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343039.373682:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343039.373704:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343039.373709:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:1.0:1763343039.373711:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010301568 00010000:00010000:0.0:1763343039.373711:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:1.0:1763343039.373715:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010301568 00000100:00100000:0.0:1763343039.373739:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:55941:x1848997993667456:12345-192.168.204.21@tcp:101:bash.0 Request processed in 12976us (13948us total) trans 8589940217 rc 0/0 00000100:00100000:1.0:1763343039.373746:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6770 00000100:00100000:0.0:1763343039.373747:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9589 00000100:00100000:1.0:1763343039.373754:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3659:x1848998010301568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343039.373773:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6771 00000100:00100000:2.0:1763343039.373785:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3660:x1848998010301696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343039.373895:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3659:x1848998010301568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 141us (216us total) trans 21474839000 rc 0/0 00000100:00100000:1.0:1763343039.373901:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6770 00000100:00100000:2.0:1763343039.374360:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3660:x1848998010301696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 578us (765us total) trans 21474839001 rc 0/0 00000100:00100000:2.0:1763343039.374369:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6771 00000004:00080000:2.0:1763343039.374415:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340ccc2680/2, rc 0, transno 21474839000 00000100:00100000:2.0:1763343039.374436:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010301568:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343039.375517:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340ccc3800/2, rc 0, transno 21474839001 00000100:00100000:0.0:1763343039.375547:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010301696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343039.382168:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.382267:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993668224 00000100:00100000:2.0:1763343039.382282:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993668224 00000100:00100000:2.0:1763343039.383100:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9591 00000100:00100000:2.0:1763343039.383117:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56924:x1848997993668224:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343039.383152:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.383185:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8538 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c50 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.383298:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae853f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383317:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae853f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383331:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae853f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383345:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8546 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383352:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8546 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383358:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8546 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383507:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae854d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383519:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae854d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383527:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae854d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:2.0:1763343039.383539:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f7:0x0]: returning size 2 00010000:00010000:2.0:1763343039.383676:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae853f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383684:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae853f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383691:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae853f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383697:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae853f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383704:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.383709:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae853f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383716:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae853f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383732:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935900) 00010000:00010000:2.0:1763343039.383736:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.383742:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae853f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383748:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae853f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383768:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8546 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383773:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8546 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383779:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8546 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383783:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.383786:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8546 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383791:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8546 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383798:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935000) 00010000:00010000:2.0:1763343039.383801:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.383803:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8546 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383809:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae8546 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.383867:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8538 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c50 expref: 261 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.383883:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae854d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c50 expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.383890:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:2.0:1763343039.383893:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343039.383896:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:1.0:1763343039.384915:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.386518:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993668352 00000100:00100000:3.0:1763343039.386539:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993668352 00000100:00100000:3.0:1763343039.386669:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6772 00000100:00100000:3.0:1763343039.386682:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:55941:x1848997993668352:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343039.386706:0:10294:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.386742:0:10294:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae855b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c57 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343039.386777:0:10294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343039.386807:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.386810:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.386823:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae855b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c57 expref: 22 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343039.386828:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56924:x1848997993668224:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3711us (4673us total) trans 8589940219 rc 0/0 00010000:00010000:3.0:1763343039.386855:0:10294:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae855b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c57 expref: 22 pid: 10294 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343039.386863:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9591 00010000:00010000:3.0:1763343039.386876:0:10294:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92000, rc 0) 00000100:00100000:3.0:1763343039.386958:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:55941:x1848997993668352:12345-192.168.204.21@tcp:101:bash.0 Request processed in 279us (2054us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.386966:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6772 00000100:00100000:1.0:1763343039.391745:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.391802:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.392685:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993668480 00000100:00100000:2.0:1763343039.392702:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993668480 00000100:00100000:2.0:1763343039.392782:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993668608 00000100:00100000:2.0:1763343039.392787:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993668608 00000100:00100000:3.0:1763343039.392871:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6773 00000100:00100000:2.0:1763343039.392882:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6774 00000100:00100000:3.0:1763343039.392887:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993668480:12345-192.168.204.21@tcp:101:lfs.0 00000100:00100000:2.0:1763343039.392889:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:55941:x1848997993668608:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343039.392912:0:10294:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.392912:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.392934:0:10294:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae8562 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c5e expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.392935:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae8569 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c65 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343039.392967:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343039.392984:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.392987:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.392998:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae8569 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c65 expref: 13 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.393014:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae8569 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c65 expref: 13 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.393021:0:10294:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10294:1848998010301824:192.168.204.21@tcp:106: 00010000:00010000:2.0:1763343039.393028:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d800, rc 0) 00000100:00100000:2.0:1763343039.393096:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:55941:x1848997993668608:12345-192.168.204.21@tcp:101:bash.0 Request processed in 206us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.393105:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6774 00000100:00100000:0.0:1763343039.394116:0:10294:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c900 going to sleep for 11 seconds 00000100:00100000:1.0:1763343039.397147:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.397514:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.398159:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993668736 00000100:00100000:0.0:1763343039.398173:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993668736 00002000:00010000:0.0:1763343039.398233:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/707 (0->18446744073709551615) 00002000:00100000:0.0:1763343039.398239:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537b0f100 with x1848997993668736 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343039.398258:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537b0f100. 00000100:00100000:0.0:1763343039.398298:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993668864 00000100:00100000:0.0:1763343039.398302:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993668864 00002000:00010000:0.0:1763343039.398319:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/705 (0->18446744073709551615) 00002000:00100000:0.0:1763343039.398322:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537b0dc00 with x1848997993668864 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343039.398331:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537b0dc00. 00000100:00100000:0.0:1763343039.398357:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1644 00000100:00100000:0.0:1763343039.398368:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993668736:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343039.398538:0:10294:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x2c3:0x0] updating lvb mtime: 0 -> 1763343039 00002000:00010000:3.0:1763343039.398544:0:10294:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x2c3:0x0] updating lvb atime: 0 -> 1763343039 00002000:00010000:3.0:1763343039.398546:0:10294:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x2c3:0x0] updating lvb ctime: 0 -> 1763343039 00000100:00100000:1.0:1763343039.398598:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1645 00000100:00100000:1.0:1763343039.398610:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993668864:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:1.0:1763343039.398873:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2c1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343039.398877:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2c1:0x0] updating lvb mtime from disk: 0 -> 1763343039 00002000:00010000:1.0:1763343039.398879:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343039.398882:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2c1:0x0] updating lvb ctime from disk: 0 -> 1763343039 00002000:00010000:1.0:1763343039.398884:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2c1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343039.398959:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993668864:12345-192.168.204.21@tcp:10:bash.0 Request processed in 351us (1444us total) trans 21474839002 rc 0/0 00000100:00100000:1.0:1763343039.398967:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1645 00002000:00010000:1.0:1763343039.398972:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/705 (0->18446744073709551615) 00002000:00100000:1.0:1763343039.398975:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537b0dc00 with x1848997993668864 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343039.398981:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537b0dc00. 00000100:00100000:3.0:1763343039.399822:0:10294:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10294:1848998010301824:192.168.204.21@tcp:106: 00010000:00010000:3.0:1763343039.399886:0:10294:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae8562 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c5e expref: 24 pid: 10294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343039.399924:0:10294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d93200/0x607405d401ae8562 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c5e expref: 24 pid: 10294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343039.399941:0:10294:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:3.0:1763343039.400004:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993668480:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 7121us (8275us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343039.400012:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6773 00002000:00010000:0.0:1763343039.400774:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2c3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343039.400780:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2c3:0x0] updating lvb mtime from disk: 1763343039 -> 1763343039 00002000:00010000:0.0:1763343039.400784:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2c3:0x0] updating lvb atime from disk: 1763343039 -> 0 00002000:00010000:0.0:1763343039.400787:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2c3:0x0] updating lvb ctime from disk: 1763343039 -> 1763343039 00002000:00010000:0.0:1763343039.400790:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2c3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343039.400838:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993668736:12345-192.168.204.21@tcp:10:bash.0 Request processed in 2468us (3703us total) trans 17179871705 rc 0/0 00000100:00100000:0.0:1763343039.400862:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1644 00002000:00010000:0.0:1763343039.400878:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/707 (0->18446744073709551615) 00002000:00100000:0.0:1763343039.400881:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537b0f100 with x1848997993668736 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343039.400889:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537b0f100. 00000100:00100000:2.0:1763343039.411515:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.411675:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993669120 00000100:00100000:0.0:1763343039.411689:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993669120 00000100:00100000:0.0:1763343039.411765:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3271 00000100:00100000:0.0:1763343039.411777:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56924:x1848997993669120:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343039.412102:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56924:x1848997993669120:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 326us (601us total) trans 8589940220 rc 0/0 00000100:00100000:0.0:1763343039.412112:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3271 00000100:00100000:1.0:1763343039.416069:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.416195:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993669248 00000100:00100000:2.0:1763343039.416211:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993669248 00000100:00100000:2.0:1763343039.416293:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3272 00000100:00100000:2.0:1763343039.416315:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56924:x1848997993669248:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:2.0:1763343039.416554:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56924:x1848997993669248:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 241us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.416563:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3272 00000100:00100000:3.0:1763343039.428868:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.429093:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993669504 00000100:00100000:2.0:1763343039.429109:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993669504 00000100:00100000:2.0:1763343039.429197:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9592 00000100:00100000:2.0:1763343039.429210:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56924:x1848997993669504:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343039.429239:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.429270:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8570 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c6c expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.429418:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae8577 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.429438:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae8577 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.429453:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae8577 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:2.0:1763343039.429470:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f7:0x0]: returning size 2 00010000:00010000:2.0:1763343039.429680:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8570 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c6c expref: 264 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.429705:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae8577 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c6c expref: 263 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.429716:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:2.0:1763343039.429720:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343039.429725:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d600, rc 0) 00000100:00100000:2.0:1763343039.429818:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56924:x1848997993669504:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 609us (978us total) trans 8589940221 rc 0/0 00000100:00100000:2.0:1763343039.429826:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9592 00000100:00100000:3.0:1763343039.430917:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.431004:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993669760 00000100:00100000:0.0:1763343039.431014:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993669760 00000100:00100000:0.0:1763343039.431071:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9593 00000100:00100000:0.0:1763343039.431082:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56929:x1848997993669760:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:0.0:1763343039.431139:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763343039.431168:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8523 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f7:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c42 expref: 263 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.431192:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae854d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c50 expref: 262 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.431211:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae84eb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c34 expref: 261 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.431221:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343039.431227:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343039.431257:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8585 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431270:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8585 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431280:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8585 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431293:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae858c lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431301:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae858c lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431307:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae858c lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431411:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8593 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431420:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8593 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431427:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8593 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00080000:0.0:1763343039.431800:0:28422:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1f7:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1763343039.431924:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8593 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431932:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8593 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431938:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8593 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431944:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.431949:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8593 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431956:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8593 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431965:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343039.431968:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343039.431972:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8593 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431978:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8593 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431991:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8585 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.431996:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8585 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.432001:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8585 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.432006:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.432008:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8585 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.432014:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8585 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.432020:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:0.0:1763343039.432022:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.432025:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8585 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.432030:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8585 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343039.432043:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004aacf605 reply state 00000000a88eba19 transno 8589940222 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae858c lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.432054:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae858c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.432059:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4e00) 00010000:00010000:0.0:1763343039.432062:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343039.432065:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343039.436112:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56929:x1848997993669760:12345-192.168.204.21@tcp:36:rm.0 Request processed in 5011us (5182us total) trans 8589940222 rc 0/0 00000100:00100000:0.0:1763343039.436130:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9593 00000100:00100000:1.0:1763343039.441452:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.441547:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993670016 00000100:00100000:0.0:1763343039.441561:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993670016 00000100:00100000:0.0:1763343039.441664:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3273 00000100:00100000:0.0:1763343039.441678:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56924:x1848997993670016:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:0.0:1763343039.441780:0:14879:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae8577 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c6c expref: 262 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.441854:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae859a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343039.441871:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae859a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343039.441883:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae859a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00000004:00020000:0.0:1763343039.442072:0:14879:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0000-mdtlov: can not set all stale mirrors for [0x200000405:0x1f7:0x0]: rc = -1 00010000:00010000:0.0:1763343039.442106:0:14879:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae859a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343039.442114:0:14879:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae859a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343039.442121:0:14879:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae859a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343039.442128:0:14879:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.442134:0:14879:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae859a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343039.442141:0:14879:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae859a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343039.442151:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343039.442154:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1763343039.442159:0:14879:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae859a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343039.442165:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae859a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343039.442178:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a34037c4700) 00010000:00010000:0.0:1763343039.442181:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343039.442186:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae8577 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c6c expref: 262 pid: 10041 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343039.447987:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56924:x1848997993670016:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 6293us (6531us total) trans 8589940223 rc -1/-1 00000100:00100000:0.0:1763343039.448007:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3273 00000100:00100000:3.0:1763343039.452032:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.452185:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993670144 00000100:00100000:2.0:1763343039.452199:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993670144 00000100:00100000:2.0:1763343039.452292:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9594 00000100:00100000:2.0:1763343039.452304:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56924:x1848997993670144:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343039.452339:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.452374:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae85a1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c73 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.452451:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae85a1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c73 expref: 263 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.452468:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c600/0x607405d401ae85a1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c73 expref: 263 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.452490:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a3518935900) 00010000:00010000:2.0:1763343039.452493:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343039.452497:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c600, rc 0) 00000100:00100000:2.0:1763343039.452560:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56924:x1848997993670144:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 259us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.452567:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9594 00000100:00100000:2.0:1763343039.458987:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.459092:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993670272 00000100:00100000:3.0:1763343039.459107:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993670272 00000100:00100000:3.0:1763343039.459179:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9595 00000100:00100000:3.0:1763343039.459189:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56930:x1848997993670272:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.459215:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.459255:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae85a8 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c7a expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.459346:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae85af lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459365:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae85af lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459378:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae85af lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459391:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae85b6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459400:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae85b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459407:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae85b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459461:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae85af lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459469:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae85af lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459475:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae85af lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459482:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.459486:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae85af lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459494:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae85af lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459508:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873ad00) 00010000:00010000:3.0:1763343039.459511:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.459517:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae85af lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459523:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae85af lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459538:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae85b6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459544:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae85b6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459550:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae85b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459555:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.459558:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae85b6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459564:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae85b6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459570:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4e00) 00010000:00010000:3.0:1763343039.459573:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.459576:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae85b6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459581:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93800/0x607405d401ae85b6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.459611:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae85a8 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c7a expref: 264 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.459686:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873ad00) 00010000:00010000:3.0:1763343039.459690:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.459694:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae85a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c7a expref: 264 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.459710:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:3.0:1763343039.459804:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56930:x1848997993670272:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 614us (830us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343039.459815:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9595 00000100:00100000:1.0:1763343039.461554:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.461732:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993670528 00000100:00100000:0.0:1763343039.461745:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993670528 00000100:00100000:0.0:1763343039.461815:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3274 00000100:00100000:0.0:1763343039.461828:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56924:x1848997993670528:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:0.0:1763343039.462456:0:14879:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1f7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343039.462540:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1505, 64 off126648 00000004:00080000:0.0:1763343039.462550:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1233129928900ns, next at 1234129925410ns, rc = 0 00000040:00080000:0.0:1763343039.462575:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1504, 64 off126648 00000004:00080000:0.0:1763343039.462581:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233129959699ns, next at 1234129958002ns, rc = 0 00000040:00080000:0.0:1763343039.462591:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1505, 64 off126712 00000040:00080000:0.0:1763343039.462601:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1506, 64 off126712 00010000:00010000:0.0:1763343039.462712:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae85bd lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343039.462734:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae85bd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343039.462749:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae85bd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343039.462763:0:14879:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae85bd lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343039.462769:0:14879:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae85bd lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343039.462776:0:14879:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae85bd lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343039.465164:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343039.465184:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae85bd lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343039.465197:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343039.465202:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae85bd lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343039.465212:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae85bd lrc: 5/0,0 mode: PW/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343039.465236:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f7:0x0].0x0 (ffff9a3518935900) 00010000:00010000:2.0:1763343039.465240:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343039.465248:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae85bd lrc: 3/0,0 mode: --/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343039.465262:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343039.465264:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343039.465266:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343039.470669:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.470811:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993670656 00000100:00100000:3.0:1763343039.470825:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993670656 00000100:00100000:3.0:1763343039.470908:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9596 00000100:00100000:3.0:1763343039.470920:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56930:x1848997993670656:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.470951:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.470990:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae85c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c81 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.471088:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae85cb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471107:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae85cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471122:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae85cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471136:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae85d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471145:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae85d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471152:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae85d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471204:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae85cb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471211:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae85cb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471218:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae85cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471226:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae85cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471232:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.471237:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae85cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471246:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae85cb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471262:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a200) 00010000:00010000:3.0:1763343039.471265:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.471271:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae85cb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471278:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae85cb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471295:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae85d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471301:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae85d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471307:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae85d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471312:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.471315:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae85d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471321:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae85d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471332:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4e00) 00010000:00010000:3.0:1763343039.471335:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.471339:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae85d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471345:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae85d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.471377:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae85c4 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c81 expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.471389:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a200) 00010000:00010000:3.0:1763343039.471392:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.471395:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae85c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c81 expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.471415:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501481200, rc 0) 00000100:00100000:3.0:1763343039.471500:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56930:x1848997993670656:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 582us (886us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343039.471509:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9596 00010000:00010000:0.0:1763343039.472446:0:14879:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1763343039.472458:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae85bd lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00000100:00100000:0.0:1763343039.472827:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56924:x1848997993670528:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 10998us (11282us total) trans 8589940224 rc 0/0 00000100:00100000:0.0:1763343039.472838:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3274 00000100:00100000:2.0:1763343039.484615:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.484779:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993670784 00000100:00100000:3.0:1763343039.484793:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993670784 00000100:00100000:3.0:1763343039.484879:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9597 00000100:00100000:3.0:1763343039.484891:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56930:x1848997993670784:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.484923:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.484955:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae85d9 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c88 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.485051:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae85e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.485068:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae85e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.485082:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae85e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343039.485142:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343039.485148:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343039.485197:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae85d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c88 expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.485218:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae85e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c88 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.485228:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a000) 00010000:00010000:3.0:1763343039.485232:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343039.485236:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340683ce00, rc 0) 00000100:00100000:3.0:1763343039.485317:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56930:x1848997993670784:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 428us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.485325:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9597 00000100:00100000:3.0:1763343039.494462:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.495183:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993670912 00000100:00100000:2.0:1763343039.495197:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993670912 00000100:00100000:2.0:1763343039.495274:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9598 00000100:00100000:2.0:1763343039.495285:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56930:x1848997993670912:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343039.495310:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.495336:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae85e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c8f expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.495419:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae85ee lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495438:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae85ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495451:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae85ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495462:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae85f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495469:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae85f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495475:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae85f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495522:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae85ee lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495528:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae85ee lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495534:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae85ee lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495542:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae85ee lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495548:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.495553:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae85ee lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495561:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae85ee lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495578:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a000) 00010000:00010000:2.0:1763343039.495582:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.495587:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae85ee lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495594:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae85ee lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495609:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae85f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495614:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae85f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495665:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae85f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495670:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.495673:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae85f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495679:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae85f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495687:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4e00) 00010000:00010000:2.0:1763343039.495690:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.495693:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae85f5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495698:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae85f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.495728:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae85e7 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c8f expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.495740:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a000) 00010000:00010000:2.0:1763343039.495742:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.495746:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae85e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c8f expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.495755:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352cc00, rc 0) 00000100:00100000:2.0:1763343039.495857:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56930:x1848997993670912:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 573us (1409us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343039.495864:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9598 00000100:00100000:1.0:1763343039.505266:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.505338:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993671168 00000100:00100000:3.0:1763343039.505354:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993671168 00000100:00100000:3.0:1763343039.505434:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9599 00000100:00100000:3.0:1763343039.505445:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56930:x1848997993671168:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.505478:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.505482:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343039.505522:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ce00/0x607405d401ae85e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c88 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.505546:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a000) 00010000:00010000:3.0:1763343039.505558:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343039.505578:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae85fc lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c96 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.505782:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae8603 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.505799:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae8603 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.505810:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae8603 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.505821:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae860a lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.505830:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae860a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.505836:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae860a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.508091:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae8611 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.508125:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae8611 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.508141:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae8611 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343039.508156:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f9:0x0]: returning size 0 00010000:00010000:3.0:1763343039.508200:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae8603 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.508208:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae8603 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.508216:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae8603 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.508223:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340683c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.508229:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae8603 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.508238:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae8603 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.508253:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a200) 00010000:00010000:3.0:1763343039.508258:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.508274:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae8603 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.508282:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae8603 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:3.0:1763343039.508301:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000039cea19c reply state 0000000058caec24 transno 8589940225 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae860a lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.508315:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae860a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.508325:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4e00) 00010000:00010000:3.0:1763343039.508328:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343039.508332:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343039.508389:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae85fc lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c96 expref: 267 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.508414:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae8611 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c96 expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.508423:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a353873ad00) 00010000:00010000:3.0:1763343039.508426:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343039.508428:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:3.0:1763343039.508561:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56930:x1848997993671168:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3115us (3307us total) trans 8589940225 rc 0/0 00000100:00100000:3.0:1763343039.508572:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9599 00000100:00100000:3.0:1763343039.513948:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.515496:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.515616:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993671424 00000100:00100000:2.0:1763343039.515647:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993671424 00000100:00100000:2.0:1763343039.515737:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9600 00000100:00100000:2.0:1763343039.515749:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56930:x1848997993671424:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343039.515782:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.515810:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae861f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9c9d expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.515968:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8626 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.515985:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae8611 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c96 expref: 268 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.515996:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8626 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.516038:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae8611 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c96 expref: 268 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.516060:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae8611 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c96 expref: 268 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:2.0:1763343039.516076:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010301952:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343039.516188:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35012edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343039.516656:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993671680 00000100:00100000:0.0:1763343039.516663:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993671680 00000100:00100000:0.0:1763343039.516720:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9601 00000100:00100000:0.0:1763343039.516729:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56931:x1848997993671680:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343039.516742:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.516754:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae862d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ca4 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.516824:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8634 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.516837:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8634 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.516861:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8634 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343039.516875:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f9:0x0]: returning size 0 00010000:00010000:0.0:1763343039.516983:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8634 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.516991:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8634 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.516997:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8634 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.517004:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.517008:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8634 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.517015:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8634 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.517029:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a353873ad00) 00010000:00010000:0.0:1763343039.517033:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763343039.517038:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8634 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.517043:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8634 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.517090:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae862d lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ca4 expref: 271 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.517100:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a353873ad00) 00010000:00010000:0.0:1763343039.517103:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343039.517106:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae862d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ca4 expref: 271 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.517121:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:0.0:1763343039.517185:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56931:x1848997993671680:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 456us (1698us total) trans 8589940226 rc 301/301 00000100:00100000:0.0:1763343039.517193:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9601 00000100:00100000:2.0:1763343039.522295:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010301952:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343039.522335:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8626 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343039.525743:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.525816:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.526447:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993672064 00000100:00100000:0.0:1763343039.526462:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993672064 00000100:00100000:0.0:1763343039.526545:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3275 00000100:00100000:0.0:1763343039.526558:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56931:x1848997993672064:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343039.526966:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56931:x1848997993672064:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 408us (1147us total) trans 8589940227 rc 0/0 00000100:00100000:0.0:1763343039.526975:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3275 00000100:00100000:2.0:1763343039.527264:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993671808 00000100:00100000:2.0:1763343039.527271:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993671808 00010000:00010000:2.0:1763343039.527311:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae8611 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c96 expref: 271 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:2.0:1763343039.527358:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3163 00000100:00100000:2.0:1763343039.527368:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:2429:x1848997993671808:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343039.527386:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343039.527394:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae8611 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c96 expref: 271 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343039.527410:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae8611 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c96 expref: 271 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343039.527443:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae8611 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c96 expref: 271 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343039.527472:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a353873ad00) 00010000:00010000:2.0:1763343039.527479:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8626 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.527490:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8626 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.527499:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8626 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.527533:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343039.527566:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:2429:x1848997993671808:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 200us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.527574:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3163 00010000:00010000:2.0:1763343039.527602:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8626 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.527611:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8626 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343039.527682:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f9:0x0]: returning size 0 00000004:00080000:2.0:1763343039.527923:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2c3:0x0], index 0: 0 00000004:00080000:2.0:1763343039.527932:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2c5:0x0], index 1: 0 00000004:00080000:2.0:1763343039.527938:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2c6:0x0], index 1: 0 00000004:00080000:2.0:1763343039.527943:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2c4:0x0], index 0: 0 00010000:00010000:2.0:1763343039.528068:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8626 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.528077:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8626 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.528091:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8626 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.528098:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.528104:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8626 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.528112:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8626 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.528123:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a353873ad00) 00010000:00010000:2.0:1763343039.528126:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343039.528131:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8626 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.528136:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8626 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.528188:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae861f lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c9d expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.528198:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a353873ad00) 00010000:00010000:2.0:1763343039.528200:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343039.528205:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae861f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c9d expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.528221:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352cc00, rc 0) 00000100:00100000:2.0:1763343039.528264:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56930:x1848997993671424:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 12517us (14333us total) trans 8589940228 rc 301/301 00000100:00100000:2.0:1763343039.528271:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9600 00000100:00100000:3.0:1763343039.533192:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.533240:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.533454:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993672576 00000100:00100000:0.0:1763343039.533468:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993672576 00000100:00100000:0.0:1763343039.533543:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3276 00000100:00100000:0.0:1763343039.533555:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56930:x1848997993672576:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343039.533981:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56930:x1848997993672576:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 425us (738us total) trans 8589940229 rc 0/0 00000100:00100000:0.0:1763343039.533990:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3276 00000100:00100000:2.0:1763343039.534282:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993672320 00000100:00100000:2.0:1763343039.534288:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993672320 00000100:00100000:2.0:1763343039.534327:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9602 00000100:00100000:2.0:1763343039.534334:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56931:x1848997993672320:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343039.534349:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.534382:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8649 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9cab expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.534479:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8650 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534497:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8650 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534511:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8650 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534524:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8657 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534532:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534538:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534685:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae865e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534694:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae865e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534700:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae865e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343039.534712:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f9:0x0]: returning size 0 00010000:00010000:2.0:1763343039.534781:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8650 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534789:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8650 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534795:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8650 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534802:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.534807:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8650 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534815:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8650 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534831:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935000) 00010000:00010000:2.0:1763343039.534835:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.534849:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8650 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534857:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8650 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534870:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534876:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8657 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534882:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8657 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534890:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.534893:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8657 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534899:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8657 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534905:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4e00) 00010000:00010000:2.0:1763343039.534908:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.534911:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8657 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534916:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8657 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.534955:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8649 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cab expref: 273 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.534974:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae865e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cab expref: 272 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.534982:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a3518935200) 00010000:00010000:2.0:1763343039.534984:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343039.534987:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352de00, rc 0) 00000100:00100000:2.0:1763343039.535039:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56931:x1848997993672320:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 705us (1862us total) trans 8589940230 rc 0/0 00000100:00100000:2.0:1763343039.535046:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9602 00000100:00100000:1.0:1763343039.544408:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.545230:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993672832 00000100:00100000:3.0:1763343039.545248:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993672832 00000100:00100000:3.0:1763343039.545730:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3277 00000100:00100000:3.0:1763343039.545746:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56930:x1848997993672832:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343039.546104:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56930:x1848997993672832:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 359us (1707us total) trans 8589940231 rc 0/0 00000100:00100000:3.0:1763343039.546120:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3277 00000100:00100000:1.0:1763343039.548454:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.548592:0:10294:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993672960 00000100:00100000:3.0:1763343039.548606:0:10294:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993672960 00000100:00100000:3.0:1763343039.551205:0:10294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6775 00000100:00100000:3.0:1763343039.551229:0:10294:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993672960:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.551255:0:10294:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.551282:0:10294:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae866c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9cb2 expref: -99 pid: 10294 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343039.551311:0:10294:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343039.551339:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.551341:0:10294:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.551354:0:10294:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae866c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cb2 expref: 15 pid: 10294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343039.551374:0:10294:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae866c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cb2 expref: 15 pid: 10294 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343039.551389:0:10294:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:3.0:1763343039.551470:0:10294:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993672960:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 249us (3032us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.551478:0:10294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6775 00000100:00100000:1.0:1763343039.558075:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.558515:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993673216 00000100:00100000:0.0:1763343039.558529:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993673216 00000100:00100000:0.0:1763343039.558614:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9603 00000100:00100000:0.0:1763343039.558882:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:55941:x1848997993673216:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343039.558919:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.558923:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343039.558961:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae865e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cab expref: 273 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.558987:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a3518935200) 00010000:00010000:0.0:1763343039.559000:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343039.559022:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8673 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9cb9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.559183:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae867a lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.559198:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae867a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.559209:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae867a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343039.559225:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f9:0x0]: returning size 0 00010000:00010000:0.0:1763343039.559360:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8673 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cb9 expref: 275 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.559375:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae867a lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cb9 expref: 274 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.559382:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:0.0:1763343039.559385:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1763343039.559388:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:0.0:1763343039.559463:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:55941:x1848997993673216:12345-192.168.204.21@tcp:101:bash.0 Request processed in 587us (1405us total) trans 8589940232 rc 0/0 00000100:00100000:0.0:1763343039.559470:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9603 00000100:00100000:1.0:1763343039.564876:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.565104:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993673344 00000100:00100000:2.0:1763343039.565120:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993673344 00000100:00100000:2.0:1763343039.565211:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9604 00000100:00100000:2.0:1763343039.565224:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:56931:x1848997993673344:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343039.565257:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.565289:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8688 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9cc0 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.565374:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8688 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cc0 expref: 275 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.565393:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8688 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cc0 expref: 275 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.565417:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:2.0:1763343039.565421:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343039.565425:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d400, rc 0) 00000100:00100000:2.0:1763343039.565513:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:56931:x1848997993673344:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 291us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.565521:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9604 00000100:00100000:1.0:1763343039.571323:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.572512:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993673472 00000100:00100000:0.0:1763343039.572530:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993673472 00000100:00100000:0.0:1763343039.573465:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9605 00000100:00100000:0.0:1763343039.573485:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:55941:x1848997993673472:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343039.573521:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.573551:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae868f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9cc7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.573598:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8696 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.573645:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8696 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.573663:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8696 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.573814:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae868f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cc7 expref: 277 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.573837:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8696 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cc7 expref: 276 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.573859:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:0.0:1763343039.573862:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343039.573867:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:0.0:1763343039.573956:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:55941:x1848997993673472:12345-192.168.204.21@tcp:101:bash.0 Request processed in 478us (2649us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.573965:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9605 00000100:00100000:1.0:1763343039.577373:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.578456:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.578659:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993673984 00000100:00100000:3.0:1763343039.578675:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993673984 00000100:00100000:3.0:1763343039.578744:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3278 00000100:00100000:3.0:1763343039.578754:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:56931:x1848997993673984:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343039.579089:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:56931:x1848997993673984:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 334us (638us total) trans 8589940233 rc 0/0 00000100:00100000:3.0:1763343039.579098:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3278 00000100:00100000:0.0:1763343039.579389:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993673856 00000100:00100000:0.0:1763343039.579396:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993673856 00000100:00100000:0.0:1763343039.579433:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9606 00000100:00100000:0.0:1763343039.579441:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:55941:x1848997993673856:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343039.579479:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343039.579514:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae867a lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cb9 expref: 277 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.579536:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:0.0:1763343039.579543:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343039.579754:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae869d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.579772:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae869d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.579784:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae869d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:0.0:1763343039.579849:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940234 00000004:00010000:0.0:1763343039.579875:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000140fa827 reply state 000000008bc77700 transno 8589940235 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae869d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.579889:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae869d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.579895:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:0.0:1763343039.579897:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343039.579900:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343039.579975:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+279:55941:x1848997993673856:12345-192.168.204.21@tcp:36:bash.0 Request processed in 532us (2615us total) trans 8589940235 rc 0/0 00000100:00100000:0.0:1763343039.579982:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9606 00000020:00080000:0.0:1763343039.579987:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343039.584956:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.585005:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.585439:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993674240 00000100:00100000:3.0:1763343039.585455:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993674240 00000100:00100000:3.0:1763343039.585524:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993674496 00000100:00100000:3.0:1763343039.585527:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993674496 00000100:00100000:3.0:1763343039.585558:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9607 00000100:00100000:3.0:1763343039.585569:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+280:56931:x1848997993674240:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.585598:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.585657:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9cce expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.585759:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae86ab lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.585777:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae86ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.585791:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae86ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.585803:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae86b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.585811:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae86b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.585818:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae86b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.585971:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae86b9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.585982:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae86b9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.585989:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae86b9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343039.586003:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f9:0x0]: returning size 0 00010000:00010000:3.0:1763343039.586121:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae86ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586130:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae86ab lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586137:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae86ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586144:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.586149:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae86ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586158:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae86ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586174:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a300) 00010000:00010000:3.0:1763343039.586177:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.586183:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae86ab lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586189:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d93200/0x607405d401ae86ab lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586211:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae86b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586218:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae86b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586224:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae86b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586229:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340683d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.586232:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae86b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586238:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae86b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586246:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4e00) 00010000:00010000:3.0:1763343039.586249:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.586252:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae86b2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586258:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d400/0x607405d401ae86b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586311:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cce expref: 283 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.586330:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae86b9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cce expref: 282 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.586338:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:3.0:1763343039.586341:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343039.586344:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340683c200, rc 0) 00000100:00100000:3.0:1763343039.586440:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:56931:x1848997993674240:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 872us (1499us total) trans 8589940236 rc 0/0 00000100:00100000:3.0:1763343039.586448:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9607 00000100:00100000:3.0:1763343039.586588:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9608 00000100:00100000:3.0:1763343039.586598:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+281:55941:x1848997993674496:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343039.586612:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.586615:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343039.586664:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8688 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cc0 expref: 281 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.586676:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:3.0:1763343039.586680:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343039.586689:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae86c7 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9cd5 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.586721:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae86ce lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586731:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae86b9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cce expref: 281 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.586740:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae86ce lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.586775:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae86b9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cce expref: 281 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.586795:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae86b9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cce expref: 281 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:3.0:1763343039.586811:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010302080:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343039.586889:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c900 going to sleep for 11 seconds 00000100:00100000:1.0:1763343039.593021:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.593143:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993674752 00000100:00100000:2.0:1763343039.593157:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993674752 00000100:00100000:2.0:1763343039.593225:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3279 00000100:00100000:2.0:1763343039.593235:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:56931:x1848997993674752:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343039.593541:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:56931:x1848997993674752:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 306us (537us total) trans 8589940237 rc 0/0 00000100:00100000:2.0:1763343039.593550:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3279 00000100:00100000:1.0:1763343039.598101:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.599052:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010302080:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343039.599092:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae86ce lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343039.599224:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.599519:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993675008 00000100:00100000:2.0:1763343039.599530:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993675008 00010000:00010000:2.0:1763343039.599578:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae86b9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cce expref: 283 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:2.0:1763343039.599647:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3164 00000100:00100000:2.0:1763343039.599657:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:2429:x1848997993675008:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343039.599677:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343039.599685:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae86b9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cce expref: 283 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343039.599698:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae86b9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cce expref: 283 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343039.599728:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683c200/0x607405d401ae86b9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cce expref: 283 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343039.599746:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:2.0:1763343039.599752:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae86ce lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.599763:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae86ce lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.599772:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae86ce lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.599806:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343039.599877:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:2429:x1848997993675008:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 220us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.599889:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3164 00000100:00100000:0.0:1763343039.600403:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993674880 00000100:00100000:0.0:1763343039.600411:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993674880 00000100:00100000:1.0:1763343039.600554:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3280 00000100:00100000:1.0:1763343039.600564:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:56931:x1848997993674880:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:1.0:1763343039.600790:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:56931:x1848997993674880:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 227us (2705us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343039.600798:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3280 00010000:00010000:1.0:1763343039.600827:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae86ce lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.600837:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae86ce lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:1.0:1763343039.601126:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1506, 88 off126800 00000004:00080000:1.0:1763343039.601136:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233268514582ns, next at 1234129958002ns, rc = 0 00000040:00080000:1.0:1763343039.601180:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1507, 88 off126800 00000004:00080000:1.0:1763343039.601185:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1233268564745ns, next at 1234129925410ns, rc = 0 00000040:00080000:1.0:1763343039.601200:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1508, 88 off126888 00000004:00080000:1.0:1763343039.601203:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1233268582715ns, next at 1234129925410ns, rc = 0 00000040:00080000:1.0:1763343039.601212:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1507, 88 off126888 00000004:00080000:1.0:1763343039.601215:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233268594567ns, next at 1234129958002ns, rc = 0 00000001:00080000:2.0:1763343039.608366:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940238 is committed 00000004:00080000:2.0:1763343039.608387:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 993 committed 00000004:00080000:2.0:1763343039.608407:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 992 committed 00000004:00080000:2.0:1763343039.608426:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 991 committed 00000004:00080000:2.0:1763343039.608429:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 992 committed 00000004:00080000:2.0:1763343039.608460:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 991 committed 00000004:00080000:2.0:1763343039.608464:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 990 committed 00010000:00010000:1.0:1763343039.608870:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae858c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.608886:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae858c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.608895:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae858c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.608905:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.608910:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae858c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343039.608911:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010302336:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763343039.608918:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae858c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.608938:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4e00) 00010000:00010000:1.0:1763343039.608942:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.608948:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae858c lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.608954:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae858c lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.608977:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae860a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.608983:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae860a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.608988:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae860a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.608992:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340683d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.608995:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae860a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343039.608998:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343039.609001:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae860a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.609008:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4e00) 00010000:00010000:1.0:1763343039.609011:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.609014:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae860a lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.609018:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683d600/0x607405d401ae860a lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.609036:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae869d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343039.609037:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010302848:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343039.609043:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae869d lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343039.609055:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.609082:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1763343039.609088:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010302208:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.609108:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.609124:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010302720:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343039.609133:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae869d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.609139:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.609142:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae869d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343039.609146:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343039.609148:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae869d lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.609158:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:1.0:1763343039.609160:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.609163:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae869d lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.609168:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae869d lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343039.609175:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010302464:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.609199:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.609217:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343039.609222:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010302592:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.609238:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763343039.609238:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae86ce lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cd5 expref: 259 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.609247:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:1.0:1763343039.609251:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1763343039.609270:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010302336 00000100:00100000:3.0:1763343039.609280:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010302336 00000100:00100000:3.0:1763343039.609331:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010302848 00000100:00100000:3.0:1763343039.609334:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010302848 00000100:00100000:3.0:1763343039.609352:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010302208 00000100:00100000:3.0:1763343039.609354:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010302208 00010000:00010000:1.0:1763343039.609359:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae86c7 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cd5 expref: 259 pid: 28422 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1763343039.609369:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010302720 00000100:00100000:3.0:1763343039.609371:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010302720 00010000:00010000:1.0:1763343039.609380:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae86ce lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cd5 expref: 258 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.609384:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010302464 00000100:00100000:3.0:1763343039.609386:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010302464 00000100:00100000:3.0:1763343039.609399:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010302592 00000100:00100000:3.0:1763343039.609401:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010302592 00010000:00010000:1.0:1763343039.609420:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00000100:00100000:3.0:1763343039.609421:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6776 00010000:00010000:1.0:1763343039.609422:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343039.609425:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480a00, rc 0) 00000100:00100000:3.0:1763343039.609429:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3658:x1848998010302336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343039.609459:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:702 count 1 00010000:00010000:3.0:1763343039.609485:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae86d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343039.609487:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:55941:x1848997993674496:12345-192.168.204.21@tcp:101:bash.0 Request processed in 22890us (24480us total) trans 8589940238 rc 0/0 00000100:00100000:1.0:1763343039.609496:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9608 00010000:00010000:3.0:1763343039.609504:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8443 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bf5 expref: 14 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.609512:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343039.609514:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343039.609518:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae86d5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.609547:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8443 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bf5 expref: 14 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.609561:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8443 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bf5 expref: 14 pid: 10294 timeout: 1333 lvb_type: 0 00000100:00100000:3.0:1763343039.609579:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1848998010302976:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343039.609655:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c900 going to sleep for 11 seconds 00000100:00100000:3.0:1763343039.609673:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6777 00000100:00100000:3.0:1763343039.609681:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3658:x1848998010302848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.609870:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010302848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 190us (813us total) trans 21474839003 rc 0/0 00000100:00100000:3.0:1763343039.609878:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6777 00000100:00100000:0.0:1763343039.609890:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010303232:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343039.609891:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6778 00000100:00100000:3.0:1763343039.609897:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3658:x1848998010302208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343039.609908:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:701 count 1 00010000:00010000:3.0:1763343039.609920:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae86dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343039.609922:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343039.609933:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae824b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b54 expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343039.609937:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010303744:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763343039.609940:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343039.609942:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343039.609944:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae86dc lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343039.609956:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343039.609963:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae824b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b54 expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343039.609967:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1763343039.609972:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010303104:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763343039.609973:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae824b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b54 expref: 14 pid: 28996 timeout: 1333 lvb_type: 0 00000100:00100000:3.0:1763343039.609983:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010303872:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343039.609990:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343039.610368:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010303616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343039.610394:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.610981:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343039.611010:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010303232 00000100:00100000:3.0:1763343039.611018:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010303232 00000100:00100000:2.0:1763343039.611026:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010303360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343039.611049:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010303744 00000100:00100000:3.0:1763343039.611052:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010303744 00000100:00100000:3.0:1763343039.611060:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010303104 00000100:00100000:3.0:1763343039.611063:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010303104 00000100:00100000:2.0:1763343039.611067:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.611073:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010303616 00000100:00100000:3.0:1763343039.611075:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010303616 00000100:00100000:3.0:1763343039.611085:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010303360 00000100:00100000:2.0:1763343039.611086:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343039.611087:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010303360 00000100:00100000:2.0:1763343039.611091:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010303488:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343039.611100:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6779 00000100:00100000:3.0:1763343039.611108:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e9cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3658:x1848998010302720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343039.611109:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1763343039.611243:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343039.611248:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343039.611250:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343039.611253:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343039.611255:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343039.611614:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e9cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010302720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 505us (2464us total) trans 21474839004 rc 0/0 00000100:00100000:3.0:1763343039.611921:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6779 00000100:00100000:3.0:1763343039.611944:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010303488 00000100:00100000:3.0:1763343039.611950:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010303488 00000100:00100000:3.0:1763343039.611972:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6780 00000100:00100000:3.0:1763343039.611979:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3659:x1848998010302464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343039.612000:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:705 count 1 00010000:00010000:3.0:1763343039.612173:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.612195:0:8410:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae8569 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c65 expref: 14 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.612203:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343039.612205:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343039.612209:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86e3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.612380:0:8410:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae8569 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c65 expref: 14 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.612395:0:8410:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae8569 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c65 expref: 14 pid: 27835 timeout: 1333 lvb_type: 0 00000100:00100000:3.0:1763343039.612412:0:8410:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010304000:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343039.612565:0:8410:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343039.612596:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6781 00000100:00100000:3.0:1763343039.612606:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3659:x1848998010302592:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343039.612693:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6782 00000100:00100000:1.0:1763343039.612705:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3660:x1848998010303232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763343039.612973:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:704 count 1 00010000:00010000:1.0:1763343039.612996:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3500030000/0x607405d401ae86ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613012:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae844a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c03 expref: 22 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613020:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343039.613022:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343039.613025:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3500030000/0x607405d401ae86ea lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613051:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae844a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c03 expref: 22 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613062:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae844a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c03 expref: 22 pid: 8408 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343039.613074:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010304128:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343039.613111:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343039.613135:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6783 00000100:00100000:1.0:1763343039.613144:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3660:x1848998010303744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343039.613394:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3660:x1848998010303744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 251us (3435us total) trans 17179871706 rc 0/0 00000100:00100000:1.0:1763343039.613402:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6783 00000100:00100000:1.0:1763343039.613426:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6784 00000100:00100000:1.0:1763343039.613434:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3660:x1848998010303104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763343039.613447:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:703 count 1 00010000:00010000:1.0:1763343039.613460:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3500030e00/0x607405d401ae86f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613473:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae84ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c26 expref: 22 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613479:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343039.613481:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343039.613484:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3500030e00/0x607405d401ae86f1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613506:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae84ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c26 expref: 22 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613517:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae84ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c26 expref: 22 pid: 10294 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343039.613528:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010304256:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343039.613554:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343039.613577:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6785 00000100:00100000:1.0:1763343039.613586:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3660:x1848998010303616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343039.613708:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3660:x1848998010303616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (3312us total) trans 17179871707 rc 0/0 00000100:00100000:1.0:1763343039.613715:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6785 00000100:00100000:1.0:1763343039.613732:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6786 00000100:00100000:1.0:1763343039.613739:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3657:x1848998010303360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763343039.613752:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:707 count 1 00010000:00010000:1.0:1763343039.613765:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae86f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613779:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae855b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c57 expref: 22 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613786:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343039.613788:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343039.613790:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae86f8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613812:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae855b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c57 expref: 22 pid: 10294 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613822:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae855b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c57 expref: 22 pid: 10294 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343039.613833:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010304384:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343039.613870:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343039.613890:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6787 00000100:00100000:1.0:1763343039.613898:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3657:x1848998010303488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763343039.613911:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:708 count 1 00002000:00010000:1.0:1763343039.613935:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343039.613940:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5e400/0x607405d401ae86ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613948:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.613949:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.613954:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5e400/0x607405d401ae86ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613969:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5e400/0x607405d401ae86ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613979:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5e400/0x607405d401ae86ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.613986:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5e400/0x607405d401ae86ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.614012:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343039.614215:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3657:x1848998010303488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 317us (3103us total) trans 17179871708 rc 0/0 00000100:00100000:1.0:1763343039.614221:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6787 00010000:00010000:1.0:1763343039.614242:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343039.614249:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5e400/0x607405d401ae86ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.614257:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403a5e400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343039.614262:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5e400/0x607405d401ae86ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.614272:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5e400/0x607405d401ae86ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.614291:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5e400/0x607405d401ae86ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.614298:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5e400/0x607405d401ae86ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.614316:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343039.614318:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343039.614320:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343039.614460:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062c9880/2, rc 0, transno 17179871707 00000100:00100000:0.0:1763343039.614468:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010303616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343039.614481:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062caa00/2, rc 0, transno 17179871706 00000100:00100000:0.0:1763343039.614485:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010303744:0@lo:2:osp-syn-1-0.0 00002000:00080000:3.0:1763343039.614754:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:706 count 1 00000004:00080000:2.0:1763343039.614779:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062cb480/2, rc 0, transno 17179871708 00002000:00010000:3.0:1763343039.614783:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1763343039.614784:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010303488:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763343039.614789:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae8706 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.614799:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.614800:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.614805:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae8706 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.614815:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae8706 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.614823:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae8706 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.614830:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae8706 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.614861:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343039.614879:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343039.614884:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae8706 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.614892:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d93200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343039.614895:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae8706 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.614902:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae8706 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.614912:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae8706 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.614919:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae8706 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.614933:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343039.614935:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343039.614936:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343039.615031:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010302592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2426us (5791us total) trans 21474839005 rc 0/0 00000100:00100000:3.0:1763343039.615038:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6781 00000004:00080000:3.0:1763343039.615101:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b0700/2, rc 0, transno 21474839004 00000100:00100000:3.0:1763343039.615107:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010302720:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343039.615117:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b3100/2, rc 0, transno 21474839003 00000100:00100000:3.0:1763343039.615121:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010302848:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763343039.615821:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b1500/2, rc 0, transno 21474839005 00000100:00100000:0.0:1763343039.615831:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010302592:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343039.619681:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.619729:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.619777:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993675264 00000100:00100000:2.0:1763343039.619795:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993675264 00000100:00100000:2.0:1763343039.619867:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6788 00000100:00100000:2.0:1763343039.619878:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:55941:x1848997993675264:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343039.619901:0:28993:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.619923:0:28993:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9cdc expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.619959:0:28993:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae866c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cb2 expref: 16 pid: 10294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343039.619968:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.619971:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.619976:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 16 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.620015:0:28993:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae866c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cb2 expref: 16 pid: 10294 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343039.620033:0:28993:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae866c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cb2 expref: 16 pid: 10294 timeout: 1333 lvb_type: 1 00000100:00100000:2.0:1763343039.620048:0:28993:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406649880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010304512:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343039.620136:0:28993:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35012edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343039.620309:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993675136 00000100:00100000:0.0:1763343039.620314:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993675136 00010000:00010000:0.0:1763343039.620339:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8443 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bf5 expref: 17 pid: 10294 timeout: 1333 lvb_type: 0 00000100:00100000:0.0:1763343039.620378:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3165 00000100:00100000:0.0:1763343039.620384:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993675136:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343039.620394:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343039.620400:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8443 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bf5 expref: 17 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.620414:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8443 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bf5 expref: 17 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.620435:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.620437:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.620442:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae86d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.620451:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae86d5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.620468:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343039.620503:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993675136:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 118us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.620511:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3165 00010000:00010000:1.0:1763343039.620750:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8443 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9bf5 expref: 16 pid: 10294 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343039.620772:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1848998010302976:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343039.620795:0:8408:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae86d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.620805:0:8408:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae86d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.620812:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae86d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.620823:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae86d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.620831:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae86d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.620866:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343039.621243:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010302336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11811us (12242us total) trans 21474839006 rc 0/0 00000100:00100000:1.0:1763343039.621252:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6776 00010000:00010000:3.0:1763343039.622012:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343039.622025:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae86d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.622036:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343039.622041:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae86d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.622058:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae86d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.622080:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae86d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.622087:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3501480e00/0x607405d401ae86d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.622113:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343039.622115:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343039.622117:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343039.622248:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b0a80/2, rc 0, transno 21474839006 00000100:00100000:3.0:1763343039.622257:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010302336:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343039.624685:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.624960:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993675520 00000100:00100000:1.0:1763343039.624974:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993675520 00000100:00100000:1.0:1763343039.625705:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9609 00000100:00100000:1.0:1763343039.625721:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56932:x1848997993675520:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343039.625762:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.625793:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8714 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ce3 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.625915:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae871b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.625933:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae871b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.625945:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae871b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.625960:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405986400/0x607405d401ae8722 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.625966:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405986400/0x607405d401ae8722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.625972:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405986400/0x607405d401ae8722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626143:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8729 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626153:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8729 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626161:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8729 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343039.626172:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f9:0x0]: returning size 2 00010000:00010000:1.0:1763343039.626299:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae871b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626308:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae871b lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626316:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae871b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626322:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501481200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.626327:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae871b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626336:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae871b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626351:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289a00) 00010000:00010000:1.0:1763343039.626354:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.626360:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae871b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626366:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae871b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626382:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405986400/0x607405d401ae8722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626388:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405986400/0x607405d401ae8722 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626393:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405986400/0x607405d401ae8722 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626398:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405986400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.626400:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405986400/0x607405d401ae8722 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626406:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405986400/0x607405d401ae8722 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626417:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289d00) 00010000:00010000:1.0:1763343039.626419:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.626422:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405986400/0x607405d401ae8722 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626427:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405986400/0x607405d401ae8722 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.626471:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8714 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ce3 expref: 261 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.626487:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8729 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ce3 expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.626494:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:1.0:1763343039.626497:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343039.626499:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405987000, rc 0) 00000100:00100000:1.0:1763343039.626600:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56932:x1848997993675520:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 883us (1978us total) trans 8589940239 rc 0/0 00000100:00100000:1.0:1763343039.626609:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9609 00000100:00100000:3.0:1763343039.627027:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010303872:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343039.627060:0:15756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae86dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.627233:0:8410:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8410:1848998010304000:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343039.627246:0:8410:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.627279:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.627319:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.627370:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.627426:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.627448:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993675648 00000100:00100000:3.0:1763343039.627456:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993675648 00000100:00100000:1.0:1763343039.627481:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010304128:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343039.627487:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae824b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b54 expref: 16 pid: 28996 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343039.627497:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3500030000/0x607405d401ae86ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.627511:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993675776 00000100:00100000:3.0:1763343039.627513:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993675776 00000100:00100000:1.0:1763343039.627519:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010304256:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343039.627524:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae8569 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c65 expref: 17 pid: 27835 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343039.627531:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3500030e00/0x607405d401ae86f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.627534:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993675904 00000100:00100000:3.0:1763343039.627536:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993675904 00010000:00010000:3.0:1763343039.627548:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae844a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c03 expref: 23 pid: 8408 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343039.627557:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010304384:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343039.627558:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993676032 00000100:00100000:3.0:1763343039.627560:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993676032 00010000:00010000:3.0:1763343039.627570:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae84ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c26 expref: 24 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343039.627571:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae86f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.627583:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3166 00000100:00100000:3.0:1763343039.627591:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993675648:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763343039.627592:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3167 00000100:00100000:1.0:1763343039.627597:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f6a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993675776:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343039.627606:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343039.627606:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343039.627611:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae824b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b54 expref: 17 pid: 28996 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343039.627611:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae8569 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c65 expref: 17 pid: 27835 timeout: 1333 lvb_type: 0 00010000:00010000:3.0:1763343039.627647:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae824b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b54 expref: 17 pid: 28996 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343039.627647:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae8569 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c65 expref: 17 pid: 27835 timeout: 1333 lvb_type: 0 00010000:00010000:3.0:1763343039.627672:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92600/0x607405d401ae824b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9b54 expref: 17 pid: 28996 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343039.627672:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d800/0x607405d401ae8569 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c65 expref: 17 pid: 27835 timeout: 1333 lvb_type: 0 00010000:00010000:3.0:1763343039.627688:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.627688:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.627690:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.627690:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.627696:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae86dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.627696:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.627708:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae86dc lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.627708:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86e3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.627730:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343039.627730:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343039.627762:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f6a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993675776:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 163us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343039.627770:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3167 00000100:00100000:1.0:1763343039.627786:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3168 00000100:00100000:1.0:1763343039.627793:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993675904:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343039.627801:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1763343039.627805:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3169 00010000:00010000:1.0:1763343039.627806:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae844a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c03 expref: 24 pid: 8408 timeout: 1333 lvb_type: 0 00000100:00100000:0.0:1763343039.627815:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993676032:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343039.627816:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae844a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c03 expref: 24 pid: 8408 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.627822:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343039.627827:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae84ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c26 expref: 24 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343039.627831:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae844a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c03 expref: 24 pid: 8408 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.627837:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae84ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c26 expref: 24 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343039.627852:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.627854:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.627857:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3500030000/0x607405d401ae86ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.627861:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae84ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c26 expref: 23 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343039.627866:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3500030000/0x607405d401ae86ea lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.627871:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.627872:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.627875:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3500030e00/0x607405d401ae86f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.627881:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343039.627882:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3500030e00/0x607405d401ae86f1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.627904:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343039.631130:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993675648:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 3520us (3833us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.631152:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3166 00010000:00010000:3.0:1763343039.631372:0:8410:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.631387:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.631401:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.631409:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.631461:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343039.631589:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993675904:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 3793us (4214us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343039.631599:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3168 00010000:00010000:1.0:1763343039.631650:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3500030000/0x607405d401ae86ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.631659:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3500030000/0x607405d401ae86ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.631667:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3500030000/0x607405d401ae86ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.631674:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3500030000/0x607405d401ae86ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.631691:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1763343039.631865:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343039.631875:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.631884:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343039.631889:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.631898:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.631921:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.631928:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae86e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.631949:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343039.631951:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3500030000/0x607405d401ae86ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.631962:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3500030000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343039.631965:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3500030000/0x607405d401ae86ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.631971:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3500030000/0x607405d401ae86ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.631980:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3500030000/0x607405d401ae86ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.631986:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3500030000/0x607405d401ae86ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.632000:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343039.632002:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343039.632003:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343039.632014:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3660:x1848998010303232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19312us (22090us total) trans 17179871709 rc 0/0 00000100:00100000:1.0:1763343039.632022:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6782 00010000:00010000:1.0:1763343039.632042:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343039.632081:0:28993:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406649880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010304512:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343039.632116:0:28993:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 13 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.632133:0:28993:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c200, rc 0) 00000100:00100000:2.0:1763343039.632155:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:55941:x1848997993675264:12345-192.168.204.21@tcp:101:bash.0 Request processed in 12281us (12426us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.632162:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6788 00000100:00100000:3.0:1763343039.632468:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010302464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20488us (23266us total) trans 21474839007 rc 0/0 00000100:00100000:3.0:1763343039.632475:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6780 00010000:00010000:3.0:1763343039.632503:0:15756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae86dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.632512:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae86dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.632520:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae86dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.632527:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae86dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.632550:0:15756:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343039.632661:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993676032:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 4845us (5231us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.632670:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3169 00000100:00100000:3.0:1763343039.632693:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010302208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22796us (23583us total) trans 21474839008 rc 0/0 00010000:00010000:0.0:1763343039.632697:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3500030e00/0x607405d401ae86f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.632700:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6778 00010000:00010000:0.0:1763343039.632705:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3500030e00/0x607405d401ae86f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.632713:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3500030e00/0x607405d401ae86f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.632719:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3500030e00/0x607405d401ae86f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.632734:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1763343039.632892:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b0e00/2, rc 0, transno 21474839008 00000100:00100000:3.0:1763343039.632900:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010302208:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343039.632969:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3660:x1848998010303104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19536us (22976us total) trans 17179871710 rc 0/0 00000100:00100000:0.0:1763343039.632980:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6784 00000004:00080000:1.0:1763343039.632992:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b2d80/2, rc 0, transno 21474839007 00000100:00100000:1.0:1763343039.632997:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010302464:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1763343039.633013:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062cbb80/2, rc 0, transno 17179871710 00000100:00100000:0.0:1763343039.633018:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010303104:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1763343039.633028:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062c9500/2, rc 0, transno 17179871709 00000100:00100000:0.0:1763343039.633032:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010303232:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1763343039.633261:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343039.633269:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae86dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.633278:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343039.633287:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae86dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.633296:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae86dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.633313:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae86dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.633320:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3501480600/0x607405d401ae86dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.633339:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343039.633342:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3500030e00/0x607405d401ae86f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.633349:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3500030e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343039.633352:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3500030e00/0x607405d401ae86f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.633352:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343039.633360:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3500030e00/0x607405d401ae86f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.633369:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3500030e00/0x607405d401ae86f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.633377:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3500030e00/0x607405d401ae86f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.633389:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343039.633391:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343039.633393:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343039.633689:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.633717:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.633745:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.633852:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993676416 00000100:00100000:2.0:1763343039.633862:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993676416 00000100:00100000:0.0:1763343039.633914:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993676160 00000100:00100000:2.0:1763343039.633917:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6789 00000100:00100000:0.0:1763343039.633918:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993676160 00000100:00100000:2.0:1763343039.633926:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2431:x1848997993676416:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343039.633945:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae855b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c57 expref: 21 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343039.633946:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.633965:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae8737 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9cea expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343039.633966:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993676288 00000100:00100000:0.0:1763343039.633969:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993676288 00010000:00010000:0.0:1763343039.633980:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae866c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cb2 expref: 15 pid: 10294 timeout: 1333 lvb_type: 1 00010000:00010000:2.0:1763343039.633989:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1763343039.633998:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3170 00010000:00010000:2.0:1763343039.634000:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae8737 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cea expref: 15 pid: 28995 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1763343039.634004:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993676160:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343039.634016:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343039.634019:0:28995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae8737 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cea expref: 15 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343039.634022:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae855b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c57 expref: 21 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343039.634030:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352da00, rc 0) 00010000:00010000:0.0:1763343039.634033:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae855b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c57 expref: 21 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.634048:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3408d92000/0x607405d401ae855b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9c57 expref: 21 pid: 10294 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.634058:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.634060:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.634066:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae86f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343039.634067:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2431:x1848997993676416:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 143us (321us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343039.634074:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6789 00010000:00010000:0.0:1763343039.634078:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae86f8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.634116:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343039.634137:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993676160:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 133us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.634145:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3170 00000100:00100000:0.0:1763343039.634160:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3171 00000100:00100000:0.0:1763343039.634166:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2432:x1848997993676288:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343039.634176:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343039.634180:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae866c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cb2 expref: 13 pid: 10294 timeout: 1333 lvb_type: 1 00010000:00010000:0.0:1763343039.634190:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae866c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cb2 expref: 13 pid: 10294 timeout: 1333 lvb_type: 1 00010000:00010000:0.0:1763343039.634203:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae866c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cb2 expref: 13 pid: 10294 timeout: 1333 lvb_type: 1 00010000:00010000:0.0:1763343039.634212:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.634213:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.634220:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 12 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.634228:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 12 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.634273:0:27834:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 12 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343039.634291:0:27834:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406ab2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:27834:1848998010304640:192.168.204.21@tcp:105: 00000100:00100000:0.0:1763343039.634350:0:27834:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f316c0 going to sleep for 11 seconds 00010000:00010000:2.0:1763343039.634571:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae86f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.634582:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae86f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.634591:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae86f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.634598:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae86f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.634645:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343039.634888:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3657:x1848998010303360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21147us (23818us total) trans 17179871711 rc 0/0 00000100:00100000:2.0:1763343039.634897:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6786 00010000:00010000:0.0:1763343039.635037:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343039.635044:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae86f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.635052:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403a5fe00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343039.635056:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae86f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.635066:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae86f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.635081:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae86f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.635089:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3403a5fe00/0x607405d401ae86f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.635110:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343039.635113:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343039.635114:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343039.635194:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062cb100/2, rc 0, transno 17179871711 00000100:00100000:3.0:1763343039.635201:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010303360:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343039.638445:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.638568:0:27834:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406ab2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:27834:1848998010304640:192.168.204.21@tcp:105: 00010000:00010000:0.0:1763343039.638601:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343039.638701:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2432:x1848997993676288:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 4533us (4981us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.638708:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.638713:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3171 00000100:00100000:1.0:1763343039.638847:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993676544 00000100:00100000:1.0:1763343039.638857:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993676544 00000100:00100000:2.0:1763343039.638858:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993676800 00000100:00100000:2.0:1763343039.638862:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993676800 00000100:00100000:2.0:1763343039.638906:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3281 00000100:00100000:1.0:1763343039.638914:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6790 00000100:00100000:2.0:1763343039.638916:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56932:x1848997993676800:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343039.638920:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:55941:x1848997993676544:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343039.638937:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.638964:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405986400/0x607405d401ae873e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9cf1 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343039.638991:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343039.639014:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.639016:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.639027:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405986400/0x607405d401ae873e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cf1 expref: 21 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.639042:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3405986400/0x607405d401ae873e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cf1 expref: 21 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.639056:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405986400, rc 0) 00000100:00100000:1.0:1763343039.639090:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:55941:x1848997993676544:12345-192.168.204.21@tcp:101:bash.0 Request processed in 170us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343039.639096:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6790 00000100:00100000:2.0:1763343039.639144:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56932:x1848997993676800:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 229us (435us total) trans 8589940240 rc 0/0 00000100:00100000:2.0:1763343039.639153:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3281 00000100:00100000:2.0:1763343039.648088:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.648154:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.648354:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993677056 00000100:00100000:0.0:1763343039.648370:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993677056 00002000:00010000:0.0:1763343039.648429:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/709 (0->18446744073709551615) 00002000:00100000:0.0:1763343039.648436:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406649180 with x1848997993677056 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343039.648453:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3406649180. 00000100:00100000:0.0:1763343039.648487:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993676928 00000100:00100000:0.0:1763343039.648491:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993676928 00002000:00010000:0.0:1763343039.648506:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/707 (0->18446744073709551615) 00002000:00100000:0.0:1763343039.648509:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340664ad80 with x1848997993676928 ext(0->18446744073709551615) 00000100:00100000:2.0:1763343039.648515:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1646 00002000:00010000:0.0:1763343039.648517:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340664ad80. 00000100:00100000:2.0:1763343039.648529:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993677056:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:0.0:1763343039.648543:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1647 00000100:00100000:0.0:1763343039.648548:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993676928:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343039.648779:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2c5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343039.648779:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343039.648784:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2c5:0x0] updating lvb mtime from disk: 0 -> 1763343039 00002000:00010000:0.0:1763343039.648784:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb mtime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343039.648787:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2c5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343039.648787:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343039.648790:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2c5:0x0] updating lvb ctime from disk: 0 -> 1763343039 00002000:00010000:0.0:1763343039.648790:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb ctime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343039.648793:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2c5:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1763343039.648793:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343039.649782:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993677056:12345-192.168.204.21@tcp:10:bash.0 Request processed in 1249us (1704us total) trans 17179871712 rc 0/0 00000100:00100000:2.0:1763343039.649795:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1646 00002000:00010000:2.0:1763343039.649801:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/709 (0->18446744073709551615) 00002000:00100000:2.0:1763343039.649805:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406649180 with x1848997993677056 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343039.649813:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3406649180. 00000100:00100000:0.0:1763343039.650015:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993676928:12345-192.168.204.21@tcp:10:bash.0 Request processed in 1463us (1857us total) trans 21474839009 rc 0/0 00000100:00100000:0.0:1763343039.650022:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1647 00002000:00010000:0.0:1763343039.650026:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/707 (0->18446744073709551615) 00002000:00100000:0.0:1763343039.650029:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340664ad80 with x1848997993676928 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343039.650035:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340664ad80. 00000100:00100000:3.0:1763343039.656313:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.656313:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.656829:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993677312 00000100:00100000:0.0:1763343039.656854:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993677312 00000100:00100000:0.0:1763343039.656935:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3282 00000100:00100000:0.0:1763343039.656947:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:55941:x1848997993677312:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343039.657549:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993677312:12345-192.168.204.21@tcp:35:bash.0 Request processed in 601us (1247us total) trans 8589940241 rc 0/0 00000100:00100000:0.0:1763343039.657560:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3282 00000100:00100000:1.0:1763343039.657695:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993677568 00000100:00100000:1.0:1763343039.657701:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993677568 00000100:00100000:1.0:1763343039.657744:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9610 00000100:00100000:1.0:1763343039.657752:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56933:x1848997993677568:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343039.657765:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.657794:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae8745 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9cf8 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.657897:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae874c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.657915:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae874c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.657928:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae874c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343039.657945:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f9:0x0]: returning size 5 00010000:00010000:1.0:1763343039.658024:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae8745 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cf8 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.658042:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae874c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cf8 expref: 264 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.658052:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:1.0:1763343039.658055:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763343039.658060:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405987600, rc 0) 00000100:00100000:1.0:1763343039.658524:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56933:x1848997993677568:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 769us (2223us total) trans 8589940242 rc 0/0 00000100:00100000:1.0:1763343039.658534:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9610 00000100:00100000:0.0:1763343039.662006:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.662171:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993677824 00000100:00100000:1.0:1763343039.662185:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993677824 00000100:00100000:1.0:1763343039.662252:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9611 00000100:00100000:1.0:1763343039.662262:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56933:x1848997993677824:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343039.662292:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.662335:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae875a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9cff expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.662562:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.662581:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8729 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ce3 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.662591:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.662658:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8729 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ce3 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.662673:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8729 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ce3 expref: 265 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343039.662689:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010304768:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343039.662797:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343039.668942:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.669722:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993678080 00000100:00100000:0.0:1763343039.669734:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993678080 00000100:00100000:1.0:1763343039.670121:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010304768:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343039.670161:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343039.670717:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3283 00000100:00100000:2.0:1763343039.670737:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56934:x1848997993678080:12345-192.168.204.21@tcp:35:rm.0 00000100:00100000:2.0:1763343039.671145:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56934:x1848997993678080:12345-192.168.204.21@tcp:35:rm.0 Request processed in 414us (2218us total) trans 8589940243 rc 0/0 00000100:00100000:2.0:1763343039.671154:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3283 00000100:00100000:3.0:1763343039.671381:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.671881:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993678208 00000100:00100000:0.0:1763343039.671891:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993678208 00010000:00010000:0.0:1763343039.671926:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8729 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ce3 expref: 267 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:0.0:1763343039.671956:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3172 00000100:00100000:0.0:1763343039.671964:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:2430:x1848997993678208:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343039.671979:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343039.671986:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8729 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ce3 expref: 267 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.672007:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8729 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ce3 expref: 267 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.672037:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8729 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ce3 expref: 267 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.672056:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:0.0:1763343039.672062:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.672074:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.672083:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.672111:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343039.672152:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:2430:x1848997993678208:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 188us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.672160:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3172 00010000:00010000:1.0:1763343039.672406:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.672417:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343039.672447:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f9:0x0]: returning size 5 00010000:00010000:1.0:1763343039.672592:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae875a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cff expref: 267 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.672611:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cff expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.673096:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:1.0:1763343039.673101:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763343039.673105:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a5fe00, rc 0) 00000100:00100000:1.0:1763343039.673173:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56933:x1848997993677824:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 10910us (11182us total) trans 8589940244 rc 0/0 00000100:00100000:1.0:1763343039.673186:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9611 00000100:00100000:1.0:1763343039.674484:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.675448:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993678592 00000100:00100000:1.0:1763343039.675465:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993678592 00000100:00100000:1.0:1763343039.677678:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9612 00000100:00100000:1.0:1763343039.677710:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56934:x1848997993678592:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:1.0:1763343039.677794:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343039.677834:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae874c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cf8 expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.677875:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae86ce lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cd5 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.677892:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8696 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cc7 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.677906:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:1.0:1763343039.677913:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343039.677957:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae876f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.677975:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae876f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.677987:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae876f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.678006:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8776 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.678019:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8776 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.678025:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8776 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.678131:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.678144:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cff expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.678154:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.678204:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cff expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.678220:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cff expref: 263 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343039.678239:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010304896:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343039.678385:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b600 going to sleep for 11 seconds 00000100:00100000:1.0:1763343039.680172:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.681874:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993678720 00000100:00100000:0.0:1763343039.681896:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993678720 00000100:00100000:0.0:1763343039.681997:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9613 00000100:00100000:0.0:1763343039.682011:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56933:x1848997993678720:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343039.682045:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.682074:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8784 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d06 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.682209:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae878b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.682227:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.682235:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae878b lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.682257:0:10041:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343039.683606:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae878b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:1.0:1763343039.685851:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010304896:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343039.685894:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343039.687123:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.687283:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993678848 00000100:00100000:1.0:1763343039.687297:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993678848 00010000:00010000:1.0:1763343039.687348:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cff expref: 266 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343039.687731:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3173 00000100:00100000:1.0:1763343039.687744:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:2429:x1848997993678848:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343039.687764:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343039.687773:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cff expref: 266 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343039.687787:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cff expref: 266 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343039.687816:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8761 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cff expref: 266 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343039.687836:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:1.0:1763343039.687851:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.687862:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.687870:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.687878:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae878b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.687885:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae878b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.687894:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae878b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.687919:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343039.688001:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:2429:x1848997993678848:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 259us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343039.688009:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3173 00010000:00010000:2.0:1763343039.688077:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688086:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00000004:00080000:2.0:1763343039.688448:0:28422:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1f9:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1763343039.688559:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688572:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688578:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688583:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403a85200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.688587:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688594:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688604:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:2.0:1763343039.688607:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343039.688610:0:28422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae878b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.688643:0:28422:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae878b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.688651:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae878b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.688679:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688687:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae877d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688702:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae876f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688709:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae876f lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688716:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae876f lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688721:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405987a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343039.688724:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae876f lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688731:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae876f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688738:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289100) 00010000:00010000:2.0:1763343039.688741:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343039.688744:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae876f lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688750:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae876f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:2.0:1763343039.688767:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009e8a085a reply state 0000000047b11c07 transno 8589940245 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8776 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688778:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8776 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.688784:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289500) 00010000:00010000:2.0:1763343039.688787:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343039.688790:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343039.688861:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56934:x1848997993678592:12345-192.168.204.21@tcp:36:rm.0 Request processed in 11166us (14388us total) trans 8589940245 rc 0/0 00000100:00100000:2.0:1763343039.688870:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9612 00010000:00010000:0.0:1763343039.689039:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae878b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.689048:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae878b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343039.689082:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f9:0x0]: returning size 5 00000004:00200000:0.0:1763343039.689087:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343039.689105:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae878b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.689138:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8784 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d06 expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.689156:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae878b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d06 expref: 265 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.689164:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:0.0:1763343039.689166:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343039.689169:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:0.0:1763343039.689213:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56933:x1848997993678720:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 7206us (9055us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.689220:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9613 00000100:00100000:3.0:1763343039.699242:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.701425:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993679104 00000100:00100000:0.0:1763343039.701449:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993679104 00000100:00100000:0.0:1763343039.701548:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9614 00000100:00100000:0.0:1763343039.701560:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56933:x1848997993679104:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343039.701597:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.701650:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8792 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d0d expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.701801:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8799 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.701819:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8799 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.701832:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8799 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343039.701857:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f9:0x0]: returning size 5 00010000:00010000:0.0:1763343039.702008:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8792 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d0d expref: 268 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.702032:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8799 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d0d expref: 267 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.702042:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:0.0:1763343039.702046:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343039.702050:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:0.0:1763343039.702140:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56933:x1848997993679104:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 581us (2916us total) trans 8589940246 rc 0/0 00000100:00100000:0.0:1763343039.702148:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9614 00000100:00100000:1.0:1763343039.710022:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1848998010305152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1763343039.710122:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343039.710188:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343039.710196:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1848998010305024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1763343039.710223:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343039.710300:0:8851:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010305152 00000100:00100000:0.0:1763343039.710311:0:8851:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010305152 00000100:00100000:0.0:1763343039.710386:0:8851:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010305024 00000100:00100000:0.0:1763343039.710390:0:8851:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010305024 00000100:00100000:0.0:1763343039.710415:0:8851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:0.0:1763343039.710424:0:8851:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1848998010305152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1763343039.710465:0:8851:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 28672 granted 484927680 pending 0 free 3920240640 avail 3688718336 00000100:00100000:0.0:1763343039.710520:0:8851:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1848998010305152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.710528:0:8851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:0.0:1763343039.710548:0:8851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1763343039.710555:0:8851:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1848998010305024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1763343039.710565:0:8851:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484927680 pending 28672 free 3919175680 avail 3687624704 00000100:00100000:0.0:1763343039.710594:0:8851:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1848998010305024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.710600:0:8851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00080000:1.0:1763343039.711145:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1763343039.711152:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1763343039.711208:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1848998010305024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1763343039.711224:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340664aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1848998010305152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1763343039.711594:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.711682:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.711753:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993679232 00000100:00100000:3.0:1763343039.711762:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993679232 00000100:00100000:3.0:1763343039.711815:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6791 00000100:00100000:3.0:1763343039.711825:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993679232:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:3.0:1763343039.711885:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3500031600/0x607405d401ae87a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.711908:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 13 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.711916:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343039.711918:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343039.711923:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3500031600/0x607405d401ae87a7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.711963:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 13 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.711979:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 13 pid: 28993 timeout: 1333 lvb_type: 0 00000100:00100000:3.0:1763343039.712001:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010305280:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343039.712096:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35085190c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343039.712171:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993679360 00000100:00100000:1.0:1763343039.712175:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993679360 00000100:00100000:1.0:1763343039.712224:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9615 00000100:00100000:1.0:1763343039.712232:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56935:x1848997993679360:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343039.712251:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.712287:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae87ae lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d14 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.712367:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae87b5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712385:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae87b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712399:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae87b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712410:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87bc lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712418:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712425:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712475:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae87b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712483:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae87b5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712490:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae87b5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712496:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405987a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.712501:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae87b5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712509:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae87b5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712523:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343039.712527:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.712533:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae87b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712539:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae87b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712553:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712559:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712565:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712570:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405987600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.712573:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712579:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712586:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289500) 00010000:00010000:1.0:1763343039.712588:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.712591:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87bc lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712597:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87bc lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.712657:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae87ae lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d14 expref: 268 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.712667:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343039.712670:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.712674:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae87ae lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d14 expref: 268 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.712687:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a85200, rc 0) 00000100:00100000:1.0:1763343039.712726:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56935:x1848997993679360:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 494us (1043us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343039.712733:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9615 00000100:00100000:3.0:1763343039.715862:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010305280:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343039.715902:0:15756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3500031600/0x607405d401ae87a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343039.716567:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.716697:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993679488 00000100:00100000:0.0:1763343039.716708:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993679488 00002000:00100000:0.0:1763343039.716767:0:28424:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x2c3:0x0] (0->4) req@ffff9a340664b800 x1848997993679488/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:535/0 lens 496/0 e 0 to 0 dl 1763343050 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343039.716779:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340664b800 with x1848997993679488 ext(0->4) 00010000:00010000:0.0:1763343039.716788:0:28424:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 14 pid: 28993 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.716810:0:28424:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 14 pid: 28993 timeout: 1333 lvb_type: 0 00002000:00010000:0.0:1763343039.716820:0:28424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a340664b800 00000100:00100000:0.0:1763343039.716859:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 111 00000100:00100000:0.0:1763343039.716870:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993679488:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:0.0:1763343039.723790:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993679488:12345-192.168.204.21@tcp:4:bash.0 Request processed in 6899us (7204us total) trans 21474839010 rc 0/0 00000100:00100000:0.0:1763343039.723813:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 111 00002000:00100000:0.0:1763343039.723835:0:28424:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x2c3:0x0] (0->4) req@ffff9a340664b800 x1848997993679488/t21474839010(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:535/0 lens 496/448 e 0 to 0 dl 1763343050 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763343039.723857:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340664b800 with x1848997993679488 ext(0->4) 00010000:00010000:0.0:1763343039.723871:0:28424:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 16 pid: 28993 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.723895:0:28424:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 16 pid: 28993 timeout: 1333 lvb_type: 0 00002000:00010000:0.0:1763343039.723903:0:28424:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a340664b800 00000100:00100000:2.0:1763343039.726143:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.726258:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.726824:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993679616 00000100:00100000:1.0:1763343039.726850:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993679616 00010000:00010000:1.0:1763343039.726907:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 16 pid: 28993 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343039.726962:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3174 00000100:00100000:1.0:1763343039.726974:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35084c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2431:x1848997993679616:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343039.726994:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763343039.727019:0:6509:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1763343039.727023:0:6509:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763343039.727030:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 16 pid: 28993 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343039.727044:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 16 pid: 28993 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343039.727072:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c200/0x607405d401ae870d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cdc expref: 16 pid: 28993 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343039.727091:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.727094:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.727101:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3500031600/0x607405d401ae87a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.727112:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3500031600/0x607405d401ae87a7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.727153:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343039.727235:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35084c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2431:x1848997993679616:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 262us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343039.727243:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3174 00010000:00010000:3.0:1763343039.727468:0:15756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3500031600/0x607405d401ae87a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.727480:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3500031600/0x607405d401ae87a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.727505:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3500031600/0x607405d401ae87a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.727515:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3500031600/0x607405d401ae87a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.727524:0:15756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3500031600/0x607405d401ae87a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.727532:0:15756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3500031600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343039.727536:0:15756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3500031600/0x607405d401ae87a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.727553:0:15756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3500031600/0x607405d401ae87a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.727566:0:15756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3500031600/0x607405d401ae87a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.727574:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3500031600/0x607405d401ae87a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.727682:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993679232:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 15858us (16091us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.727691:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6791 00000100:00100000:3.0:1763343039.728813:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993679744 00000100:00100000:3.0:1763343039.728825:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993679744 00000100:00100000:3.0:1763343039.728883:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9616 00000100:00100000:3.0:1763343039.728893:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56935:x1848997993679744:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.728915:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.728941:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae87c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d1b expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.729023:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae87ca lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729038:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae87ca lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729051:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae87ca lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729062:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729071:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729077:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729127:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae87ca lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729134:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae87ca lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729141:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae87ca lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729148:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae87ca lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729155:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3500030e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.729159:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae87ca lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729166:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae87ca lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729177:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a000) 00010000:00010000:3.0:1763343039.729181:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.729185:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae87ca lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729192:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae87ca lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729207:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729212:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729218:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729222:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3500030000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.729225:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729231:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729238:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289500) 00010000:00010000:3.0:1763343039.729241:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.729243:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87d1 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729249:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.729276:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae87c3 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d1b expref: 268 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.729286:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a000) 00010000:00010000:3.0:1763343039.729289:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.729293:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae87c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d1b expref: 268 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.729313:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3500031400, rc 0) 00000100:00100000:3.0:1763343039.729375:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56935:x1848997993679744:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 483us (3115us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343039.729381:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9616 00000100:00100000:2.0:1763343039.732985:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.733428:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993680000 00000100:00100000:1.0:1763343039.733443:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993680000 00000100:00100000:1.0:1763343039.733520:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9617 00000100:00100000:1.0:1763343039.733532:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56933:x1848997993680000:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:1.0:1763343039.733601:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343039.733669:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae878b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d06 expref: 267 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.733694:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:1.0:1763343039.733700:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343039.733742:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87d8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.733757:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87d8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.733768:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87d8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:1.0:1763343039.734078:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1508, 88 off126976 00000004:00080000:1.0:1763343039.734089:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233401467360ns, next at 1234129958002ns, rc = 0 00000040:00080000:1.0:1763343039.734140:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1509, 88 off126976 00000004:00080000:1.0:1763343039.734146:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1233401524752ns, next at 1234129925410ns, rc = 0 00000040:00080000:1.0:1763343039.734178:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1510, 88 off127064 00000004:00080000:1.0:1763343039.734182:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1233401561280ns, next at 1234129925410ns, rc = 0 00000040:00080000:1.0:1763343039.734195:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1509, 88 off127064 00000004:00080000:1.0:1763343039.734199:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233401577918ns, next at 1234129958002ns, rc = 0 00000100:00100000:2.0:1763343039.737352:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.737475:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993680128 00000100:00100000:3.0:1763343039.737489:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993680128 00000100:00100000:3.0:1763343039.737558:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9618 00000100:00100000:3.0:1763343039.737568:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56935:x1848997993680128:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.737593:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.737666:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae87df lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d22 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.737740:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae87e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.737756:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae87e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.737767:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae87e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343039.737816:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343039.737822:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343039.737875:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae87df lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d22 expref: 270 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.737894:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae87e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d22 expref: 269 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.737910:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a800) 00010000:00010000:3.0:1763343039.737914:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343039.737918:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a5e400, rc 0) 00000100:00100000:3.0:1763343039.737999:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56935:x1848997993680128:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 432us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.738007:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9618 00000001:00080000:0.0:1763343039.742757:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940247 is committed 00000004:00080000:0.0:1763343039.742776:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 995 committed 00000004:00080000:0.0:1763343039.742796:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 994 committed 00000004:00080000:0.0:1763343039.742813:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 993 committed 00000004:00080000:0.0:1763343039.742815:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 994 committed 00010000:00010000:3.0:1763343039.742944:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8776 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.742960:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8776 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.742968:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8776 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.742975:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403a84a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.742981:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8776 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.742991:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8776 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.743012:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289500) 00010000:00010000:3.0:1763343039.743015:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.743021:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8776 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343039.743028:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8776 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343039.743353:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010305792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343039.743432:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343039.743472:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343039.743477:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010305664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343039.743497:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1763343039.743563:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000632f2f49 reply state 00000000d5739548 transno 8589940247 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87d8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.743582:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.743589:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:1.0:1763343039.743592:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763343039.743595:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1763343039.743731:0:28422:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763343039.743750:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56933:x1848997993680000:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 10217us (10774us total) trans 8589940247 rc 0/0 00000100:00100000:1.0:1763343039.743760:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9617 00010000:00010000:1.0:1763343039.743792:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.743800:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.743806:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.743811:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405987600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.743814:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.743822:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.743830:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:1.0:1763343039.743832:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343039.743835:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87d8 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343039.743851:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae87d8 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343039.744389:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010305792 00000100:00100000:2.0:1763343039.744401:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010305792 00000100:00100000:2.0:1763343039.744461:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010305664 00000100:00100000:2.0:1763343039.744465:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010305664 00000100:00100000:2.0:1763343039.744489:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6792 00000100:00100000:2.0:1763343039.744498:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3658:x1848998010305792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343039.744751:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3658:x1848998010305792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 253us (1317us total) trans 17179871713 rc 0/0 00000100:00100000:2.0:1763343039.744758:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6792 00000100:00100000:2.0:1763343039.744775:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6793 00000100:00100000:2.0:1763343039.744782:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3658:x1848998010305664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763343039.744835:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2c5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343039.744850:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2c5:0x0] updating lvb mtime from disk: 1763343039 -> 1763343039 00002000:00010000:2.0:1763343039.744853:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2c5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343039.744856:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2c5:0x0] updating lvb ctime from disk: 1763343039 -> 1763343039 00002000:00010000:2.0:1763343039.744858:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2c5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343039.744882:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3658:x1848998010305664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (1384us total) trans 17179871714 rc 0/0 00000100:00100000:2.0:1763343039.744887:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6793 00000004:00080000:2.0:1763343039.744940:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035e8700/2, rc 0, transno 17179871714 00000100:00100000:2.0:1763343039.744946:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010305664:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343039.744956:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035eb480/2, rc 0, transno 17179871713 00000100:00100000:2.0:1763343039.744960:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010305792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343039.745439:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010305536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.745488:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.745513:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343039.745518:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010305408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.745535:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.745563:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010305536 00000100:00100000:3.0:1763343039.745568:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010305536 00000100:00100000:3.0:1763343039.745681:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010305408 00000100:00100000:3.0:1763343039.745684:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010305408 00000100:00100000:3.0:1763343039.745703:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6794 00000100:00100000:3.0:1763343039.745710:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3660:x1848998010305536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.745835:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3660:x1848998010305536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (347us total) trans 21474839011 rc 0/0 00000100:00100000:3.0:1763343039.745853:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6794 00000100:00100000:3.0:1763343039.745866:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6795 00000100:00100000:3.0:1763343039.745872:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3660:x1848998010305408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.745929:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3660:x1848998010305408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (393us total) trans 21474839012 rc 0/0 00000100:00100000:3.0:1763343039.745935:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6795 00000004:00080000:3.0:1763343039.745981:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406648e00/2, rc 0, transno 21474839012 00000100:00100000:3.0:1763343039.745986:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010305408:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343039.745993:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340664aa00/2, rc 0, transno 21474839011 00000100:00100000:3.0:1763343039.745996:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340664aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010305536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343039.751913:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.752075:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993680256 00000100:00100000:3.0:1763343039.752092:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993680256 00000100:00100000:3.0:1763343039.752175:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9619 00000100:00100000:3.0:1763343039.752189:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56933:x1848997993680256:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.752226:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.752259:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae87ed lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d29 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.752345:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae87ed lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d29 expref: 259 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.752366:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae87ed lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d29 expref: 259 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.752388:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:3.0:1763343039.752392:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343039.752397:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3500030600, rc 0) 00000100:00100000:3.0:1763343039.752480:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56933:x1848997993680256:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 294us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.752489:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9619 00000100:00100000:2.0:1763343039.754894:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.755660:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993680384 00000100:00100000:3.0:1763343039.755675:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993680384 00000100:00100000:3.0:1763343039.755739:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9620 00000100:00100000:3.0:1763343039.755750:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56935:x1848997993680384:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.755774:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.755801:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae87f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d30 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.755907:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87fb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.755925:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.755938:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.755955:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae8802 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.755962:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae8802 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.755967:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae8802 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756017:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87fb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756024:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87fb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756031:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756037:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87fb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756044:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3500030000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.756049:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87fb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756058:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87fb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756076:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a800) 00010000:00010000:3.0:1763343039.756080:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.756085:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87fb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756091:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030000/0x607405d401ae87fb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756105:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae8802 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756110:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae8802 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756115:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae8802 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756120:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3500030e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.756123:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae8802 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756128:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae8802 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756134:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873a000) 00010000:00010000:3.0:1763343039.756137:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.756139:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae8802 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756145:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030e00/0x607405d401ae8802 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.756180:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae87f4 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d30 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.756191:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a800) 00010000:00010000:3.0:1763343039.756194:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.756198:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031400/0x607405d401ae87f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d30 expref: 260 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.756209:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3500031400, rc 0) 00000100:00100000:3.0:1763343039.756284:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56935:x1848997993680384:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 535us (1403us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343039.756293:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9620 00000100:00100000:1.0:1763343039.756509:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.756822:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993680512 00000100:00100000:2.0:1763343039.756830:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993680512 00000100:00100000:2.0:1763343039.756888:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9621 00000100:00100000:2.0:1763343039.756897:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56933:x1848997993680512:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343039.756910:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.756925:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8809 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d37 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.756987:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8810 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.757000:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8810 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.757010:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8810 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343039.757059:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f9:0x0]: returning size 5 00000004:00200000:2.0:1763343039.757064:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343039.757086:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8810 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343039.757112:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8809 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d37 expref: 261 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.757129:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8810 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d37 expref: 260 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.757141:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:2.0:1763343039.757144:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763343039.757146:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c200, rc 0) 00000100:00100000:2.0:1763343039.757190:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56933:x1848997993680512:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 295us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.757196:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9621 00000100:00100000:1.0:1763343039.761286:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.761339:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.761407:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993680896 00000100:00100000:2.0:1763343039.761421:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993680896 00000100:00100000:2.0:1763343039.761494:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6796 00000100:00100000:2.0:1763343039.761506:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993680896:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343039.761532:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.761560:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8817 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d45 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343039.761592:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c3:0x0] initial LVB size: 5, mtime: 0x691a7abf, atime: 0x0, ctime: 0x691a7abf, blocks: 0x8 00010000:00010000:2.0:1763343039.761662:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.761665:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.761679:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8817 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d45 expref: 15 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343039.761701:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8817 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d45 expref: 15 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343039.761719:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352de00, rc 0) 00000100:00100000:2.0:1763343039.761798:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993680896:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 294us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.761811:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6796 00000100:00100000:3.0:1763343039.762788:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993680768 00000100:00100000:3.0:1763343039.762801:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993680768 00000100:00100000:3.0:1763343039.762872:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9622 00000100:00100000:3.0:1763343039.762882:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56935:x1848997993680768:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.762903:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.762906:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763343039.762938:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae87e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d22 expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.762961:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a800) 00010000:00010000:3.0:1763343039.762973:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343039.762989:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031600/0x607405d401ae881e lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d3e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.763115:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae8825 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763130:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae8825 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763142:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae8825 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763154:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae882c lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763160:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae882c lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763166:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae882c lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763738:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8833 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763750:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8833 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763759:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8833 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343039.763769:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fa:0x0]: returning size 0 00010000:00010000:3.0:1763343039.763797:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae8825 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763804:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae8825 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763810:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae8825 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763816:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae8825 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763822:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501480a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.763826:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae8825 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763832:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae8825 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763850:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a200) 00010000:00010000:3.0:1763343039.763853:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.763856:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae8825 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763862:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480a00/0x607405d401ae8825 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:3.0:1763343039.763874:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e9eba0f7 reply state 000000003e896d1e transno 8589940248 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae882c lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763884:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae882c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.763890:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873ab00) 00010000:00010000:3.0:1763343039.763892:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343039.763895:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343039.763926:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500031600/0x607405d401ae881e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d3e expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.763947:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8833 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d3e expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.763955:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a353873a400) 00010000:00010000:3.0:1763343039.763958:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343039.763960:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480600, rc 0) 00000100:00100000:3.0:1763343039.764041:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56935:x1848997993680768:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1160us (2770us total) trans 8589940248 rc 0/0 00000100:00100000:3.0:1763343039.764051:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9622 00000100:00100000:1.0:1763343039.770874:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.771009:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993681152 00000100:00100000:3.0:1763343039.771024:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993681152 00000100:00100000:3.0:1763343039.771105:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9623 00000100:00100000:3.0:1763343039.771117:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56935:x1848997993681152:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.771151:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.771181:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae8841 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d4c expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.771488:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8848 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.771509:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8833 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d3e expref: 263 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.771520:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8848 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.771567:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8833 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d3e expref: 263 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.771583:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8833 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d3e expref: 263 pid: 6525 timeout: 1333 lvb_type: 0 00000100:00100000:3.0:1763343039.771599:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010305920:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343039.774530:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343039.782021:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010305920:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343039.782064:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8848 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:1.0:1763343039.784088:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.784211:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993681280 00000100:00100000:0.0:1763343039.784226:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993681280 00010000:00010000:0.0:1763343039.784296:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8833 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d3e expref: 264 pid: 6525 timeout: 1333 lvb_type: 0 00000100:00100000:0.0:1763343039.784350:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3175 00000100:00100000:0.0:1763343039.784361:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:2430:x1848997993681280:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343039.784383:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343039.784391:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8833 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d3e expref: 264 pid: 6525 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.784406:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8833 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d3e expref: 264 pid: 6525 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.784436:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480600/0x607405d401ae8833 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d3e expref: 264 pid: 6525 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343039.784457:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a353873a400) 00010000:00010000:0.0:1763343039.784465:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8848 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.784476:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8848 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.784486:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8848 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.784525:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343039.784602:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:2430:x1848997993681280:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 242us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.784616:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3175 00010000:00010000:3.0:1763343039.784997:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8848 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.785007:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8848 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343039.785040:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fa:0x0]: returning size 0 00000004:00080000:3.0:1763343039.785300:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2c7:0x0], index 1: 0 00000004:00080000:3.0:1763343039.785309:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2c5:0x0], index 0: 0 00000004:00080000:3.0:1763343039.785316:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2c6:0x0], index 0: 0 00000004:00080000:3.0:1763343039.785321:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2c8:0x0], index 1: 0 00010000:00010000:3.0:1763343039.785463:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8848 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.785472:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8848 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.785480:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8848 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.785487:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403a5fe00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.785493:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8848 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.785501:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8848 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.785516:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a353873a400) 00010000:00010000:3.0:1763343039.785519:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343039.785524:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8848 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.785535:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8848 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343039.785598:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae8841 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d4c expref: 263 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.785608:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a353873a400) 00010000:00010000:3.0:1763343039.785611:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343039.785614:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501480e00/0x607405d401ae8841 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d4c expref: 263 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.785683:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3501480e00, rc 0) 00000100:00100000:3.0:1763343039.785750:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56935:x1848997993681152:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 14635us (14896us total) trans 8589940249 rc 301/301 00000100:00100000:3.0:1763343039.785758:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9623 00000100:00100000:2.0:1763343039.790484:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.791699:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993681536 00000100:00100000:0.0:1763343039.791719:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993681536 00000100:00100000:0.0:1763343039.791802:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3284 00000100:00100000:0.0:1763343039.791815:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56935:x1848997993681536:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343039.792236:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56935:x1848997993681536:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 422us (1769us total) trans 8589940250 rc 0/0 00000100:00100000:0.0:1763343039.792245:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3284 00000100:00100000:2.0:1763343039.795120:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.795616:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993681792 00000100:00100000:3.0:1763343039.795694:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993681792 00000100:00100000:2.0:1763343039.795991:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3285 00000100:00100000:2.0:1763343039.796004:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56935:x1848997993681792:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343039.796776:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56935:x1848997993681792:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 769us (1664us total) trans 8589940251 rc 0/0 00000100:00100000:2.0:1763343039.796789:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3285 00000100:00100000:3.0:1763343039.801572:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.801978:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993682048 00000100:00100000:1.0:1763343039.801994:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993682048 00000100:00100000:1.0:1763343039.802074:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9624 00000100:00100000:1.0:1763343039.802086:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993682048:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343039.802119:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.802153:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae8856 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d53 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.802351:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae885d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802369:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae885d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802384:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae885d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802397:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae8864 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802405:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae8864 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802412:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae8864 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802485:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae886b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802493:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae886b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802499:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae886b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343039.802512:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fa:0x0]: returning size 0 00010000:00010000:1.0:1763343039.802658:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae885d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802667:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae885d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802677:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae885d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802684:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae885d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802691:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405987000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.802696:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae885d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802704:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae885d lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802718:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343039.802722:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.802727:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae885d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802734:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae885d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802750:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae8864 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802757:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae8864 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802764:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae8864 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802769:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405987a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.802773:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae8864 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802783:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae8864 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802791:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873ab00) 00010000:00010000:1.0:1763343039.802794:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.802797:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae8864 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802804:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987a00/0x607405d401ae8864 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.802859:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae8856 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d53 expref: 267 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.802881:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae886b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d53 expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.802890:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a3510289000) 00010000:00010000:1.0:1763343039.802892:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343039.802895:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a84a00, rc 0) 00000100:00100000:1.0:1763343039.802992:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:55941:x1848997993682048:12345-192.168.204.21@tcp:101:bash.0 Request processed in 907us (1436us total) trans 8589940252 rc 0/0 00000100:00100000:1.0:1763343039.803003:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9624 00000100:00100000:1.0:1763343039.806532:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.806910:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993682176 00000100:00100000:2.0:1763343039.806926:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993682176 00000100:00100000:2.0:1763343039.807010:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9625 00000100:00100000:2.0:1763343039.807025:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:55941:x1848997993682176:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343039.807059:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.807089:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8879 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d5a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.807138:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8880 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.807156:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8880 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.807171:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8880 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.807479:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8879 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d5a expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.807506:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8880 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d5a expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.807517:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a3510289000) 00010000:00010000:2.0:1763343039.807520:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343039.807525:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d800, rc 0) 00000100:00100000:2.0:1763343039.807858:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:55941:x1848997993682176:12345-192.168.204.21@tcp:101:bash.0 Request processed in 835us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.807867:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9625 00000100:00100000:0.0:1763343039.811041:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.811363:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993682432 00000100:00100000:2.0:1763343039.811378:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993682432 00000100:00100000:2.0:1763343039.811461:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9626 00000100:00100000:2.0:1763343039.811473:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:55941:x1848997993682432:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:2.0:1763343039.811546:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343039.811581:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae886b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d53 expref: 267 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.811605:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a3510289000) 00010000:00010000:2.0:1763343039.811611:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343039.811899:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8887 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.811916:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8887 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.811927:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8887 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:2.0:1763343039.811989:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940253 00000004:00010000:2.0:1763343039.812018:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002e614f29 reply state 00000000f07d47cd transno 8589940254 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8887 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.812033:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8887 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.812038:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a3510289000) 00010000:00010000:2.0:1763343039.812041:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343039.812045:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343039.812171:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:55941:x1848997993682432:12345-192.168.204.21@tcp:36:bash.0 Request processed in 698us (1142us total) trans 8589940254 rc 0/0 00000100:00100000:2.0:1763343039.812180:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9626 00000020:00080000:2.0:1763343039.812187:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343039.822850:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.822987:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993682560 00000100:00100000:1.0:1763343039.823002:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993682560 00000100:00100000:1.0:1763343039.823088:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9627 00000100:00100000:1.0:1763343039.823102:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:55941:x1848997993682560:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343039.823138:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.823167:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae888e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d61 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.823251:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae888e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d61 expref: 270 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.823269:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae888e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d61 expref: 270 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.823292:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a3510289000) 00010000:00010000:1.0:1763343039.823296:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343039.823300:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a85200, rc 0) 00000100:00100000:1.0:1763343039.823382:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:55941:x1848997993682560:12345-192.168.204.21@tcp:101:bash.0 Request processed in 284us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343039.823392:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9627 00000100:00100000:0.0:1763343039.828596:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.830382:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993682816 00000100:00100000:1.0:1763343039.830404:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993682816 00000100:00100000:2.0:1763343039.831730:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9628 00000100:00100000:2.0:1763343039.831761:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:55941:x1848997993682816:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343039.831794:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.831799:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343039.831847:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae888e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d61 expref: 270 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.831874:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a3510289000) 00010000:00010000:2.0:1763343039.831880:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343039.831899:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8895 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d68 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.831964:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae889c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.831987:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae889c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.831997:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae889c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000040:00080000:2.0:1763343039.833506:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1511, 88 off127152 00000004:00080000:2.0:1763343039.833527:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1233500906216ns, next at 1234129925410ns, rc = 0 00000040:00080000:2.0:1763343039.834494:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1510, 88 off127152 00000004:00080000:2.0:1763343039.834510:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233501888499ns, next at 1234129958002ns, rc = 0 00000040:00080000:2.0:1763343039.834535:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1511, 88 off127240 00000004:00080000:2.0:1763343039.834540:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233501918899ns, next at 1234129958002ns, rc = 0 00000040:00080000:2.0:1763343039.834554:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1512, 88 off127240 00000004:00080000:2.0:1763343039.834557:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1233501936735ns, next at 1234129925410ns, rc = 0 00000001:00080000:0.0:1763343039.844462:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940255 is committed 00000004:00080000:0.0:1763343039.844484:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 996 committed 00000004:00080000:0.0:1763343039.844509:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 997 committed 00000004:00080000:0.0:1763343039.844529:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 996 committed 00000004:00080000:0.0:1763343039.844532:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 995 committed 00000100:00100000:2.0:1763343039.844757:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010306176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343039.844856:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343039.844905:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343039.844911:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010306048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343039.844934:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343039.844974:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010306176 00000100:00100000:2.0:1763343039.844982:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010306176 00000100:00100000:2.0:1763343039.845037:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010306048 00000100:00100000:2.0:1763343039.845040:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010306048 00000100:00100000:2.0:1763343039.845067:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6797 00000100:00100000:2.0:1763343039.845077:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3660:x1848998010306176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343039.845314:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3660:x1848998010306176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 237us (457us total) trans 17179871715 rc 0/0 00000100:00100000:2.0:1763343039.845326:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6797 00000100:00100000:2.0:1763343039.845347:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6798 00000100:00100000:2.0:1763343039.845354:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3660:x1848998010306048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343039.845432:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3660:x1848998010306048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (496us total) trans 17179871716 rc 0/0 00000100:00100000:2.0:1763343039.845438:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6798 00000004:00080000:2.0:1763343039.845489:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406551880/2, rc 0, transno 17179871716 00000100:00100000:2.0:1763343039.845495:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010306048:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343039.845505:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406551500/2, rc 0, transno 17179871715 00000100:00100000:2.0:1763343039.845508:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010306176:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763343039.845582:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae889c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fa:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d68 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.845597:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a3510289000) 00010000:00010000:2.0:1763343039.845600:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343039.845664:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8895 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d68 expref: 264 pid: 6525 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343039.845688:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae889c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fa:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d68 expref: 263 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.845724:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a3510289000) 00010000:00010000:2.0:1763343039.845727:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343039.845730:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352dc00, rc 0) 00000100:00100000:2.0:1763343039.845783:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:55941:x1848997993682816:12345-192.168.204.21@tcp:101:bash.0 Request processed in 14037us (17202us total) trans 8589940255 rc 0/0 00000100:00100000:2.0:1763343039.845796:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9628 00000100:00100000:3.0:1763343039.846066:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010306432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.846112:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.846140:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343039.846146:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010306304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.846168:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343039.846193:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010306432 00000100:00100000:3.0:1763343039.846198:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010306432 00000100:00100000:3.0:1763343039.846230:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010306304 00000100:00100000:3.0:1763343039.846232:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010306304 00000100:00100000:3.0:1763343039.846252:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6799 00000100:00100000:3.0:1763343039.846259:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3658:x1848998010306432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.846405:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3658:x1848998010306432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (293us total) trans 21474839013 rc 0/0 00000100:00100000:3.0:1763343039.846412:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6799 00000100:00100000:3.0:1763343039.846429:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6800 00000100:00100000:3.0:1763343039.846435:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3658:x1848998010306304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343039.846501:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3658:x1848998010306304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (331us total) trans 21474839014 rc 0/0 00000100:00100000:3.0:1763343039.846506:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6800 00000004:00080000:3.0:1763343039.846549:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b5500/2, rc 0, transno 21474839014 00000100:00100000:3.0:1763343039.846554:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010306304:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343039.846561:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095b5f80/2, rc 0, transno 21474839013 00000100:00100000:3.0:1763343039.846565:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010306432:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763343039.846966:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae882c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.846978:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae882c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.846986:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae882c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.846992:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3501481200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.846997:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae882c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.847012:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae882c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.847029:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873ab00) 00010000:00010000:1.0:1763343039.847032:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.847037:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae882c lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.847043:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3501481200/0x607405d401ae882c lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.847073:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8887 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.847079:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8887 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.847084:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8887 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.847089:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.847091:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8887 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.847097:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8887 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.847104:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a3510289000) 00010000:00010000:1.0:1763343039.847107:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.847110:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8887 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.847116:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae8887 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1fa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000100:00100000:0.0:1763343039.855133:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.855183:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.855270:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993683072 00000100:00100000:1.0:1763343039.855284:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993683072 00000100:00100000:1.0:1763343039.855356:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993682944 00000100:00100000:1.0:1763343039.855359:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993682944 00000100:00100000:1.0:1763343039.855394:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6801 00000100:00100000:1.0:1763343039.855406:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:55941:x1848997993683072:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343039.855431:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.855463:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3403a85200/0x607405d401ae88a3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d6f expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343039.855493:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343039.855518:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.855521:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343039.855533:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403a85200/0x607405d401ae88a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d6f expref: 23 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.855552:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3403a85200/0x607405d401ae88a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d6f expref: 23 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.855568:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a85200, rc 0) 00000100:00100000:1.0:1763343039.855664:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:55941:x1848997993683072:12345-192.168.204.21@tcp:101:bash.0 Request processed in 260us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343039.855672:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6801 00000100:00100000:1.0:1763343039.855695:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6802 00000100:00100000:1.0:1763343039.855702:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2431:x1848997993682944:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:1.0:1763343039.855779:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2431:x1848997993682944:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 77us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343039.855787:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6802 00000100:00100000:0.0:1763343039.863185:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.863241:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.863666:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993683328 00000100:00100000:1.0:1763343039.863681:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993683328 00000100:00100000:1.0:1763343039.863848:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993683200 00000100:00100000:1.0:1763343039.863853:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993683200 00000100:00100000:2.0:1763343039.863893:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6803 00000100:00100000:2.0:1763343039.863908:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:55941:x1848997993683328:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343039.863933:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.863962:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae88aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d76 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343039.863993:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343039.864021:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.864024:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.864036:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae88aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d76 expref: 17 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.864055:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae88aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d76 expref: 17 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.864070:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c800, rc 0) 00000100:00100000:2.0:1763343039.864153:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993683328:12345-192.168.204.21@tcp:101:bash.0 Request processed in 248us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.864161:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6803 00000100:00100000:2.0:1763343039.864185:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6804 00000100:00100000:2.0:1763343039.864193:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993683200:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:2.0:1763343039.864945:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993683200:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 745us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.864956:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6804 00000100:00100000:1.0:1763343039.869214:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.869321:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.869796:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.870461:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993683584 00000100:00100000:2.0:1763343039.870479:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993683584 00002000:00010000:2.0:1763343039.870541:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/709 (0->18446744073709551615) 00002000:00100000:2.0:1763343039.870547:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b0000 with x1848997993683584 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343039.870563:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34095b0000. 00000100:00100000:2.0:1763343039.870601:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993683456 00000100:00100000:2.0:1763343039.870605:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993683456 00002000:00010000:2.0:1763343039.870646:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/711 (0->18446744073709551615) 00002000:00100000:2.0:1763343039.870649:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b3b80 with x1848997993683456 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343039.870657:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34095b3b80. 00000100:00100000:2.0:1763343039.870673:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993683712 00000100:00100000:2.0:1763343039.870677:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993683712 00000100:00100000:2.0:1763343039.870714:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1648 00000100:00100000:2.0:1763343039.870725:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993683584:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343039.870986:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2c5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343039.870990:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2c5:0x0] updating lvb mtime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343039.870993:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2c5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343039.870995:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2c5:0x0] updating lvb ctime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343039.870997:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2c5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343039.871071:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993683584:12345-192.168.204.21@tcp:10:bash.0 Request processed in 347us (1872us total) trans 21474839015 rc 0/0 00000100:00100000:2.0:1763343039.871079:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1648 00002000:00010000:2.0:1763343039.871084:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/709 (0->18446744073709551615) 00002000:00100000:2.0:1763343039.871087:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b0000 with x1848997993683584 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343039.871092:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34095b0000. 00000100:00100000:2.0:1763343039.871114:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1649 00000100:00100000:2.0:1763343039.871121:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2429:x1848997993683456:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343039.871219:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2c7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343039.871222:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2c7:0x0] updating lvb mtime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343039.871224:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2c7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343039.871226:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2c7:0x0] updating lvb ctime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343039.871228:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2c7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343039.871251:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2429:x1848997993683456:12345-192.168.204.21@tcp:10:bash.0 Request processed in 131us (1986us total) trans 17179871717 rc 0/0 00000100:00100000:2.0:1763343039.871258:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1649 00002000:00010000:2.0:1763343039.871261:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/711 (0->18446744073709551615) 00000100:00100000:3.0:1763343039.871405:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1650 00000100:00100000:3.0:1763343039.871416:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993683712:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:3.0:1763343039.871452:0:28425:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae88b1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.871469:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.871471:0:28425:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.871479:0:28425:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae88b1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.871495:0:28425:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae88b1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.871611:0:28425:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae88b1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.871637:0:28425:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae88b1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.871645:0:28425:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae88b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.871652:0:28425:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403a5e400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343039.871656:0:28425:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae88b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.871665:0:28425:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae88b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.871681:0:28425:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae88b1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.871688:0:28425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae88b1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28425 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343039.871727:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993683712:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 314us (1934us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763343039.871734:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1650 00002000:00100000:2.0:1763343039.873112:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34095b3b80 with x1848997993683456 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343039.873130:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34095b3b80. 00000100:00100000:1.0:1763343039.877050:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.877115:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993683840 00000100:00100000:2.0:1763343039.877130:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993683840 00000100:00100000:2.0:1763343039.877216:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9629 00000100:00100000:2.0:1763343039.877228:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56933:x1848997993683840:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343039.877262:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.877291:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae88b8 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d7d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.877341:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae88bf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.877359:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae88bf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.877371:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae88bf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343039.877536:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae88b8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d7d expref: 263 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.877557:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352cc00/0x607405d401ae88bf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d7d expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.877568:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:2.0:1763343039.877571:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343039.877576:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352cc00, rc 0) 00000100:00100000:2.0:1763343039.878391:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56933:x1848997993683840:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1160us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343039.878403:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9629 00000100:00100000:1.0:1763343039.879009:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.879062:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993684096 00000100:00100000:2.0:1763343039.879073:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993684096 00000100:00100000:2.0:1763343039.879126:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3286 00000100:00100000:2.0:1763343039.879135:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993684096:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:2.0:1763343039.879509:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:55941:x1848997993684096:12345-192.168.204.21@tcp:35:bash.0 Request processed in 373us (503us total) trans 8589940256 rc 0/0 00000100:00100000:2.0:1763343039.879517:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3286 00000100:00100000:1.0:1763343039.886108:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.886200:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993684224 00000100:00100000:2.0:1763343039.886215:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993684224 00000100:00100000:2.0:1763343039.886362:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1651 00000100:00100000:2.0:1763343039.886374:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993684224:12345-192.168.204.21@tcp:4:lfs.0 00002000:00010000:2.0:1763343039.886449:0:28426:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343039.886461:0:28426:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae88c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.886480:0:28426:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.886484:0:28426:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343039.886492:0:28426:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae88c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.886509:0:28426:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae88c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1763343039.894462:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871718 is committed 00000001:00080000:3.0:1763343039.894493:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871716 is committed 00002000:00010000:0.0:1763343039.894769:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2c6:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763343039.894775:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2c6:0x0] updating lvb mtime from disk: 0 -> 1763343039 00002000:00010000:0.0:1763343039.894778:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2c6:0x0] updating lvb ctime from disk: 0 -> 1763343039 00002000:00010000:0.0:1763343039.894780:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2c6:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1763343039.894798:0:28426:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae88c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.894810:0:28426:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae88c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.894820:0:28426:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae88c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.894826:0:28426:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343039.894831:0:28426:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae88c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.894852:0:28426:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae88c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.894877:0:28426:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae88c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.894885:0:28426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae88c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343039.900716:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993684224:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 14325us (14607us total) trans 17179871718 rc 0/0 00000100:00100000:0.0:1763343039.900737:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1651 00010000:00010000:2.0:1763343039.900910:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343039.907458:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.907532:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993684352 00000100:00100000:3.0:1763343039.907546:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993684352 00000100:00100000:3.0:1763343039.907643:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9630 00000100:00100000:3.0:1763343039.907655:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56936:x1848997993684352:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:3.0:1763343039.907695:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.907729:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae88cd lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d84 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.907983:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae88d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908000:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae88d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908012:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae88d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908024:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae88db lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908030:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae88db lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908036:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae88db lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908122:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae88e2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908130:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae88e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908135:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae88e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343039.908184:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fa:0x0]: returning size 5 00000004:00200000:3.0:1763343039.908189:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343039.908213:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae88e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908226:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae88e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908235:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae88d4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908241:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae88d4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908247:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae88d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908254:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae88d4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908259:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403a5fe00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.908263:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae88d4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908270:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae88d4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908283:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a400) 00010000:00010000:3.0:1763343039.908286:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.908290:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae88d4 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908295:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae88d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908311:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae88db lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908317:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae88db lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908322:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae88db lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908326:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403a84a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343039.908329:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae88db lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908333:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae88db lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908338:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873a200) 00010000:00010000:3.0:1763343039.908340:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343039.908342:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae88db lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908347:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae88db lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.908375:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae88cd lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d84 expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.908388:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae88e2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d84 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.908394:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a3510289000) 00010000:00010000:3.0:1763343039.908397:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343039.908400:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405987e00, rc 0) 00000100:00100000:3.0:1763343039.908469:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56936:x1848997993684352:12345-192.168.204.21@tcp:101:rm.0 Request processed in 816us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.908477:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9630 00000100:00100000:1.0:1763343039.912698:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.912795:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993684608 00000100:00100000:0.0:1763343039.912809:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993684608 00000100:00100000:0.0:1763343039.912890:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9631 00000100:00100000:0.0:1763343039.912901:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56936:x1848997993684608:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:0.0:1763343039.912968:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763343039.913003:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae889c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fa:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d68 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.913031:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae88e2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d84 expref: 263 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.913042:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8880 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d5a expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.913052:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a3510289000) 00010000:00010000:0.0:1763343039.913064:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343039.913096:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae88e9 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913109:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae88e9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913119:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae88e9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913129:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae88f0 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913136:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae88f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913141:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae88f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913240:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae88f7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913246:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae88f7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913255:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae88f7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000040:00080000:0.0:1763343039.913597:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1513, 64 off127304 00000040:00080000:0.0:1763343039.913662:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1512, 64 off127304 00000040:00080000:0.0:1763343039.913676:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1513, 64 off127368 00000040:00080000:0.0:1763343039.913686:0:10041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1514, 64 off127368 00010000:00010000:0.0:1763343039.913761:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae88fe lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913771:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae88fe lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913780:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae88fe lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913787:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae88fe lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913792:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae88fe lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913798:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae88fe lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913831:0:10041:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763343039.913864:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae88f7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913870:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae88f7 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913876:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae88f7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913883:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.913888:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae88f7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913895:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae88f7 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913904:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a34037c4c00) 00010000:00010000:0.0:1763343039.913907:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343039.913912:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae88f7 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.913918:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae88f7 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.914063:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae88e9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.914070:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae88e9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.914075:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae88e9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.914081:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae88e9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.914086:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.914089:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae88e9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.914095:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae88e9 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.914107:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4400) 00010000:00010000:0.0:1763343039.914110:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.914113:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae88e9 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.914118:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae88e9 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00010000:0.0:1763343039.914133:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000054b00828 reply state 0000000038ae9779 transno 8589940257 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae88f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.914144:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae88f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343039.914149:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4200) 00010000:00010000:0.0:1763343039.914151:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343039.914154:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343039.914372:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343039.914380:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae88fe lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.914387:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343039.914390:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae88fe lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.914395:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae88fe lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.914405:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fa:0x0].0x0 (ffff9a34037c4c00) 00010000:00010000:1.0:1763343039.914407:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343039.914410:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae88fe lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.914415:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae88fe lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.914432:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343039.914434:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343039.914436:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343039.914480:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56936:x1848997993684608:12345-192.168.204.21@tcp:36:rm.0 Request processed in 1577us (1795us total) trans 8589940257 rc 0/0 00000100:00100000:0.0:1763343039.914490:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9631 00000100:00100000:1.0:1763343039.938122:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.938229:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993684864 00000100:00100000:3.0:1763343039.938243:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993684864 00000100:00100000:0.0:1763343039.939049:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9632 00000100:00100000:0.0:1763343039.939067:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56933:x1848997993684864:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343039.939153:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343039.939192:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae8810 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d37 expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.939219:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:0.0:1763343039.939227:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343039.939646:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8905 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.939666:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8905 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.939679:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8905 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00010000:1.0:1763343039.939925:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007badf6db reply state 00000000d14f5a6b transno 8589940258 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8905 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.939942:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8905 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.939949:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:1.0:1763343039.939951:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343039.939954:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343039.940086:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56933:x1848997993684864:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 1023us (1977us total) trans 8589940258 rc 0/0 00000100:00100000:1.0:1763343039.940096:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9632 00000100:00100000:2.0:1763343039.945521:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.945674:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993684992 00000100:00100000:0.0:1763343039.945689:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993684992 00000100:00100000:0.0:1763343039.945758:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9633 00000100:00100000:0.0:1763343039.945770:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56937:x1848997993684992:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343039.945798:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.945829:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae890c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d8b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.945941:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8913 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.945959:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8913 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.945973:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8913 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.945984:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae891a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.945992:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae891a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.945998:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae891a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946052:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8913 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946060:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8913 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946066:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8913 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946077:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8913 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946083:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.946088:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8913 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946095:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8913 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946110:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4400) 00010000:00010000:0.0:1763343039.946114:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.946119:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8913 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946125:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8913 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946140:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae891a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946145:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae891a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946150:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae891a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946155:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.946158:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae891a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946163:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae891a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946174:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4200) 00010000:00010000:0.0:1763343039.946176:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.946179:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae891a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946184:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae891a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.946215:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae890c lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d8b expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.946225:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4400) 00010000:00010000:0.0:1763343039.946228:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.946231:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae890c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d8b expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.946245:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:0.0:1763343039.951338:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56937:x1848997993684992:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 5549us (5811us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343039.951356:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9633 00000100:00100000:0.0:1763343039.953888:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.954009:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993685120 00000100:00100000:3.0:1763343039.954028:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993685120 00000100:00100000:3.0:1763343039.954115:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6805 00000100:00100000:3.0:1763343039.954128:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:56933:x1848997993685120:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.954149:0:8410:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.954185:0:8410:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8921 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d92 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343039.954211:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c6:0x0] initial LVB size: 4096, mtime: 0x691a7abf, atime: 0x0, ctime: 0x691a7abf, blocks: 0x8 00010000:00010000:3.0:1763343039.954235:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.954238:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343039.954247:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8921 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d92 expref: 14 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.954263:0:8410:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8921 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d92 expref: 14 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.954275:0:8410:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405987a00, rc 0) 00000100:00100000:3.0:1763343039.954348:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:56933:x1848997993685120:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 223us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.954356:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6805 00000100:00100000:1.0:1763343039.954952:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.955032:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993685248 00000100:00100000:0.0:1763343039.955042:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993685248 00000100:00100000:0.0:1763343039.955100:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9634 00000100:00100000:0.0:1763343039.955109:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56937:x1848997993685248:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343039.955135:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.955160:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8928 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9d99 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.955247:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae892f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955261:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae892f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955378:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae892f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955391:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8936 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955398:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8936 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955404:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8936 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955457:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae892f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955463:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae892f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955469:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae892f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955476:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae892f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955482:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.955487:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae892f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955499:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae892f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955512:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4400) 00010000:00010000:0.0:1763343039.955515:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.955520:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae892f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955526:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae892f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955540:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8936 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955546:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8936 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955551:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8936 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955555:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343039.955558:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8936 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955562:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8936 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955567:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4200) 00010000:00010000:0.0:1763343039.955569:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.955572:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8936 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955576:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8936 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343039.955602:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8928 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d99 expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.955611:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037c4400) 00010000:00010000:0.0:1763343039.955614:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343039.955617:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8928 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d99 expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.956183:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:1.0:1763343039.956820:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56937:x1848997993685248:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1706us (1866us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343039.956830:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9634 00000100:00100000:2.0:1763343039.967728:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.967801:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343039.968204:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993685376 00000100:00100000:3.0:1763343039.968218:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993685376 00000100:00100000:3.0:1763343039.968295:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9635 00000100:00100000:3.0:1763343039.968307:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56937:x1848997993685376:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343039.968335:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343039.968367:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae893d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9da0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.968452:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8944 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.968469:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8944 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343039.968482:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8944 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343039.968537:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1763343039.968543:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1763343039.968588:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae893d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9da0 expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.968609:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8944 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9da0 expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343039.968660:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a800) 00010000:00010000:3.0:1763343039.968664:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1763343039.968669:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405987600, rc 0) 00000100:00100000:3.0:1763343039.968741:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56937:x1848997993685376:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 436us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343039.968748:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9635 00000100:00100000:0.0:1763343039.969120:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993685504 00000100:00100000:0.0:1763343039.969136:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993685504 00000100:00100000:0.0:1763343039.969212:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6806 00000100:00100000:0.0:1763343039.969223:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:56933:x1848997993685504:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343039.969244:0:8410:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343039.969265:0:8410:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae894b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9da7 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343039.969288:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343039.969308:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.969311:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343039.969319:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae894b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9da7 expref: 18 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.969334:0:8410:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae894b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9da7 expref: 18 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343039.969346:0:8410:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:0.0:1763343039.971178:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:56933:x1848997993685504:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1948us (3367us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343039.971191:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6806 00000100:00100000:2.0:1763343039.978006:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.978167:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993685632 00000100:00100000:1.0:1763343039.978178:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993685632 00000100:00100000:1.0:1763343039.978235:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9636 00000100:00100000:1.0:1763343039.978244:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56937:x1848997993685632:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343039.978263:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.978285:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8952 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9dae expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.978354:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8959 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978368:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8959 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978380:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8959 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978392:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8960 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978400:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8960 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978406:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8960 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978446:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8959 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978453:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8959 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978459:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8959 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978469:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8959 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978475:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.978480:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8959 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978487:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8959 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978498:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a800) 00010000:00010000:1.0:1763343039.978502:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.978507:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8959 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978513:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8959 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978526:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8960 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978532:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8960 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978538:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8960 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978542:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.978544:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8960 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978549:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8960 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978559:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4200) 00010000:00010000:1.0:1763343039.978561:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.978564:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8960 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978570:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8960 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343039.978592:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8952 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dae expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.978602:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a800) 00010000:00010000:1.0:1763343039.978605:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.978608:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8952 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dae expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.978617:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6600, rc 0) 00000100:00100000:1.0:1763343039.979125:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56937:x1848997993685632:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 502us (837us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343039.979135:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9636 00000100:00100000:1.0:1763343039.980728:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.980763:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343039.982937:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993685760 00000100:00100000:0.0:1763343039.982953:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993685760 00000100:00100000:3.0:1763343039.982976:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00002000:00010000:0.0:1763343039.983003:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/710 (5->18446744073709551615) 00002000:00100000:0.0:1763343039.983010:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a351fc75180 with x1848997993685760 ext(5->18446744073709551615) 00002000:00010000:0.0:1763343039.983022:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a351fc75180. 00000100:00100000:0.0:1763343039.983052:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993685888 00000100:00100000:0.0:1763343039.983057:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993685888 00002000:00010000:0.0:1763343039.983076:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/708 (0->18446744073709551615) 00002000:00100000:0.0:1763343039.983079:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a351fc77800 with x1848997993685888 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343039.983087:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a351fc77800. 00000100:00100000:3.0:1763343039.983090:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1652 00000100:00100000:3.0:1763343039.983117:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993685760:12345-192.168.204.21@tcp:10:lfs.0 00000100:00100000:1.0:1763343039.983258:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993686144 00000100:00100000:1.0:1763343039.983266:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993686144 00000100:00100000:1.0:1763343039.983326:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9637 00000100:00100000:1.0:1763343039.983339:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56937:x1848997993686144:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343039.983358:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343039.983362:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343039.983391:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8944 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9da0 expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.983412:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873a800) 00010000:00010000:1.0:1763343039.983424:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343039.983439:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae8967 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9db5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343039.983477:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1653 00000100:00100000:0.0:1763343039.983488:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993685888:12345-192.168.204.21@tcp:10:lfs.0 00010000:00010000:1.0:1763343039.983536:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae896e lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.983565:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae896e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.983578:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae896e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00002000:00010000:3.0:1763343039.983589:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2c6:0x0] updating lvb size from disk: 4096 -> 5 00010000:00010000:1.0:1763343039.983593:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8975 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00002000:00010000:3.0:1763343039.983596:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2c6:0x0] updating lvb mtime from disk: 1763343039 -> 1763343039 00002000:00010000:3.0:1763343039.983606:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2c6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343039.983615:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2c6:0x0] updating lvb ctime from disk: 1763343039 -> 1763343039 00010000:00010000:1.0:1763343039.983655:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.983665:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00002000:00010000:3.0:1763343039.983666:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2c6:0x0] updating lvb blocks from disk: 8 -> 8 00002000:00010000:0.0:1763343039.983725:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2c4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343039.983730:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2c4:0x0] updating lvb mtime from disk: 0 -> 1763343039 00002000:00010000:0.0:1763343039.983733:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2c4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343039.983735:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2c4:0x0] updating lvb ctime from disk: 0 -> 1763343039 00002000:00010000:0.0:1763343039.983738:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2c4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343039.983773:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993685760:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 665us (3051us total) trans 17179871719 rc 0/0 00000100:00100000:3.0:1763343039.983786:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1652 00002000:00010000:3.0:1763343039.983793:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/710 (5->18446744073709551615) 00002000:00100000:3.0:1763343039.983797:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a351fc75180 with x1848997993685760 ext(5->18446744073709551615) 00002000:00010000:3.0:1763343039.983806:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a351fc75180. 00000100:00100000:0.0:1763343039.983809:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993685888:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 320us (3041us total) trans 21474839016 rc 0/0 00000100:00100000:0.0:1763343039.983821:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1653 00002000:00010000:0.0:1763343039.983828:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/708 (0->18446744073709551615) 00002000:00100000:0.0:1763343039.983841:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a351fc77800 with x1848997993685888 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343039.983849:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a351fc77800. 00010000:00010000:1.0:1763343039.985184:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae897c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.985201:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae897c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.985212:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae897c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343039.985227:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fc:0x0]: returning size 0 00010000:00010000:1.0:1763343039.985253:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae896e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.985261:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae896e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.985267:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae896e lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.985273:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae896e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.985279:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343039.985283:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae896e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.985290:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae896e lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.985300:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289700) 00010000:00010000:1.0:1763343039.985303:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343039.985308:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae896e lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.985314:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae896e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:1.0:1763343039.985328:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000afe6c8ec reply state 00000000b5c27035 transno 8589940259 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.985338:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8975 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.985349:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4200) 00010000:00010000:1.0:1763343039.985352:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343039.985354:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343039.985386:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae8967 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9db5 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.985404:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae897c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9db5 expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343039.985410:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a3510289000) 00010000:00010000:1.0:1763343039.985413:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343039.985415:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3406702600, rc 0) 00000100:00100000:1.0:1763343039.989447:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56937:x1848997993686144:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6100us (6470us total) trans 8589940259 rc 0/0 00000100:00100000:1.0:1763343039.989460:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9637 00000100:00100000:0.0:1763343039.990771:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343039.990880:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993686400 00000100:00100000:1.0:1763343039.990889:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993686400 00000100:00100000:1.0:1763343039.990946:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9638 00000100:00100000:1.0:1763343039.990955:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56933:x1848997993686400:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:1.0:1763343039.991205:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae898a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.991223:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae898a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.991234:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae898a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00010000:1.0:1763343039.991334:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ac7a717e reply state 00000000fde878c2 transno 8589940260 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae898a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.991346:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae898a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343039.991353:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:1.0:1763343039.991357:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343039.991360:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343039.991459:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56933:x1848997993686400:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 505us (693us total) trans 8589940260 rc 0/0 00000100:00100000:1.0:1763343039.991466:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9638 00000100:00100000:3.0:1763343039.995215:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.998578:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993686656 00000100:00100000:2.0:1763343039.998593:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993686656 00000100:00100000:2.0:1763343039.998698:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9639 00000100:00100000:2.0:1763343039.998712:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56937:x1848997993686656:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343039.998736:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343039.998756:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae8991 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9dbc expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.998880:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8998 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.998896:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae897c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9db5 expref: 270 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.998906:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8998 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343039.998947:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae897c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9db5 expref: 270 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343039.998966:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae897c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9db5 expref: 270 pid: 6525 timeout: 1333 lvb_type: 0 00000100:00100000:2.0:1763343039.998981:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406552d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010306560:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343039.999065:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3505131780 going to sleep for 11 seconds 00000100:00100000:0.0:1763343039.999591:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343039.999691:0:8410:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993686784 00000100:00100000:2.0:1763343039.999697:0:8410:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993686784 00000100:00100000:2.0:1763343039.999743:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6807 00000100:00100000:2.0:1763343039.999750:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993686784:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:2.0:1763343039.999889:0:8410:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343039.999893:0:8410:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb mtime from disk: 1763343039 -> 1763343039 00002000:00010000:2.0:1763343039.999896:0:8410:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb atime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343039.999898:0:8410:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb ctime from disk: 1763343039 -> 1763343039 00002000:00010000:2.0:1763343039.999901:0:8410:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343039.999949:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993686784:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 199us (359us total) trans 21474839017 rc 0/0 00000100:00100000:2.0:1763343039.999957:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6807 00000100:00100000:0.0:1763343040.004016:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.004067:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.004156:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993687040 00000100:00100000:1.0:1763343040.004166:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993687040 00000100:00100000:1.0:1763343040.004226:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3287 00000100:00100000:1.0:1763343040.004237:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56933:x1848997993687040:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:1.0:1763343040.004314:0:14879:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1f9:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8799 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d0d expref: 271 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.004363:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343040.004377:0:14879:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae87ed lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d29 expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.004388:0:14879:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00000100:00100000:3.0:1763343040.004401:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993687168 00000100:00100000:3.0:1763343040.004408:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993687168 00010000:00010000:1.0:1763343040.004422:0:14879:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae87ed lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d29 expref: 272 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.004436:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae897c lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9db5 expref: 272 pid: 6525 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343040.004437:0:14879:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae87ed lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d29 expref: 272 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343040.004464:0:14879:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a351fc77b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010306688:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343040.004475:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3176 00000100:00100000:3.0:1763343040.004484:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:2430:x1848997993687168:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343040.004495:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343040.004502:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae897c lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9db5 expref: 272 pid: 6525 timeout: 1333 lvb_type: 0 00010000:00010000:3.0:1763343040.004521:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae897c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9db5 expref: 272 pid: 6525 timeout: 1333 lvb_type: 0 00010000:00010000:3.0:1763343040.004539:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a3510289000) 00000100:00100000:1.0:1763343040.004539:0:14879:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1bf00 going to sleep for 11 seconds 00010000:00010000:3.0:1763343040.004547:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8998 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.004555:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8998 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.004563:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8998 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.004580:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343040.004610:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:2430:x1848997993687168:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 127us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343040.004641:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3176 00010000:00010000:2.0:1763343040.009076:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae897c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9db5 expref: 271 pid: 6525 timeout: 1333 lvb_type: 0 00000100:00100000:2.0:1763343040.009106:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406552d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010306560:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343040.009134:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8998 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.009145:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8998 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.009152:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8998 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:2.0:1763343040.009176:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fc:0x0]: returning size 0 00000004:00080000:2.0:1763343040.009360:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2c7:0x0], index 0: 0 00000004:00080000:2.0:1763343040.009367:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2c9:0x0], index 1: 0 00000004:00080000:2.0:1763343040.009372:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2ca:0x0], index 1: 0 00000004:00080000:2.0:1763343040.009375:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2c8:0x0], index 0: 0 00010000:00010000:2.0:1763343040.009478:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8998 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.009487:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8998 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.009494:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8998 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.009501:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.009506:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8998 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.009514:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8998 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.009529:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a3510289000) 00010000:00010000:2.0:1763343040.009532:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343040.009537:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8998 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.009543:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8998 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.009592:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae8991 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dbc expref: 271 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.009603:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a3510289000) 00010000:00010000:2.0:1763343040.009606:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343040.009610:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae8991 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dbc expref: 271 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.009667:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d600, rc 0) 00000100:00100000:2.0:1763343040.009736:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56937:x1848997993686656:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 11028us (14530us total) trans 8589940261 rc 301/301 00000100:00100000:2.0:1763343040.009745:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9639 00000100:00100000:3.0:1763343040.010240:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.010325:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993687296 00000100:00100000:2.0:1763343040.010333:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993687296 00000100:00100000:1.0:1763343040.010348:0:14879:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a351fc77b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010306688:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343040.010365:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae87ed lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d29 expref: 270 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343040.010368:0:14879:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00000100:00100000:2.0:1763343040.011116:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3177 00000100:00100000:2.0:1763343040.011129:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:2430:x1848997993687296:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.011144:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.011150:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae87ed lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d29 expref: 270 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.011161:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae87ed lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d29 expref: 270 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.011179:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3500030600/0x607405d401ae87ed lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d29 expref: 270 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.011194:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:2.0:1763343040.011198:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343040.011209:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343040.011216:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343040.011247:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343040.011284:0:14879:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343040.011292:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00000100:00100000:2.0:1763343040.011473:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:2430:x1848997993687296:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 347us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.011481:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3177 00000040:00080000:1.0:1763343040.011511:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1514, 88 off127456 00000004:00080000:1.0:1763343040.011522:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233678900254ns, next at 1234129958002ns, rc = 0 00000040:00080000:1.0:1763343040.011553:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1515, 88 off127456 00000004:00080000:1.0:1763343040.011559:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1233678938713ns, next at 1234129925410ns, rc = 0 00000040:00080000:1.0:1763343040.011575:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1516, 88 off127544 00000004:00080000:1.0:1763343040.011579:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1233678958113ns, next at 1234129925410ns, rc = 0 00000040:00080000:1.0:1763343040.011588:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1515, 88 off127544 00000004:00080000:1.0:1763343040.011592:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233678971074ns, next at 1234129958002ns, rc = 0 00000100:00100000:2.0:1763343040.017584:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.017694:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993687552 00000100:00100000:3.0:1763343040.017705:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993687552 00000100:00100000:3.0:1763343040.017753:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3288 00000100:00100000:3.0:1763343040.017761:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56937:x1848997993687552:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343040.018095:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56937:x1848997993687552:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 333us (521us total) trans 8589940263 rc 0/0 00000100:00100000:3.0:1763343040.018105:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3288 00000001:00080000:0.0:1763343040.021446:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940262 is committed 00000004:00080000:0.0:1763343040.021465:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 999 committed 00000004:00080000:0.0:1763343040.021478:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 998 committed 00000004:00080000:0.0:1763343040.021493:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 997 committed 00000004:00080000:0.0:1763343040.021496:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 998 committed 00000100:00100000:0.0:1763343040.021664:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010306816:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343040.021730:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343040.021772:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343040.021778:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010306944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343040.021801:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343040.021846:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010306816 00000100:00100000:0.0:1763343040.021853:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010306816 00000100:00100000:0.0:1763343040.021895:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010306944 00000100:00100000:0.0:1763343040.021899:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010306944 00000100:00100000:0.0:1763343040.021919:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6808 00000100:00100000:0.0:1763343040.021927:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3659:x1848998010306816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343040.021953:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:711 count 1 00010000:00010000:0.0:1763343040.021980:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae89ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.022000:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3403a85200/0x607405d401ae88a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d6f expref: 14 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.022009:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343040.022012:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343040.022016:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae89ad lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.022043:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3403a85200/0x607405d401ae88a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d6f expref: 14 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.022057:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3403a85200/0x607405d401ae88a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d6f expref: 14 pid: 28995 timeout: 1333 lvb_type: 0 00000100:00100000:0.0:1763343040.022069:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010307328:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343040.022129:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f316c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343040.022147:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6809 00000100:00100000:0.0:1763343040.022155:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3659:x1848998010306944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343040.022167:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:712 count 1 00002000:00010000:0.0:1763343040.022188:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343040.022194:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae89b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.022202:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343040.022204:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343040.022208:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae89b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.022221:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae89b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.022231:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae89b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.022244:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae89b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.022259:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343040.022473:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3659:x1848998010306944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 319us (670us total) trans 17179871720 rc 0/0 00000100:00100000:0.0:1763343040.022481:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6809 00000100:00100000:0.0:1763343040.022526:0:3659:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871716 gen 2 00000004:00080000:0.0:1763343040.022531:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478fb80, transno 17179871677 00000004:00080000:0.0:1763343040.022538:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537910000, transno 17179871678 00000004:00080000:0.0:1763343040.022541:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537912680, transno 17179871679 00000004:00080000:0.0:1763343040.022544:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340a65b480, transno 17179871680 00000004:00080000:0.0:1763343040.022546:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340a659180, transno 17179871681 00000004:00080000:0.0:1763343040.022548:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340478e680, transno 17179871682 00000004:00080000:0.0:1763343040.022551:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3538755500, transno 17179871684 00000004:00080000:0.0:1763343040.022553:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3538756680, transno 17179871685 00000004:00080000:0.0:1763343040.022556:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3538757480, transno 17179871686 00000004:00080000:0.0:1763343040.022558:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3538756300, transno 17179871687 00000004:00080000:0.0:1763343040.022561:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3538755180, transno 17179871688 00000004:00080000:0.0:1763343040.022563:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3538754e00, transno 17179871689 00000004:00080000:0.0:1763343040.022566:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a353876ca80, transno 17179871692 00000004:00080000:0.0:1763343040.022569:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a353876c700, transno 17179871693 00000004:00080000:0.0:1763343040.022572:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a350121b100, transno 17179871694 00000004:00080000:0.0:1763343040.022575:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3501218000, transno 17179871695 00000004:00080000:0.0:1763343040.022577:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d10ea00, transno 17179871699 00000004:00080000:0.0:1763343040.022580:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d10f100, transno 17179871700 00000004:00080000:0.0:1763343040.022582:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d10d880, transno 17179871701 00000004:00080000:0.0:1763343040.022586:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d10c380, transno 17179871702 00000004:00080000:0.0:1763343040.022588:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537b0c380, transno 17179871703 00000004:00080000:0.0:1763343040.022590:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537b0c700, transno 17179871704 00000004:00080000:0.0:1763343040.022593:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062caa00, transno 17179871706 00000004:00080000:0.0:1763343040.022596:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062c9880, transno 17179871707 00000004:00080000:0.0:1763343040.022598:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062cb480, transno 17179871708 00000004:00080000:0.0:1763343040.022601:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062c9500, transno 17179871709 00000004:00080000:0.0:1763343040.022603:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062cbb80, transno 17179871710 00000004:00080000:0.0:1763343040.022606:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062cb100, transno 17179871711 00000004:00080000:0.0:1763343040.022609:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035eb480, transno 17179871713 00000004:00080000:0.0:1763343040.022612:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035e8700, transno 17179871714 00000004:00080000:0.0:1763343040.022614:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406551500, transno 17179871715 00000004:00080000:0.0:1763343040.022617:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406551880, transno 17179871716 00000100:00100000:0.0:1763343040.022643:0:3659:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a3537c3b100 x1848998010306944/t17179871720(17179871720) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763343056 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763343040.022654:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c3b100/2, rc 0, transno 17179871720 00000100:00100000:0.0:1763343040.022660:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010306944:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1763343040.022856:0:32357:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 4 in progress, 3 in flight, 32 done 00000004:00010000:0.0:1763343040.022991:0:14879:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d0c8b542 reply state 00000000bdf9b021 transno 8589940262 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343040.023008:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343040.023016:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:0.0:1763343040.023019:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343040.023022:0:14879:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343040.023027:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:0.0:1763343040.023030:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343040.023035:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8799 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d0d expref: 263 pid: 10041 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1763343040.023106:0:14879:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343040.023119:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56933:x1848997993687040:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 18884us (19113us total) trans 8589940262 rc 0/0 00000100:00100000:0.0:1763343040.023126:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3287 00010000:00010000:0.0:1763343040.023176:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343040.023183:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343040.023189:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343040.023195:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.023198:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343040.023205:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343040.023214:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:0.0:1763343040.023217:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343040.023220:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343040.023226:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae899f lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00000100:00100000:2.0:1763343040.023333:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010307072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343040.023367:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.023400:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343040.023406:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010307200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343040.023426:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343040.023448:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343040.023454:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae89b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.023462:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343040.023465:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae89b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.023476:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae89b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.023489:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae89b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.023495:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae89b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.023512:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.023513:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.023515:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343040.023524:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010307072 00000100:00100000:2.0:1763343040.023528:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010307072 00000100:00100000:2.0:1763343040.023561:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010307200 00000100:00100000:2.0:1763343040.023564:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010307200 00000100:00100000:2.0:1763343040.023585:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6810 00000100:00100000:2.0:1763343040.023591:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3657:x1848998010307072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763343040.023703:0:28994:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2c5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343040.023707:0:28994:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2c5:0x0] updating lvb mtime from disk: 1763343039 -> 1763343039 00002000:00010000:2.0:1763343040.023710:0:28994:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2c5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343040.023712:0:28994:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2c5:0x0] updating lvb ctime from disk: 1763343039 -> 1763343039 00002000:00010000:2.0:1763343040.023714:0:28994:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2c5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343040.023743:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010307072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 152us (376us total) trans 17179871721 rc 0/0 00000100:00100000:2.0:1763343040.023750:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6810 00000100:00100000:2.0:1763343040.023764:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6811 00000100:00100000:2.0:1763343040.023769:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3657:x1848998010307200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763343040.023818:0:28994:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2c6:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763343040.023821:0:28994:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2c6:0x0] updating lvb mtime from disk: 1763343039 -> 1763343039 00002000:00010000:2.0:1763343040.023824:0:28994:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2c6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343040.023825:0:28994:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2c6:0x0] updating lvb ctime from disk: 1763343039 -> 1763343039 00002000:00010000:2.0:1763343040.023827:0:28994:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2c6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1763343040.023865:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010307200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (438us total) trans 17179871722 rc 0/0 00000100:00100000:2.0:1763343040.023871:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6811 00000004:00080000:2.0:1763343040.023898:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c3a680/2, rc 0, transno 17179871722 00000100:00100000:2.0:1763343040.023903:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010307200:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343040.023910:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c38000/2, rc 0, transno 17179871721 00000100:00100000:2.0:1763343040.023913:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010307072:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763343040.024187:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae88f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.024199:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae88f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.024205:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae88f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.024210:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.024213:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae88f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.024219:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae88f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.024235:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4200) 00010000:00010000:3.0:1763343040.024238:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343040.024241:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae88f0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.024247:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae88f0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000100:00100000:2.0:1763343040.024251:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a351fc77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010307584:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1763343040.024265:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8905 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00000100:00100000:2.0:1763343040.024284:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343040.024285:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8905 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.024294:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8905 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.024299:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.024302:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8905 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.024308:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8905 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.024316:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00000100:00100000:2.0:1763343040.024318:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1763343040.024319:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343040.024324:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8905 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000100:00100000:2.0:1763343040.024328:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a351fc77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010307456:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1763343040.024334:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8905 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.024349:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8975 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343040.024356:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343040.024361:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8975 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.024367:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8975 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.024372:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.024376:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8975 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.024382:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8975 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343040.024383:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a351fc76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010307712:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1763343040.024397:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037c4200) 00010000:00010000:3.0:1763343040.024401:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343040.024404:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8975 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.024409:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8975 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343040.024416:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343040.024437:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae898a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343040.024438:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343040.024447:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a351fc74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010307840:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1763343040.024448:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae898a lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.024458:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae898a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.024464:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3406702000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.024468:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae898a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343040.024474:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763343040.024481:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae898a lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.024491:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:3.0:1763343040.024495:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343040.024498:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae898a lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343040.024502:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010307584 00010000:00010000:3.0:1763343040.024504:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae898a lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343040.024509:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010307584 00000100:00100000:3.0:1763343040.024530:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010307456 00000100:00100000:3.0:1763343040.024535:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010307456 00000100:00100000:2.0:1763343040.024539:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010307712 00000100:00100000:2.0:1763343040.024543:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010307712 00000100:00100000:2.0:1763343040.024563:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010307840 00000100:00100000:2.0:1763343040.024566:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010307840 00000100:00100000:2.0:1763343040.024588:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6812 00000100:00100000:2.0:1763343040.024595:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3660:x1848998010307584:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343040.024603:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6813 00002000:00080000:2.0:1763343040.024612:0:27833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:710 count 1 00000100:00100000:3.0:1763343040.024613:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e9ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3657:x1848998010307712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763343040.024678:0:27833:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343040.024685:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae89bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.024697:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.024699:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.024703:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae89bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343040.024714:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb size from disk: 5 -> 5 00010000:00010000:2.0:1763343040.024716:0:27833:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae89bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343040.024720:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb mtime from disk: 1763343039 -> 1763343039 00002000:00010000:3.0:1763343040.024726:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb atime from disk: 1763343039 -> 1763343039 00002000:00010000:3.0:1763343040.024734:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb ctime from disk: 1763343039 -> 1763343039 00010000:00010000:2.0:1763343040.024736:0:27833:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae89bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343040.024737:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2c3:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:2.0:1763343040.024748:0:27833:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae89bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.024771:0:27833:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343040.024778:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e9ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3657:x1848998010307712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 167us (364us total) trans 21474839018 rc 0/0 00000100:00100000:3.0:1763343040.024786:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6813 00000100:00100000:3.0:1763343040.024802:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6814 00000100:00100000:3.0:1763343040.024809:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3657:x1848998010307840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343040.024881:0:28993:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2c4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343040.024884:0:28993:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2c4:0x0] updating lvb mtime from disk: 1763343039 -> 1763343039 00002000:00010000:3.0:1763343040.024886:0:28993:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2c4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343040.024889:0:28993:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2c4:0x0] updating lvb ctime from disk: 1763343039 -> 1763343039 00002000:00010000:3.0:1763343040.024891:0:28993:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2c4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343040.024920:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3657:x1848998010307840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 111us (448us total) trans 21474839020 rc 0/0 00000100:00100000:3.0:1763343040.024926:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6814 00000100:00100000:3.0:1763343040.024945:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6815 00000100:00100000:2.0:1763343040.024951:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3660:x1848998010307584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 355us (666us total) trans 21474839019 rc 0/0 00000100:00100000:3.0:1763343040.024956:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3660:x1848998010307456:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343040.024969:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6812 00002000:00080000:3.0:1763343040.024973:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:709 count 1 00010000:00010000:3.0:1763343040.024986:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405987000/0x607405d401ae89c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.024992:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343040.024999:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae89bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.025000:0:28993:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae88aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d76 expref: 19 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.025017:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343040.025019:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343040.025022:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae89bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.025023:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343040.025029:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405987000/0x607405d401ae89c2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.025035:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae89bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.025050:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae89bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.025058:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d000/0x607405d401ae89bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.025059:0:28993:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae88aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d76 expref: 19 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.025080:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343040.025082:0:28993:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae88aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d76 expref: 19 pid: 27835 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.025083:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.025087:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343040.025099:0:28993:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010307968:192.168.204.21@tcp:104: 00000004:00080000:2.0:1763343040.025109:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a351fc77100/2, rc 0, transno 21474839019 00000100:00100000:2.0:1763343040.025115:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a351fc77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010307584:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343040.025159:0:28993:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c3c0 going to sleep for 11 seconds 00000004:00080000:3.0:1763343040.025212:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a351fc74000/2, rc 0, transno 21474839020 00000100:00100000:3.0:1763343040.025218:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a351fc74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010307840:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343040.025226:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a351fc76680/2, rc 0, transno 21474839018 00000100:00100000:3.0:1763343040.025230:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a351fc76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010307712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343040.028955:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.029767:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993687808 00000100:00100000:2.0:1763343040.029779:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993687808 00000100:00100000:2.0:1763343040.029853:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3289 00000100:00100000:2.0:1763343040.029863:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+258:56937:x1848997993687808:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343040.030098:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56937:x1848997993687808:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 236us (1156us total) trans 8589940264 rc 0/0 00000100:00100000:2.0:1763343040.030105:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3289 00000100:00100000:1.0:1763343040.034283:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.034422:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993687936 00000100:00100000:2.0:1763343040.034434:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993687936 00000100:00100000:2.0:1763343040.034493:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9640 00000100:00100000:2.0:1763343040.034503:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a351fc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+259:56933:x1848997993687936:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.034530:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.034552:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae89c9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9dc3 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343040.034606:0:28993:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:28993:1848998010307968:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343040.034609:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae89c9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dc3 expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.034664:0:28993:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3405987000/0x607405d401ae89c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.034677:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c200/0x607405d401ae89c9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dc3 expref: 260 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.034698:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:2.0:1763343040.034703:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343040.034707:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c200, rc 0) 00000100:00100000:0.0:1763343040.034746:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010307328:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343040.034762:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae89ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343040.034771:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a351fc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:56933:x1848997993687936:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 267us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.034781:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9640 00000100:00100000:3.0:1763343040.035500:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.035568:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993688064 00000100:00100000:2.0:1763343040.035574:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993688064 00010000:00010000:2.0:1763343040.035600:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3403a85200/0x607405d401ae88a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d6f expref: 15 pid: 28995 timeout: 1333 lvb_type: 0 00000100:00100000:2.0:1763343040.035682:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3178 00000100:00100000:2.0:1763343040.035691:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993688064:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.035704:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.035709:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3403a85200/0x607405d401ae88a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d6f expref: 15 pid: 28995 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.035722:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3403a85200/0x607405d401ae88a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d6f expref: 15 pid: 28995 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.035744:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3403a85200/0x607405d401ae88a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d6f expref: 15 pid: 28995 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.035763:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.035765:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.035769:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae89ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.035779:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae89ad lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.035805:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343040.035855:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993688064:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 165us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.035862:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3178 00010000:00010000:0.0:1763343040.035975:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae89ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.035985:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae89ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.035995:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae89ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.036004:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae89ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.036027:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343040.036259:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3659:x1848998010306816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14332us (14528us total) trans 17179871723 rc 0/0 00000100:00100000:0.0:1763343040.036268:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6808 00000004:00080000:1.0:1763343040.036320:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c39c00/2, rc 0, transno 17179871723 00000100:00100000:1.0:1763343040.036329:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010306816:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1763343040.036381:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343040.036389:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae89ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.036397:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343040.036402:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae89ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.036412:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae89ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.036424:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae89ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.036432:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176200/0x607405d401ae89ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.036448:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.036450:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.036452:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343040.037775:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.037827:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993688192 00000100:00100000:0.0:1763343040.037844:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993688192 00010000:00010000:0.0:1763343040.037880:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae88aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d76 expref: 20 pid: 27835 timeout: 1333 lvb_type: 0 00000100:00100000:0.0:1763343040.037929:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3179 00000100:00100000:0.0:1763343040.037938:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993688192:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343040.037960:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343040.037965:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae88aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d76 expref: 20 pid: 27835 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343040.037976:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae88aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d76 expref: 20 pid: 27835 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343040.037994:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae88aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d76 expref: 20 pid: 27835 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343040.038008:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343040.038010:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343040.038014:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405987000/0x607405d401ae89c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.038023:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405987000/0x607405d401ae89c2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.038052:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343040.038077:0:28993:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3405987000/0x607405d401ae89c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.038087:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405987000/0x607405d401ae89c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.038102:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405987000/0x607405d401ae89c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.038109:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405987000/0x607405d401ae89c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343040.038112:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993688192:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 174us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.038126:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3179 00010000:00010000:3.0:1763343040.038139:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343040.038362:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3660:x1848998010307456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13409us (14008us total) trans 21474839021 rc 0/0 00000100:00100000:3.0:1763343040.038373:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6815 00000004:00080000:2.0:1763343040.038404:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a351fc77b80/2, rc 0, transno 21474839021 00000100:00100000:2.0:1763343040.038413:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a351fc77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010307456:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1763343040.038504:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343040.038510:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3405987000/0x607405d401ae89c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.038518:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405987000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343040.038522:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405987000/0x607405d401ae89c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.038529:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405987000/0x607405d401ae89c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.038542:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3405987000/0x607405d401ae89c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.038550:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405987000/0x607405d401ae89c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.038571:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343040.038573:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343040.038574:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343040.041461:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.041512:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.041522:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993688448 00000100:00100000:2.0:1763343040.041535:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993688448 00000100:00100000:2.0:1763343040.041603:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9641 00000100:00100000:2.0:1763343040.041613:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+260:55941:x1848997993688448:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343040.041674:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.041698:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae89d0 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9dca expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.041851:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae89d7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.041865:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae89d7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.041877:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae89d7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.041891:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae89de lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.041897:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae89de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.041903:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae89de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.041978:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae89e5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.041987:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae89e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.041994:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae89e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343040.042005:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fc:0x0]: returning size 0 00010000:00010000:2.0:1763343040.042088:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae89d7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.042096:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae89d7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.042104:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae89d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.042110:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae89d7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.042116:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.042120:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae89d7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.042127:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae89d7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.042138:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcc00) 00010000:00010000:2.0:1763343040.042142:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.042147:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae89d7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.042153:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae89d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.042168:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae89de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.042173:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae89de lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.042179:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae89de lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.042184:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.042187:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae89de lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.042196:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae89de lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.042202:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc300) 00010000:00010000:2.0:1763343040.042205:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.042208:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae89de lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.042214:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae89de lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.042252:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae89d0 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dca expref: 263 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.042266:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae89e5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dca expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.042273:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343040.042275:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343040.042277:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352dc00, rc 0) 00000100:00100000:2.0:1763343040.042334:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:55941:x1848997993688448:12345-192.168.204.21@tcp:101:bash.0 Request processed in 723us (883us total) trans 8589940265 rc 0/0 00000100:00100000:2.0:1763343040.042341:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9641 00000100:00100000:0.0:1763343040.042434:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993688704 00000100:00100000:0.0:1763343040.042440:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993688704 00000100:00100000:0.0:1763343040.042474:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3290 00000100:00100000:0.0:1763343040.042481:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56933:x1848997993688704:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:0.0:1763343040.042656:0:6526:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1f9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343040.042706:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1516, 64 off127608 00000040:00080000:0.0:1763343040.042723:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1517, 64 off127608 00000040:00080000:0.0:1763343040.042730:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1518, 64 off127672 00000040:00080000:0.0:1763343040.042737:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1517, 64 off127672 00010000:00010000:0.0:1763343040.042769:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae89f3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.042778:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae89f3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.042785:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae89f3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.042791:0:6526:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae89f3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.042797:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae89f3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.042801:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae89f3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.042825:0:6526:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343040.042897:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343040.042904:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae89f3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343040.042916:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343040.042920:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae89f3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343040.042926:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae89f3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343040.042936:0:13198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f9:0x0].0x0 (ffff9a34039e4600) 00010000:00010000:1.0:1763343040.042940:0:13198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343040.042944:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae89f3 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343040.042950:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae89f3 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343040.042967:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343040.042969:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343040.042971:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343040.042977:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56933:x1848997993688704:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 495us (1464us total) trans 8589940266 rc 0/0 00000100:00100000:0.0:1763343040.042985:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3290 00000100:00100000:1.0:1763343040.046109:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.046189:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993688832 00000100:00100000:3.0:1763343040.046199:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993688832 00000100:00100000:3.0:1763343040.046249:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9642 00000100:00100000:3.0:1763343040.046257:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:55941:x1848997993688832:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343040.046282:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343040.046303:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae89fa lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9dd1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.046335:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae8a01 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.046348:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae8a01 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.046359:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae8a01 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.046464:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae89fa lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dd1 expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.046481:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae8a01 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dd1 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.046490:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:3.0:1763343040.046494:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343040.046497:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405987e00, rc 0) 00000100:00100000:3.0:1763343040.046553:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993688832:12345-192.168.204.21@tcp:101:bash.0 Request processed in 296us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343040.046560:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9642 00000100:00100000:1.0:1763343040.052595:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.052670:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993689088 00000100:00100000:1.0:1763343040.052671:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.052683:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993689088 00000100:00100000:0.0:1763343040.052742:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993689344 00000100:00100000:0.0:1763343040.052746:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993689344 00000100:00100000:0.0:1763343040.052779:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9643 00000100:00100000:0.0:1763343040.052790:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56933:x1848997993689088:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.052814:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.052846:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8a08 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9dd8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343040.052932:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9644 00000100:00100000:3.0:1763343040.052942:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:55941:x1848997993689344:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343040.052949:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae8a0f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343040.052965:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae8a0f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:3.0:1763343040.052975:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343040.052976:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae8a0f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:0.0:1763343040.052989:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fc:0x0]: returning size 0 00010000:00010000:3.0:1763343040.052996:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae89e5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dca expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.053014:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:3.0:1763343040.053019:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343040.053090:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8a08 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dd8 expref: 268 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.053107:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae8a0f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dd8 expref: 267 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.053114:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:0.0:1763343040.053118:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763343040.053120:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00010000:00010000:3.0:1763343040.053127:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8a1d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.053139:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8a1d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.053147:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8a1d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:0.0:1763343040.053177:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56933:x1848997993689088:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 388us (592us total) trans 8589940267 rc 0/0 00000100:00100000:0.0:1763343040.053186:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9643 00000001:00080000:3.0:1763343040.053188:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940268 00000004:00010000:3.0:1763343040.053207:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cc1538ef reply state 0000000048676644 transno 8589940269 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8a1d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.053219:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8a1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1fc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.053226:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:3.0:1763343040.053228:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343040.053232:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343040.054523:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:55941:x1848997993689344:12345-192.168.204.21@tcp:36:bash.0 Request processed in 1575us (1844us total) trans 8589940269 rc 0/0 00000100:00100000:3.0:1763343040.054533:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9644 00000020:00080000:3.0:1763343040.054540:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343040.057099:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.057159:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993689472 00000100:00100000:0.0:1763343040.057168:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993689472 00000100:00100000:0.0:1763343040.057232:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9645 00000100:00100000:0.0:1763343040.057243:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:55941:x1848997993689472:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343040.057264:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.057296:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a24 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ddf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.057353:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a24 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ddf expref: 269 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.057368:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a24 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ddf expref: 269 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.057385:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:0.0:1763343040.057389:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343040.057393:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:0.0:1763343040.057457:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:55941:x1848997993689472:12345-192.168.204.21@tcp:101:bash.0 Request processed in 215us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.057465:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9645 00000100:00100000:0.0:1763343040.057881:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.058058:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993689600 00000100:00100000:2.0:1763343040.058064:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993689600 00000100:00100000:2.0:1763343040.058103:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9646 00000100:00100000:2.0:1763343040.058111:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56933:x1848997993689600:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.058124:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.058136:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae8a2b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9de6 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.058214:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8a32 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.058225:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8a32 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.058236:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8a32 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343040.058264:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fc:0x0]: returning size 0 00000004:00200000:2.0:1763343040.058268:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343040.058299:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8a32 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.058324:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae8a2b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9de6 expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.058339:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8a32 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9de6 expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.058347:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343040.058350:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343040.058353:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d800, rc 0) 00000100:00100000:2.0:1763343040.058393:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56933:x1848997993689600:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 283us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.058399:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9646 00000100:00100000:1.0:1763343040.060764:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.060807:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.060822:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993689984 00000100:00100000:0.0:1763343040.060845:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993689984 00000100:00100000:0.0:1763343040.060904:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9647 00000100:00100000:0.0:1763343040.060914:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:55941:x1848997993689984:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343040.060932:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.060935:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343040.060962:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae8a0f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dd8 expref: 270 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.060980:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:0.0:1763343040.060985:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343040.060997:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8a39 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ded expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.061047:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.061059:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8a32 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9de6 expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.061067:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a24 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ddf expref: 270 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.061074:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.061104:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a24 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ddf expref: 270 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.061116:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a24 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ddf expref: 270 pid: 6525 timeout: 1333 lvb_type: 0 00000100:00100000:0.0:1763343040.061129:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010308096:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343040.061199:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993689728 00000100:00100000:2.0:1763343040.061205:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993689728 00010000:00010000:2.0:1763343040.061228:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a24 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ddf expref: 271 pid: 6525 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343040.061230:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8a32 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9de6 expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.061250:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8a32 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9de6 expref: 271 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:0.0:1763343040.061261:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c39180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010308224:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343040.061279:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3180 00000100:00100000:0.0:1763343040.061283:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31780 going to sleep for 11 seconds 00000100:00100000:2.0:1763343040.061290:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:2429:x1848997993689728:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.061301:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.061306:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a24 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ddf expref: 271 pid: 6525 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.061318:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a24 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ddf expref: 271 pid: 6525 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.061331:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343040.061335:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.061342:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.061347:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343040.061370:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:2429:x1848997993689728:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 84us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.061377:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3180 00000100:00100000:3.0:1763343040.062249:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.062559:0:28993:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993690112 00000100:00100000:0.0:1763343040.062567:0:28993:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993690112 00000100:00100000:2.0:1763343040.063140:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6816 00000100:00100000:2.0:1763343040.063153:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993690112:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.063168:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.063186:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8a47 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9df4 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343040.063213:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343040.063231:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.063233:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.063241:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8a47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9df4 expref: 20 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343040.063255:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8a47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9df4 expref: 20 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343040.063274:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d400, rc 0) 00000100:00100000:2.0:1763343040.063326:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993690112:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 176us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.063332:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6816 00000100:00100000:0.0:1763343040.065196:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c39180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010308224:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343040.065214:0:6525:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.21@tcp) returned -22 from blocking AST (req@00000000457f1847 x1848998010308096) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a24 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ddf expref: 270 pid: 6525 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343040.065231:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a24 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ddf expref: 270 pid: 6525 timeout: 1333 lvb_type: 0 00000100:00100000:0.0:1763343040.065245:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010308096:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343040.065275:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:0.0:1763343040.065281:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.065289:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.065297:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343040.065920:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.066125:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993690240 00000100:00100000:1.0:1763343040.066132:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993690240 00010000:00010000:1.0:1763343040.066165:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8a32 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9de6 expref: 270 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343040.066334:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3181 00000100:00100000:1.0:1763343040.066343:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35084c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:2430:x1848997993690240:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343040.066358:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343040.066364:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8a32 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9de6 expref: 270 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343040.066375:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8a32 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9de6 expref: 270 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343040.066394:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8a32 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9de6 expref: 270 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:1.0:1763343040.066407:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:1.0:1763343040.066411:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.066419:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.066427:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.066451:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343040.066499:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35084c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:2430:x1848997993690240:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 157us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.066507:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3181 00010000:00010000:0.0:1763343040.066715:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.066723:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000040:00080000:0.0:1763343040.066949:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1518, 88 off127760 00000004:00080000:0.0:1763343040.066957:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233734335556ns, next at 1234129958002ns, rc = 0 00000040:00080000:0.0:1763343040.066981:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1519, 88 off127760 00000004:00080000:0.0:1763343040.066986:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1233734365097ns, next at 1234129925410ns, rc = 0 00000040:00080000:0.0:1763343040.068501:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1520, 88 off127848 00000004:00080000:0.0:1763343040.068517:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1233735895584ns, next at 1234129925410ns, rc = 0 00000040:00080000:0.0:1763343040.068557:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1519, 88 off127848 00000004:00080000:0.0:1763343040.068562:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233735941134ns, next at 1234129958002ns, rc = 0 00000100:00100000:2.0:1763343040.070338:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.070400:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993690368 00000100:00100000:3.0:1763343040.070409:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993690368 00000100:00100000:3.0:1763343040.070461:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9648 00000100:00100000:3.0:1763343040.070470:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56933:x1848997993690368:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343040.070491:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343040.070512:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae8a4e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9dfb expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.070560:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 2/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.070571:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae8a4e lrc: 4/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dfb expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.070588:0:28422:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.070599:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae8a4e lrc: 3/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dfb expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.070613:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:3.0:1763343040.070616:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343040.070650:0:28422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae8a4e lrc: 3/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dfb expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.070659:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a85200, rc 0) 00000100:00100000:3.0:1763343040.070711:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56933:x1848997993690368:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 243us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343040.070718:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9648 00000001:00080000:2.0:1763343040.072998:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940270 is committed 00000004:00080000:2.0:1763343040.073009:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1001 committed 00000004:00080000:2.0:1763343040.073026:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1000 committed 00010000:00010000:0.0:1763343040.073151:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8a1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1fc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.073161:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8a1d lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1fc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.073169:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8a1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1fc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.073175:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405987600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.073180:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8a1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1fc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.073188:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8a1d lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1fc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.073203:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:0.0:1763343040.073206:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.073210:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8a1d lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1fc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.073217:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8a1d lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1fc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00080000:2.0:1763343040.073432:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 999 committed 00000100:00100000:3.0:1763343040.073583:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010308480:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343040.073665:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343040.073696:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343040.073701:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010308352:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343040.073718:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343040.073740:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340465e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010308608:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343040.073759:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343040.073771:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343040.073775:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340465e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010308736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343040.073789:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343040.073817:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010308480 00000100:00100000:3.0:1763343040.073823:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010308480 00000100:00100000:3.0:1763343040.073870:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010308352 00000100:00100000:3.0:1763343040.073873:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010308352 00000100:00100000:3.0:1763343040.073886:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010308608 00000100:00100000:3.0:1763343040.073889:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010308608 00000100:00100000:3.0:1763343040.073901:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010308736 00000100:00100000:3.0:1763343040.073903:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010308736 00000100:00100000:3.0:1763343040.073918:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6817 00000100:00100000:3.0:1763343040.073924:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3660:x1848998010308480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343040.073948:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:708 count 1 00010000:00010000:3.0:1763343040.073973:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8a55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.073992:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae894b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9da7 expref: 19 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.073999:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343040.074001:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343040.074004:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8a55 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.074030:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae894b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9da7 expref: 19 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.074044:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae894b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9da7 expref: 19 pid: 8410 timeout: 1333 lvb_type: 0 00000100:00100000:3.0:1763343040.074056:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010308864:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343040.074105:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343040.074121:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6818 00000100:00100000:3.0:1763343040.074128:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3660:x1848998010308352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343040.074138:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:707 count 1 00010000:00010000:3.0:1763343040.074149:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8a5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.074160:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8817 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d45 expref: 19 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343040.074173:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.074175:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.074178:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8a5c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.074193:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8817 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d45 expref: 19 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343040.074202:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8817 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d45 expref: 19 pid: 27835 timeout: 1333 lvb_type: 1 00000100:00100000:3.0:1763343040.074212:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010308992:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343040.074231:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c180 going to sleep for 11 seconds 00000100:00100000:3.0:1763343040.074245:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6819 00000100:00100000:3.0:1763343040.074252:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3657:x1848998010308608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343040.074486:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6820 00000100:00100000:0.0:1763343040.074496:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340465fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3657:x1848998010308736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343040.074706:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3657:x1848998010308736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 212us (915us total) trans 21474839022 rc 0/0 00000100:00100000:0.0:1763343040.074717:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6820 00000004:00080000:0.0:1763343040.074764:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340465e300/2, rc 0, transno 21474839022 00000100:00100000:0.0:1763343040.074770:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340465e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010308736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343040.075038:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010309504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.075068:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343040.075088:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343040.075093:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010309376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.075109:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343040.075126:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010309504 00000100:00100000:1.0:1763343040.075130:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010309504 00000100:00100000:1.0:1763343040.075152:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010309376 00000100:00100000:1.0:1763343040.075154:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010309376 00000100:00100000:1.0:1763343040.075166:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6821 00000100:00100000:1.0:1763343040.075171:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3658:x1848998010309504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.075260:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3658:x1848998010309504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (191us total) trans 17179871724 rc 0/0 00000100:00100000:1.0:1763343040.075280:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6821 00000100:00100000:1.0:1763343040.075292:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6822 00000100:00100000:1.0:1763343040.075298:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3658:x1848998010309376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.075355:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3658:x1848998010309376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (245us total) trans 17179871725 rc 0/0 00000100:00100000:1.0:1763343040.075361:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6822 00000004:00080000:1.0:1763343040.075384:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad3b80/2, rc 0, transno 17179871725 00000100:00100000:1.0:1763343040.075388:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010309376:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763343040.075395:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad2300/2, rc 0, transno 17179871724 00000100:00100000:1.0:1763343040.075399:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010309504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.075416:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010309248:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.075434:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343040.075449:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343040.075453:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010309120:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.075469:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343040.075486:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010309248 00000100:00100000:1.0:1763343040.075489:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010309248 00000100:00100000:1.0:1763343040.075518:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010309120 00000100:00100000:1.0:1763343040.075521:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010309120 00000100:00100000:1.0:1763343040.075537:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6823 00000100:00100000:1.0:1763343040.075542:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3660:x1848998010309248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763343040.075552:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:710 count 1 00010000:00010000:1.0:1763343040.075565:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae8a63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.075581:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8921 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d92 expref: 13 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.075588:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343040.075589:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343040.075592:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae8a63 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.075614:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8921 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d92 expref: 13 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.075646:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8921 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d92 expref: 13 pid: 8410 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343040.075657:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1848998010309632:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343040.075695:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343040.075709:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6824 00000100:00100000:1.0:1763343040.075715:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3535ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3660:x1848998010309120:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763343040.075726:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:709 count 1 00010000:00010000:1.0:1763343040.075736:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8a6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.075746:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405986400/0x607405d401ae873e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cf1 expref: 13 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.075752:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343040.075754:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343040.075757:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8a6a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.075772:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3405986400/0x607405d401ae873e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cf1 expref: 13 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.075780:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3405986400/0x607405d401ae873e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cf1 expref: 13 pid: 27835 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343040.075788:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010309760:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343040.075806:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1bf00 going to sleep for 11 seconds 00000004:00080000:2.0:1763343040.076139:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1000 committed 00010000:00010000:0.0:1763343040.076400:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ded expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.076412:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:0.0:1763343040.076415:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343040.076419:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae8a4e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dfb expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.076430:0:6525:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae8a4e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dfb expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.076437:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae8a4e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dfb expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.076461:0:6525:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae8a4e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dfb expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343040.076471:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010309888:192.168.204.21@tcp:105: 00000100:00100000:0.0:1763343040.076507:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31f00 going to sleep for 11 seconds 00002000:00010000:3.0:1763343040.077296:0:28648:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2c7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343040.077301:0:28648:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2c7:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343040.077304:0:28648:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2c7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343040.077307:0:28648:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2c7:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343040.077309:0:28648:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2c7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343040.077377:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3657:x1848998010308608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3122us (3614us total) trans 21474839023 rc 0/0 00000100:00100000:3.0:1763343040.077386:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6819 00000004:00080000:0.0:1763343040.077872:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340465e680/2, rc 0, transno 21474839023 00000100:00100000:0.0:1763343040.077879:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340465e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010308608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343040.082291:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010308992:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343040.082327:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8a5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343040.082691:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.082717:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.082742:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993690624 00000100:00100000:2.0:1763343040.082748:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993690624 00010000:00010000:2.0:1763343040.082783:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8817 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d45 expref: 20 pid: 27835 timeout: 1333 lvb_type: 1 00000100:00100000:2.0:1763343040.082809:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993690496 00000100:00100000:2.0:1763343040.082811:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993690496 00010000:00010000:2.0:1763343040.082821:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae894b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9da7 expref: 21 pid: 8410 timeout: 1333 lvb_type: 0 00000100:00100000:2.0:1763343040.082850:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3182 00000100:00100000:2.0:1763343040.082859:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993690624:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.082873:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.082878:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8817 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d45 expref: 21 pid: 27835 timeout: 1333 lvb_type: 1 00010000:00010000:2.0:1763343040.082888:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8817 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d45 expref: 21 pid: 27835 timeout: 1333 lvb_type: 1 00010000:00010000:2.0:1763343040.082910:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352de00/0x607405d401ae8817 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d45 expref: 21 pid: 27835 timeout: 1333 lvb_type: 1 00010000:00010000:2.0:1763343040.082925:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.082927:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.082931:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.082940:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8a5c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.082961:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343040.083008:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993690624:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 150us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.083015:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3182 00000100:00100000:2.0:1763343040.083032:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3183 00000100:00100000:2.0:1763343040.083038:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993690496:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.083046:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.083050:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae894b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9da7 expref: 19 pid: 8410 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.083061:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae894b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9da7 expref: 19 pid: 8410 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.083073:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.083074:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.083078:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.083086:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8a55 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.083096:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343040.083112:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993690496:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 74us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.083118:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3183 00000100:00100000:1.0:1763343040.083320:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010309760:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343040.083347:0:8408:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8a6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.083827:0:27835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d177e00/0x607405d401ae894b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9da7 expref: 18 pid: 8410 timeout: 1333 lvb_type: 0 00000100:00100000:3.0:1763343040.083854:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010308864:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343040.083873:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.083882:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.083889:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.083898:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.083906:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.083926:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343040.084152:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3660:x1848998010308480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10226us (10485us total) trans 21474839024 rc 0/0 00000100:00100000:3.0:1763343040.084161:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6817 00010000:00010000:0.0:1763343040.084414:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.084424:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.084432:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.084439:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.084460:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763343040.084677:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340465ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3660:x1848998010308352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10544us (10952us total) trans 21474839025 rc 0/0 00000100:00100000:0.0:1763343040.084684:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6818 00010000:00010000:2.0:1763343040.084717:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343040.084727:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343040.084727:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010309888:192.168.204.21@tcp:105: 00010000:00010000:2.0:1763343040.084743:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403a84a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343040.084748:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.084762:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8a39 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ded expref: 262 pid: 6525 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343040.084767:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8a55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.084783:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ded expref: 261 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.084788:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8a55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.084798:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3403a84a00/0x607405d401ae8a55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.084812:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00010000:00010000:2.0:1763343040.084817:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343040.084827:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.084843:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403a5e400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343040.084847:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.084854:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8a5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343040.084861:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:55941:x1848997993689984:12345-192.168.204.21@tcp:101:bash.0 Request processed in 23948us (24104us total) trans 8589940270 rc 0/0 00010000:00010000:2.0:1763343040.084868:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8a5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343040.084876:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9647 00010000:00010000:2.0:1763343040.084883:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8a5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.084904:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.084907:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.084909:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343040.085368:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062f1500/2, rc 0, transno 21474839025 00000100:00100000:1.0:1763343040.085377:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010308352:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1763343040.085385:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062f1880/2, rc 0, transno 21474839024 00000100:00100000:1.0:1763343040.085388:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010308480:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1763343040.085509:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343040.085614:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.085736:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.085979:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1848998010309632:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343040.085998:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae8a63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343040.086401:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993690880 00000100:00100000:1.0:1763343040.086409:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993690880 00000100:00100000:0.0:1763343040.086712:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993690752 00000100:00100000:0.0:1763343040.086716:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993690752 00010000:00010000:0.0:1763343040.086739:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405986400/0x607405d401ae873e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cf1 expref: 14 pid: 27835 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343040.086964:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3291 00000100:00100000:1.0:1763343040.086973:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56933:x1848997993690880:12345-192.168.204.21@tcp:49:lfs.0 00000100:00100000:1.0:1763343040.087076:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56933:x1848997993690880:12345-192.168.204.21@tcp:49:lfs.0 Request processed in 104us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.087083:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3291 00000100:00100000:0.0:1763343040.087119:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3184 00000100:00100000:0.0:1763343040.087125:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993690752:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343040.087136:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343040.087141:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3405986400/0x607405d401ae873e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cf1 expref: 14 pid: 27835 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343040.087152:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3405986400/0x607405d401ae873e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cf1 expref: 14 pid: 27835 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343040.087171:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405986400/0x607405d401ae873e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9cf1 expref: 14 pid: 27835 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343040.087184:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343040.087185:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343040.087190:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8a6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.087200:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8a6a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.087221:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343040.087239:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993690752:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 114us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.087245:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3184 00010000:00010000:0.0:1763343040.088072:0:8408:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8a6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.088084:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8a6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.088094:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8a6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.088102:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8a6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.088125:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343040.088346:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3660:x1848998010309120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12629us (12873us total) trans 17179871726 rc 0/0 00000100:00100000:0.0:1763343040.088353:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6824 00000004:00080000:0.0:1763343040.088400:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad3100/2, rc 0, transno 17179871726 00000100:00100000:0.0:1763343040.088406:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010309120:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763343040.088715:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343040.088723:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8a6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.088732:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343040.088736:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8a6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.088745:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8a6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.088761:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8a6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.088768:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8a6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.088784:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343040.088786:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343040.088788:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343040.091652:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.091733:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993691008 00000100:00100000:1.0:1763343040.091743:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993691008 00000100:00100000:1.0:1763343040.091790:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3292 00000100:00100000:1.0:1763343040.091798:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:55941:x1848997993691008:12345-192.168.204.21@tcp:49:bash.0 00000100:00100000:1.0:1763343040.091934:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:55941:x1848997993691008:12345-192.168.204.21@tcp:49:bash.0 Request processed in 136us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.091940:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3292 00000100:00100000:3.0:1763343040.092548:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.092665:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.092912:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993691136 00000100:00100000:0.0:1763343040.092919:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993691136 00010000:00010000:0.0:1763343040.092956:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8921 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d92 expref: 13 pid: 8410 timeout: 1333 lvb_type: 0 00000100:00100000:0.0:1763343040.092982:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3185 00000100:00100000:0.0:1763343040.092990:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993691136:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343040.093002:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343040.093007:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8921 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d92 expref: 13 pid: 8410 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343040.093019:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8921 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d92 expref: 13 pid: 8410 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343040.093042:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8921 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9d92 expref: 13 pid: 8410 timeout: 1333 lvb_type: 0 00010000:00010000:0.0:1763343040.093059:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343040.093061:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343040.093065:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae8a63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.093075:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae8a63 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.093099:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343040.093130:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2430:x1848997993691136:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 141us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.093137:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3185 00010000:00010000:0.0:1763343040.093180:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae8a63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.093189:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae8a63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.093204:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae8a63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.093212:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae8a63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.093226:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343040.093494:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3535ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3660:x1848998010309248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17950us (18057us total) trans 17179871727 rc 0/0 00000100:00100000:0.0:1763343040.093502:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6823 00000004:00080000:0.0:1763343040.093543:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad0380/2, rc 0, transno 17179871727 00000100:00100000:0.0:1763343040.093549:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010309248:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763343040.093571:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343040.093577:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae8a63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.093585:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343040.093589:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae8a63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.093598:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae8a63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.093610:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae8a63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.093644:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7600/0x607405d401ae8a63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.093660:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343040.093661:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343040.093663:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343040.094355:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993691392 00000100:00100000:1.0:1763343040.094362:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993691392 00000100:00100000:1.0:1763343040.094401:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3293 00000100:00100000:1.0:1763343040.094408:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56933:x1848997993691392:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343040.094577:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56933:x1848997993691392:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 169us (1911us total) trans 8589940271 rc 0/0 00000100:00100000:1.0:1763343040.094585:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3293 00000100:00100000:3.0:1763343040.097401:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.097534:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993691520 00000100:00100000:1.0:1763343040.097545:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993691520 00000100:00100000:1.0:1763343040.097598:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6825 00000100:00100000:1.0:1763343040.097606:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:55941:x1848997993691520:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343040.097644:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.097663:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8a71 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e02 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.097690:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8a47 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9df4 expref: 19 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343040.097698:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.097700:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.097705:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8a71 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e02 expref: 19 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.097734:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8a47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9df4 expref: 19 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343040.097747:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8a47 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9df4 expref: 19 pid: 27835 timeout: 1333 lvb_type: 1 00000100:00100000:1.0:1763343040.097761:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1848998010310016:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343040.097828:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343040.099187:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.099422:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993691776 00000100:00100000:0.0:1763343040.099431:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993691776 00000100:00100000:0.0:1763343040.099481:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9649 00000100:00100000:0.0:1763343040.099490:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56933:x1848997993691776:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.099509:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.099529:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8a78 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e09 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.099595:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a7f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.099608:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a7f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.100376:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a7f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.100401:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae8a86 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.100410:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae8a86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.100418:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae8a86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.100526:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8a8d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.100535:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8a8d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.100542:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8a8d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343040.100553:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fc:0x0]: returning size 2 00010000:00010000:0.0:1763343040.101571:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a7f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.101583:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a7f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.101589:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a7f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.101596:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a7f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.101601:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.101605:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a7f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.101612:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a7f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.101658:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4000) 00010000:00010000:0.0:1763343040.101662:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.101667:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a7f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.101678:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8a7f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.101692:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae8a86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.101697:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae8a86 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.101703:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae8a86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.101708:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.101711:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae8a86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.101717:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae8a86 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.101723:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4400) 00010000:00010000:0.0:1763343040.101725:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.101728:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae8a86 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.101733:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae8a86 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.101809:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8a78 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e09 expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.101825:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8a8d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e09 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.101848:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:0.0:1763343040.101850:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343040.101853:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:0.0:1763343040.101910:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56933:x1848997993691776:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2421us (2730us total) trans 8589940272 rc 0/0 00000100:00100000:0.0:1763343040.101918:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9649 00000100:00100000:1.0:1763343040.102191:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1848998010310016:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343040.102229:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8a71 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e02 expref: 19 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.102251:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7c00, rc 0) 00000100:00100000:1.0:1763343040.102285:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:55941:x1848997993691520:12345-192.168.204.21@tcp:101:bash.0 Request processed in 4679us (4892us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.102292:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6825 00000100:00100000:0.0:1763343040.104433:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.104539:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993691904 00000100:00100000:3.0:1763343040.104549:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993691904 00010000:00010000:3.0:1763343040.104582:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8a47 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9df4 expref: 19 pid: 27835 timeout: 1333 lvb_type: 1 00000100:00100000:3.0:1763343040.104617:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3186 00000100:00100000:3.0:1763343040.104653:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993691904:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343040.104666:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343040.104671:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8a47 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9df4 expref: 19 pid: 27835 timeout: 1333 lvb_type: 1 00010000:00010000:3.0:1763343040.104684:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8a47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9df4 expref: 19 pid: 27835 timeout: 1333 lvb_type: 1 00010000:00010000:3.0:1763343040.104706:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8a47 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9df4 expref: 19 pid: 27835 timeout: 1333 lvb_type: 1 00010000:00010000:3.0:1763343040.104721:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.104723:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.104730:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8a71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e02 expref: 18 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.104740:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8a71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e02 expref: 18 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.104774:0:6508:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8a71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e02 expref: 18 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343040.104787:0:6508:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6508:1848998010310144:192.168.204.21@tcp:105: 00000100:00100000:3.0:1763343040.105231:0:6508:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343040.107585:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.107742:0:6508:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6508:1848998010310144:192.168.204.21@tcp:105: 00010000:00010000:0.0:1763343040.107767:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343040.107821:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993691904:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 3169us (3395us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.107841:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3186 00000100:00100000:2.0:1763343040.107925:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993692160 00000100:00100000:2.0:1763343040.107933:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993692160 00000100:00100000:2.0:1763343040.108101:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3294 00000100:00100000:2.0:1763343040.108111:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56933:x1848997993692160:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343040.108299:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56933:x1848997993692160:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 190us (723us total) trans 8589940273 rc 0/0 00000100:00100000:2.0:1763343040.108306:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3294 00000100:00100000:3.0:1763343040.109715:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.110603:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993692288 00000100:00100000:1.0:1763343040.110614:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993692288 00000100:00100000:3.0:1763343040.111042:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.111486:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993692416 00000100:00100000:2.0:1763343040.111493:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993692416 00000100:00100000:2.0:1763343040.111541:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3295 00000100:00100000:2.0:1763343040.111549:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56933:x1848997993692416:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:2.0:1763343040.111714:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56933:x1848997993692416:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 165us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.111721:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3295 00000100:00100000:1.0:1763343040.111967:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6826 00000100:00100000:1.0:1763343040.111975:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:55941:x1848997993692288:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343040.111985:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.112005:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae8a9b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e10 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343040.112026:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343040.112041:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.112044:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.112053:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae8a9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e10 expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.112067:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae8a9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e10 expref: 13 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.112078:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6800, rc 0) 00000100:00100000:1.0:1763343040.112111:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:55941:x1848997993692288:12345-192.168.204.21@tcp:101:bash.0 Request processed in 137us (2402us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.112117:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6826 00000100:00100000:3.0:1763343040.116565:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.116599:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.116729:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993692544 00000100:00100000:2.0:1763343040.116739:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993692544 00002000:00010000:2.0:1763343040.116779:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/711 (0->18446744073709551615) 00002000:00100000:2.0:1763343040.116784:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d10d180 with x1848997993692544 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343040.116795:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340d10d180. 00000100:00100000:2.0:1763343040.116827:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993692672 00000100:00100000:2.0:1763343040.116839:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993692672 00002000:00010000:2.0:1763343040.116855:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/713 (0->18446744073709551615) 00002000:00100000:2.0:1763343040.116858:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d10df80 with x1848997993692672 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343040.116864:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340d10df80. 00000100:00100000:2.0:1763343040.116892:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1654 00000100:00100000:2.0:1763343040.116901:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993692544:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343040.117075:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2c7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343040.117079:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2c7:0x0] updating lvb mtime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343040.117081:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2c7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343040.117083:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2c7:0x0] updating lvb ctime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343040.117085:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2c7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343040.117138:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993692544:12345-192.168.204.21@tcp:10:bash.0 Request processed in 237us (581us total) trans 21474839026 rc 0/0 00000100:00100000:2.0:1763343040.117145:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1654 00002000:00010000:2.0:1763343040.117149:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/711 (0->18446744073709551615) 00002000:00100000:2.0:1763343040.117151:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d10d180 with x1848997993692544 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343040.117155:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340d10d180. 00000100:00100000:2.0:1763343040.117172:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1655 00000100:00100000:2.0:1763343040.117179:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993692672:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343040.117296:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2c9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343040.117299:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2c9:0x0] updating lvb mtime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343040.117302:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2c9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343040.117303:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2c9:0x0] updating lvb ctime from disk: 0 -> 1763343039 00002000:00010000:2.0:1763343040.117305:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2c9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343040.117331:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993692672:12345-192.168.204.21@tcp:10:bash.0 Request processed in 150us (729us total) trans 17179871728 rc 0/0 00000100:00100000:2.0:1763343040.117337:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1655 00002000:00010000:2.0:1763343040.117341:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/713 (0->18446744073709551615) 00002000:00100000:2.0:1763343040.117343:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340d10df80 with x1848997993692672 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343040.117347:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340d10df80. 00000100:00100000:3.0:1763343040.126167:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.126284:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993692928 00000100:00100000:1.0:1763343040.126294:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993692928 00000100:00100000:1.0:1763343040.126355:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3296 00000100:00100000:1.0:1763343040.126366:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993692928:12345-192.168.204.21@tcp:35:bash.0 00000001:00080000:1.0:1763343040.126584:0:6526:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940274 00000100:00100000:1.0:1763343040.126934:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:55941:x1848997993692928:12345-192.168.204.21@tcp:35:bash.0 Request processed in 568us (775us total) trans 8589940275 rc 0/0 00000100:00100000:1.0:1763343040.126943:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3296 00000020:00080000:1.0:1763343040.126949:0:6526:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343040.140452:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.141083:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993693184 00000100:00100000:0.0:1763343040.141095:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993693184 00000100:00100000:1.0:1763343040.141222:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9650 00000100:00100000:1.0:1763343040.141233:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56938:x1848997993693184:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.141256:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.141278:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8aa2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e17 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.141387:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8aa9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.141402:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.141413:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343040.141423:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fc:0x0]: returning size 5 00010000:00010000:1.0:1763343040.141524:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8aa2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e17 expref: 270 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.141542:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e17 expref: 269 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.141556:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:1.0:1763343040.141558:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763343040.141562:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7200, rc 0) 00000100:00100000:1.0:1763343040.141651:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56938:x1848997993693184:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 389us (1178us total) trans 8589940276 rc 0/0 00000100:00100000:1.0:1763343040.141658:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9650 00000100:00100000:3.0:1763343040.144380:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.145477:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993693440 00000100:00100000:0.0:1763343040.145489:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993693440 00000100:00100000:1.0:1763343040.145734:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9651 00000100:00100000:1.0:1763343040.145747:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56939:x1848997993693440:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:1.0:1763343040.145794:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1763343040.145818:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8a40 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ded expref: 269 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.145847:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae8a4e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dfb expref: 268 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.145860:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8a8d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e09 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.145871:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987e00/0x607405d401ae8a01 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9dd1 expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.145881:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:1.0:1763343040.145885:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343040.145908:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8ab7 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.145919:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8ab7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.145927:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8ab7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.145939:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8abe lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00000100:00100000:0.0:1763343040.146167:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.146258:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993693568 00000100:00100000:2.0:1763343040.146263:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993693568 00000100:00100000:2.0:1763343040.146298:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9652 00000100:00100000:2.0:1763343040.146307:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56938:x1848997993693568:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.146320:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.146332:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ac5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e1e expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.146397:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8acc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.146406:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8acc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.146413:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8acc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:2.0:1763343040.146434:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fc:0x0]: returning size 5 00000004:00200000:2.0:1763343040.146438:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343040.146456:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8acc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.146476:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ac5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e1e expref: 268 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.146489:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8acc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e1e expref: 267 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.146502:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343040.146504:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343040.146507:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352dc00, rc 0) 00000100:00100000:2.0:1763343040.146565:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56938:x1848997993693568:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 260us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.146572:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9652 00010000:00010000:1.0:1763343040.147075:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8abe lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.147084:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8abe lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.147175:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.147185:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8aa9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e17 expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.147193:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8acc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e1e expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.147200:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.147233:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8acc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e1e expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.147247:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8acc lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e1e expref: 266 pid: 10041 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343040.147261:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010310272:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343040.147334:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e17 expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.147343:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8aa9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e17 expref: 266 pid: 6525 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343040.147351:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f39880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010310400:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343040.147376:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343040.151963:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.151995:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.152033:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.152107:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993693824 00000100:00100000:2.0:1763343040.152117:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993693824 00010000:00010000:2.0:1763343040.152153:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8aa9 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e17 expref: 267 pid: 6525 timeout: 1333 lvb_type: 0 00000100:00100000:2.0:1763343040.152189:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993693696 00000100:00100000:2.0:1763343040.152192:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993693696 00010000:00010000:2.0:1763343040.152202:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8acc lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e1e expref: 268 pid: 10041 timeout: 1333 lvb_type: 0 00000100:00100000:2.0:1763343040.152221:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3187 00000100:00100000:2.0:1763343040.152229:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:2430:x1848997993693824:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.152243:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.152250:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8aa9 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e17 expref: 268 pid: 6525 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.152261:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8aa9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e17 expref: 268 pid: 6525 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.152283:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343040.152289:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.152298:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.152305:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343040.152346:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:2430:x1848997993693824:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 118us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.152353:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3187 00000100:00100000:2.0:1763343040.152369:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3188 00000100:00100000:2.0:1763343040.152375:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35084c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:2430:x1848997993693696:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.152384:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.152388:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8acc lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e1e expref: 267 pid: 10041 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.152398:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8acc lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e1e expref: 267 pid: 10041 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.152409:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343040.152413:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.152420:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.152427:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.152441:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343040.152455:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35084c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:2430:x1848997993693696:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 80us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.152465:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3188 00010000:00010000:1.0:1763343040.152566:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8acc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e1e expref: 266 pid: 10041 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343040.152582:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010310272:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343040.152592:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8aa9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e17 expref: 265 pid: 6525 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343040.152601:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f39880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010310400:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343040.152660:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.152669:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.152675:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00080000:1.0:1763343040.152908:0:6525:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1fc:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1763343040.152988:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153001:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153008:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153013:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.153017:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153025:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153034:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:1.0:1763343040.153036:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343040.153040:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153046:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8ad3 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153063:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8ab7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153069:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8ab7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153075:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8ab7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153081:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8ab7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153085:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.153088:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8ab7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153094:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8ab7 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153100:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:1.0:1763343040.153102:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343040.153105:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8ab7 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153110:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8ab7 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:1.0:1763343040.153120:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f5f44f1d reply state 0000000072ba733f transno 8589940277 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8abe lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153130:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8abe lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.153136:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873b900) 00010000:00010000:1.0:1763343040.153138:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343040.153140:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343040.153179:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56939:x1848997993693440:12345-192.168.204.21@tcp:36:rm.0 Request processed in 7436us (8806us total) trans 8589940277 rc 0/0 00000100:00100000:1.0:1763343040.153186:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9651 00000100:00100000:1.0:1763343040.153202:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993693952 00000100:00100000:1.0:1763343040.153206:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993693952 00000100:00100000:1.0:1763343040.153226:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9653 00000100:00100000:1.0:1763343040.153232:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56938:x1848997993693952:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.153245:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.153259:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8ada lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e25 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.153293:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8ada lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e25 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.153303:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7600/0x607405d401ae8ada lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e25 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.153317:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a353873b800) 00010000:00010000:1.0:1763343040.153319:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343040.153321:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7600, rc 0) 00000100:00100000:1.0:1763343040.153339:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56938:x1848997993693952:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 107us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.153346:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9653 00000100:00100000:0.0:1763343040.156042:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.156238:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993694208 00000100:00100000:1.0:1763343040.156249:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993694208 00000100:00100000:1.0:1763343040.156304:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3297 00000100:00100000:1.0:1763343040.156322:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56938:x1848997993694208:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:1.0:1763343040.156535:0:6526:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1fc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1763343040.156606:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1520, 64 off127912 00000040:00080000:1.0:1763343040.156661:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1521, 64 off127912 00000040:00080000:1.0:1763343040.156674:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1522, 64 off127976 00000040:00080000:1.0:1763343040.156683:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1521, 64 off127976 00010000:00010000:1.0:1763343040.156745:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8ae1 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343040.156762:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8ae1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343040.156773:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8ae1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343040.156781:0:6526:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8ae1 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343040.156786:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8ae1 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343040.156792:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8ae1 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:1.0:1763343040.156822:0:6526:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343040.157036:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56938:x1848997993694208:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 722us (1001us total) trans 8589940278 rc 0/0 00000100:00100000:1.0:1763343040.157045:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3297 00010000:00010000:0.0:1763343040.157431:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343040.157439:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8ae1 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.157446:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3404b76c00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343040.157450:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8ae1 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.157458:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8ae1 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.157471:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fc:0x0].0x0 (ffff9a353873b800) 00010000:00010000:0.0:1763343040.157474:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343040.157484:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8ae1 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.157490:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8ae1 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.157503:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343040.157505:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343040.157506:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343040.164786:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.165976:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993694336 00000100:00100000:2.0:1763343040.165989:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993694336 00000100:00100000:2.0:1763343040.166053:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9654 00000100:00100000:2.0:1763343040.166063:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56938:x1848997993694336:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.166086:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.166108:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ae8 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e2c expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.166165:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8aef lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166177:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8aef lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166187:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8aef lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166197:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8af6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166204:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8af6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166211:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8af6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166245:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8aef lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166252:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8aef lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166259:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8aef lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166277:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8aef lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166283:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.166287:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8aef lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166293:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8aef lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166305:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc200) 00010000:00010000:2.0:1763343040.166308:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.166312:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8aef lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166317:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8aef lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166329:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8af6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166334:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8af6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166339:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8af6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166344:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.166346:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8af6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166354:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8af6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166360:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873b900) 00010000:00010000:2.0:1763343040.166362:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.166364:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8af6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166369:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8af6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.166393:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ae8 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e2c expref: 269 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.166403:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc200) 00010000:00010000:2.0:1763343040.166405:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.166409:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ae8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e2c expref: 269 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.166421:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:2.0:1763343040.166487:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56938:x1848997993694336:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 425us (1711us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343040.166494:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9654 00000100:00100000:3.0:1763343040.174172:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.175014:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993694464 00000100:00100000:0.0:1763343040.175026:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993694464 00000100:00100000:0.0:1763343040.175092:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9655 00000100:00100000:0.0:1763343040.175103:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56940:x1848997993694464:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.175122:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.175147:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8afd lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e33 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.175207:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8b04 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175221:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8b04 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175232:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8b04 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175246:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8b0b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175253:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8b0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175259:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8b0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175357:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8b04 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175363:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8b04 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175369:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8b04 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175375:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.175379:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8b04 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175385:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8b04 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175396:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4000) 00010000:00010000:0.0:1763343040.175400:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.175405:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8b04 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175410:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8b04 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175421:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8b0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175428:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8b0b lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175434:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8b0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175438:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.175441:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8b0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175446:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8b0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175452:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873b900) 00010000:00010000:0.0:1763343040.175454:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.175457:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8b0b lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175462:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8b0b lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.175484:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8afd lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e33 expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.175493:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4000) 00010000:00010000:0.0:1763343040.175495:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.175499:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8afd lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e33 expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.175510:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:0.0:1763343040.175571:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56940:x1848997993694464:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 470us (1409us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343040.175579:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9655 00000100:00100000:0.0:1763343040.187763:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.187818:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993694592 00000100:00100000:1.0:1763343040.187838:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993694592 00000100:00100000:1.0:1763343040.187902:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9656 00000100:00100000:1.0:1763343040.187913:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56940:x1848997993694592:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.187934:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.187964:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae8b12 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e3a expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.188145:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b19 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188158:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188169:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188180:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b20 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188187:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188194:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188235:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b19 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188241:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b19 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188248:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188255:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3404b76800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.188259:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b19 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188276:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b19 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188288:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:1.0:1763343040.188291:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343040.188296:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b19 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188301:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b19 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188316:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188321:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b20 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188328:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188333:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3404b76e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.188336:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188341:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188349:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873b900) 00010000:00010000:1.0:1763343040.188352:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343040.188355:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b20 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188360:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b20 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.188385:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae8b12 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e3a expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.188396:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:1.0:1763343040.188398:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343040.188401:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae8b12 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e3a expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.188414:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3404b77600, rc 0) 00000100:00100000:1.0:1763343040.190617:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56940:x1848997993694592:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2695us (2852us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343040.190644:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9656 00000100:00100000:0.0:1763343040.193535:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.193800:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993694976 00000100:00100000:1.0:1763343040.193810:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993694976 00000100:00100000:1.0:1763343040.193869:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9657 00000100:00100000:1.0:1763343040.193878:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56940:x1848997993694976:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.193899:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.193923:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae8b27 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e48 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.193983:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8b2e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.193996:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8b2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.194006:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8b2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343040.194049:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343040.194054:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343040.194087:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae8b27 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e48 expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.194104:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8b2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e48 expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.194112:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873b500) 00010000:00010000:1.0:1763343040.194116:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343040.194119:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3404b76c00, rc 0) 00000100:00100000:3.0:1763343040.194362:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.194399:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993694848 00000100:00100000:2.0:1763343040.194404:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993694848 00000100:00100000:2.0:1763343040.194442:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9658 00000100:00100000:2.0:1763343040.194449:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56941:x1848997993694848:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.194457:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.194466:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8b35 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e41 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.194513:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8b3c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194523:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8b3c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194531:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8b3c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194546:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8b43 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194553:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8b43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194559:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8b43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194719:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8b3c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194727:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8b3c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194732:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8b3c lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194739:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8b3c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194745:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.194749:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8b3c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194757:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8b3c lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194767:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873b500) 00010000:00010000:2.0:1763343040.194770:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.194773:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8b3c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194779:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8b3c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194790:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8b43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194797:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8b43 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194803:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8b43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194808:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.194811:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8b43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194816:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8b43 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194822:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873b900) 00010000:00010000:2.0:1763343040.194825:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.194827:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8b43 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194843:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8b43 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343040.194866:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8b35 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e41 expref: 271 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.194876:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873b500) 00010000:00010000:2.0:1763343040.194879:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343040.194882:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8b35 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e41 expref: 271 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.194891:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:2.0:1763343040.194922:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d10f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56941:x1848997993694848:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 474us (560us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343040.194928:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9658 00000100:00100000:1.0:1763343040.196126:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56940:x1848997993694976:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2242us (2593us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.196139:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9657 00000100:00100000:3.0:1763343040.202065:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.202153:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993695232 00000100:00100000:1.0:1763343040.202163:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993695232 00000100:00100000:1.0:1763343040.202213:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9659 00000100:00100000:1.0:1763343040.202222:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56940:x1848997993695232:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.202243:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.202246:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343040.202272:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8b2e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e48 expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.202292:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873b500) 00010000:00010000:1.0:1763343040.202301:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343040.202316:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae8b4a lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e4f expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.202410:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b51 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202423:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202432:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202442:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b58 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202449:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202455:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202813:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8b5f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202822:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8b5f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202843:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8b5f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343040.202852:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fe:0x0]: returning size 0 00010000:00010000:1.0:1763343040.202875:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202882:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b51 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202890:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b51 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202899:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3404b76e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.202903:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b51 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202910:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b51 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202918:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:1.0:1763343040.202923:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343040.202926:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b51 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202933:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8b51 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:1.0:1763343040.202947:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bc02229b reply state 00000000a4a56166 transno 8589940279 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202958:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.202963:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873b900) 00010000:00010000:1.0:1763343040.202965:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343040.202968:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763343040.202997:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae8b4a lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e4f expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.203014:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8b5f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e4f expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.203020:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873b200) 00010000:00010000:1.0:1763343040.203023:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343040.203026:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6000, rc 0) 00000100:00100000:1.0:1763343040.203094:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56940:x1848997993695232:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 873us (1037us total) trans 8589940279 rc 0/0 00000100:00100000:1.0:1763343040.203103:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9659 00000100:00100000:0.0:1763343040.209113:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.209255:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993695488 00000100:00100000:1.0:1763343040.209274:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993695488 00000100:00100000:1.0:1763343040.209331:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9660 00000100:00100000:1.0:1763343040.209339:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56940:x1848997993695488:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.209364:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.209387:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8b6d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e56 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.209489:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b74 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.209504:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8b5f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e4f expref: 272 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.209514:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b74 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.209545:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8b5f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e4f expref: 272 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.209557:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8b5f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e4f expref: 272 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343040.209571:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f39880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010310528:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343040.209673:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c780 going to sleep for 11 seconds 00000100:00100000:2.0:1763343040.220135:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.220272:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993695744 00000100:00100000:3.0:1763343040.220280:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993695744 00000100:00100000:1.0:1763343040.220281:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f39880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010310528:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343040.220310:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b74 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343040.220343:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9661 00000100:00100000:3.0:1763343040.220354:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56942:x1848997993695744:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343040.220373:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343040.220393:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8b7b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e5d expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.220505:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8b82 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.220519:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8b82 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.220528:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8b82 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343040.220538:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fe:0x0]: returning size 0 00010000:00010000:3.0:1763343040.220614:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8b82 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.220655:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8b82 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.220670:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8b82 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.220675:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405987000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.220679:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8b82 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.220686:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8b82 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.220697:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873b200) 00010000:00010000:3.0:1763343040.220701:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763343040.220705:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8b82 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.220711:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987000/0x607405d401ae8b82 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.220764:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8b7b lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e5d expref: 275 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.220774:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873b200) 00010000:00010000:3.0:1763343040.220777:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343040.220780:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405987600/0x607405d401ae8b7b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e5d expref: 275 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.220788:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405987600, rc 0) 00000100:00100000:3.0:1763343040.220856:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:56942:x1848997993695744:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 503us (732us total) trans 8589940280 rc 301/301 00000100:00100000:3.0:1763343040.220862:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9661 00000100:00100000:0.0:1763343040.221486:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.221596:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993695872 00000100:00100000:3.0:1763343040.221602:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993695872 00010000:00010000:3.0:1763343040.221671:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8b5f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e4f expref: 274 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:3.0:1763343040.221693:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3189 00000100:00100000:3.0:1763343040.221702:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340664a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:2429:x1848997993695872:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343040.221713:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343040.221717:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8b5f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e4f expref: 274 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:3.0:1763343040.221729:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8b5f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e4f expref: 274 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:3.0:1763343040.221741:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8b5f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e4f expref: 274 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:3.0:1763343040.221752:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873b200) 00010000:00010000:3.0:1763343040.221756:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b74 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.221763:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b74 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.221768:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b74 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.221800:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343040.221838:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b74 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343040.221842:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:2429:x1848997993695872:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 141us (356us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343040.221852:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b74 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343040.221862:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3189 00000004:00200000:1.0:1763343040.221873:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fe:0x0]: returning size 0 00000004:00080000:1.0:1763343040.222013:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2cb:0x0], index 1: 0 00000004:00080000:1.0:1763343040.222020:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2c9:0x0], index 0: 0 00000004:00080000:1.0:1763343040.222024:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2ca:0x0], index 0: 0 00000004:00080000:1.0:1763343040.222028:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2cc:0x0], index 1: 0 00010000:00010000:1.0:1763343040.222111:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b74 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.222119:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b74 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.222126:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b74 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.222131:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.222135:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b74 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.222142:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b74 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.222150:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873b200) 00010000:00010000:1.0:1763343040.222153:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343040.222156:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b74 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.222162:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b74 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.222193:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8b6d lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e56 expref: 273 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.222202:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873b200) 00010000:00010000:1.0:1763343040.222205:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343040.222209:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8b6d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e56 expref: 273 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.222221:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6200, rc 0) 00000100:00100000:1.0:1763343040.222257:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340664bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56940:x1848997993695488:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 12918us (13152us total) trans 8589940281 rc 301/301 00000100:00100000:1.0:1763343040.222275:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9660 00000100:00100000:3.0:1763343040.226739:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.227110:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993696128 00000100:00100000:2.0:1763343040.227121:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993696128 00000100:00100000:2.0:1763343040.227167:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3298 00000100:00100000:2.0:1763343040.227177:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56942:x1848997993696128:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343040.227477:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56942:x1848997993696128:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 299us (745us total) trans 8589940282 rc 0/0 00000100:00100000:2.0:1763343040.227484:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3298 00000100:00100000:3.0:1763343040.229114:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.229460:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993696384 00000100:00100000:1.0:1763343040.229469:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993696384 00000100:00100000:1.0:1763343040.229521:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3299 00000100:00100000:1.0:1763343040.229531:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56940:x1848997993696384:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343040.229756:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:56940:x1848997993696384:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 226us (649us total) trans 8589940283 rc 0/0 00000100:00100000:1.0:1763343040.229764:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3299 00000100:00100000:3.0:1763343040.235017:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.236074:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993696896 00000100:00100000:1.0:1763343040.236088:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993696896 00000100:00100000:1.0:1763343040.236153:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3300 00000100:00100000:1.0:1763343040.236163:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:56940:x1848997993696896:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343040.237422:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:56940:x1848997993696896:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1252us (2407us total) trans 8589940284 rc 0/0 00000100:00100000:1.0:1763343040.237438:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3300 00000100:00100000:0.0:1763343040.237866:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.238134:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993696640 00000100:00100000:1.0:1763343040.238142:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993696640 00000100:00100000:1.0:1763343040.238189:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9662 00000100:00100000:1.0:1763343040.239741:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:56942:x1848997993696640:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.239767:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.239794:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8b97 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e64 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.239889:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b9e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.239905:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.239917:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.239929:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae8ba5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.239935:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae8ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.239941:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae8ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240047:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8bac lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240055:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8bac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240062:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8bac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343040.240072:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fe:0x0]: returning size 0 00010000:00010000:1.0:1763343040.240153:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b9e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240160:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b9e lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240167:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b9e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240172:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.240176:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b9e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240183:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b9e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240195:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873b200) 00010000:00010000:1.0:1763343040.240198:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343040.240202:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b9e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240208:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8b9e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240220:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae8ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240226:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae8ba5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240231:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae8ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240236:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3404b77600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.240238:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae8ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240244:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae8ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240254:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873b900) 00010000:00010000:1.0:1763343040.240256:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343040.240259:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae8ba5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.240266:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b77600/0x607405d401ae8ba5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.240341:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8b97 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e64 expref: 278 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.240363:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8bac lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e64 expref: 277 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.240369:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.240371:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343040.240374:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3404b76e00, rc 0) 00000100:00100000:0.0:1763343040.240447:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:56942:x1848997993696640:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 726us (2581us total) trans 8589940285 rc 0/0 00000100:00100000:0.0:1763343040.240455:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9662 00000100:00100000:0.0:1763343040.245246:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.245332:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993697280 00000100:00100000:3.0:1763343040.245343:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993697280 00000100:00100000:2.0:1763343040.245442:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.245478:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993697152 00000100:00100000:0.0:1763343040.245482:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993697152 00000100:00100000:0.0:1763343040.245530:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9663 00000100:00100000:0.0:1763343040.245540:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:55941:x1848997993697152:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343040.245564:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.245585:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8bba lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e6b expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.246035:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.246050:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8bac lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e64 expref: 278 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.246059:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.246090:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8bac lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e64 expref: 278 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.246103:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8bac lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e64 expref: 278 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:0.0:1763343040.246116:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010310656:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343040.246200:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31c00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343040.246360:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6827 00000100:00100000:3.0:1763343040.246369:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993697280:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343040.246378:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343040.246391:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405987600/0x607405d401ae8bc8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e72 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343040.246411:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343040.246424:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.246426:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.246436:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405987600/0x607405d401ae8bc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e72 expref: 15 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343040.246449:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3405987600/0x607405d401ae8bc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e72 expref: 15 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343040.246460:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405987600, rc 0) 00000100:00100000:3.0:1763343040.246500:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993697280:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 132us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343040.246507:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6827 00000100:00100000:2.0:1763343040.251132:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.251226:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010310656:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343040.251255:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343040.251431:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993697536 00000100:00100000:3.0:1763343040.251439:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993697536 00000100:00100000:3.0:1763343040.251710:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3301 00000100:00100000:3.0:1763343040.251720:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+279:56942:x1848997993697536:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343040.251942:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+280:56942:x1848997993697536:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 223us (820us total) trans 8589940286 rc 0/0 00000100:00100000:3.0:1763343040.251950:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3301 00000100:00100000:0.0:1763343040.253252:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.253770:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993697664 00000100:00100000:2.0:1763343040.253780:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993697664 00010000:00010000:2.0:1763343040.253817:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8bac lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e64 expref: 280 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:2.0:1763343040.253877:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3190 00000100:00100000:2.0:1763343040.253887:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+280:2430:x1848997993697664:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.253902:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.253909:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8bac lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e64 expref: 280 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.253922:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8bac lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e64 expref: 280 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.253945:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8bac lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e64 expref: 280 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.255515:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.255523:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.255534:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.255541:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.255587:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343040.255677:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+279:2430:x1848997993697664:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1789us (2426us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.255687:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3190 00010000:00010000:0.0:1763343040.255819:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.255837:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343040.255863:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fe:0x0]: returning size 0 00010000:00010000:0.0:1763343040.255997:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8bba lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e6b expref: 280 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.256014:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e6b expref: 279 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.256021:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.256024:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763343040.256027:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:0.0:1763343040.256072:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+279:55941:x1848997993697152:12345-192.168.204.21@tcp:101:bash.0 Request processed in 10533us (10630us total) trans 8589940287 rc 0/0 00000100:00100000:0.0:1763343040.256080:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9663 00000100:00100000:0.0:1763343040.257860:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.258038:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993697920 00000100:00100000:2.0:1763343040.258048:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993697920 00000100:00100000:2.0:1763343040.258105:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9664 00000100:00100000:2.0:1763343040.258114:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+279:56942:x1848997993697920:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.258135:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.258156:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8bd6 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e79 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.258226:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8bdd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258239:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8bdd lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258250:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8bdd lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258259:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8be4 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258266:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8be4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258273:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8be4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258369:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8beb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258377:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8beb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258384:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8beb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343040.258393:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fe:0x0]: returning size 0 00010000:00010000:2.0:1763343040.258466:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8bdd lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258473:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8bdd lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258479:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8bdd lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258485:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.258489:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8bdd lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258495:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8bdd lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258507:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc200) 00010000:00010000:2.0:1763343040.258510:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.258514:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8bdd lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258520:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8bdd lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258530:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8be4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258536:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8be4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258541:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8be4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258545:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.258548:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8be4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258554:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8be4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258560:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873b900) 00010000:00010000:2.0:1763343040.258562:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.258564:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8be4 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258569:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8be4 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.258599:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8bd6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e79 expref: 282 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.258615:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8beb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e79 expref: 281 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.258664:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.258666:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763343040.258669:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d800, rc 0) 00000100:00100000:2.0:1763343040.258743:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+281:56942:x1848997993697920:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 629us (889us total) trans 8589940288 rc 0/0 00000100:00100000:2.0:1763343040.258750:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9664 00000100:00100000:2.0:1763343040.262989:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.263034:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.263140:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993698304 00000100:00100000:0.0:1763343040.263150:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993698304 00000100:00100000:0.0:1763343040.263215:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9665 00000100:00100000:0.0:1763343040.263225:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+281:55941:x1848997993698304:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343040.263249:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.263271:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8bf9 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e80 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.263306:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8c00 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.263319:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8c00 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.263330:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8c00 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.263440:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8bf9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e80 expref: 283 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.263458:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8c00 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e80 expref: 282 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.263466:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.263469:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343040.263471:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:0.0:1763343040.263532:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:55941:x1848997993698304:12345-192.168.204.21@tcp:101:bash.0 Request processed in 308us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.263539:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9665 00000100:00100000:3.0:1763343040.263600:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993698176 00000100:00100000:3.0:1763343040.263605:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993698176 00000100:00100000:3.0:1763343040.263660:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3302 00000100:00100000:3.0:1763343040.263667:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:56942:x1848997993698176:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343040.263795:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:56942:x1848997993698176:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 128us (816us total) trans 8589940289 rc 0/0 00000100:00100000:3.0:1763343040.263801:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3302 00000100:00100000:2.0:1763343040.268249:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.268720:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993698432 00000100:00100000:0.0:1763343040.268734:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993698432 00000100:00100000:0.0:1763343040.268798:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3303 00000100:00100000:0.0:1763343040.268808:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:56942:x1848997993698432:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:0.0:1763343040.268992:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:56942:x1848997993698432:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 185us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.269000:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3303 00000100:00100000:2.0:1763343040.269074:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.269694:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993698688 00000100:00100000:0.0:1763343040.269701:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993698688 00000100:00100000:0.0:1763343040.269995:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9666 00000100:00100000:0.0:1763343040.270005:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:55941:x1848997993698688:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343040.270050:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343040.270077:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8beb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e79 expref: 283 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.270096:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.270101:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343040.270284:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8c07 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.270298:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8c07 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.270307:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8c07 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000001:00080000:0.0:1763343040.270357:0:28422:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940290 00000004:00010000:0.0:1763343040.270379:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001942ccf0 reply state 00000000c449a9f1 transno 8589940291 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8c07 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.270392:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8c07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.270397:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.270400:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343040.270402:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343040.270486:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+285:55941:x1848997993698688:12345-192.168.204.21@tcp:36:bash.0 Request processed in 483us (1411us total) trans 8589940291 rc 0/0 00000100:00100000:0.0:1763343040.270493:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9666 00000020:00080000:0.0:1763343040.270497:0:28422:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343040.275290:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.275369:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993698816 00000100:00100000:0.0:1763343040.275380:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993698816 00000100:00100000:0.0:1763343040.275439:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9667 00000100:00100000:0.0:1763343040.275450:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+285:55941:x1848997993698816:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343040.275472:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.275494:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8c0e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e87 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.275553:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8c0e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e87 expref: 286 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.275567:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8c0e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e87 expref: 286 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.275585:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.275588:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343040.275592:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:0.0:1763343040.275698:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+286:55941:x1848997993698816:12345-192.168.204.21@tcp:101:bash.0 Request processed in 250us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.275705:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9667 00000100:00100000:1.0:1763343040.280299:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.280729:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993699072 00000100:00100000:2.0:1763343040.280743:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993699072 00000100:00100000:2.0:1763343040.280795:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9668 00000100:00100000:2.0:1763343040.280805:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+286:55941:x1848997993699072:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343040.280824:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.280837:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343040.280865:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8c0e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e87 expref: 286 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.280882:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.280888:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343040.280902:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8c15 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e8e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.280952:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8c1c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.280965:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8c1c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.280975:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8c1c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000040:00080000:2.0:1763343040.281188:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1523, 88 off128064 00000004:00080000:2.0:1763343040.281197:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1233948575651ns, next at 1234129925410ns, rc = 0 00000040:00080000:2.0:1763343040.281234:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1522, 88 off128064 00000004:00080000:2.0:1763343040.281240:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233948618830ns, next at 1234129958002ns, rc = 0 00000040:00080000:2.0:1763343040.281278:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1523, 88 off128152 00000004:00080000:2.0:1763343040.281282:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233948661719ns, next at 1234129958002ns, rc = 0 00000040:00080000:2.0:1763343040.281292:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1524, 88 off128152 00000004:00080000:2.0:1763343040.281295:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1233948674403ns, next at 1234129925410ns, rc = 0 00000001:00080000:3.0:1763343040.285939:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940292 is committed 00000004:00080000:3.0:1763343040.285957:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1002 committed 00000004:00080000:3.0:1763343040.285967:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1003 committed 00000004:00080000:3.0:1763343040.285983:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1002 committed 00000004:00080000:3.0:1763343040.285987:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1001 committed 00000100:00100000:2.0:1763343040.286226:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010311040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343040.286318:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.286360:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343040.286367:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010311168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343040.286390:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763343040.286470:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8c1c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e8e expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.286483:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.286487:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343040.286502:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8c15 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e8e expref: 266 pid: 6525 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343040.286521:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8c1c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e8e expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.286557:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.286560:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343040.286562:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352de00, rc 0) 00000100:00100000:2.0:1763343040.286614:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993699072:12345-192.168.204.21@tcp:101:bash.0 Request processed in 5810us (6323us total) trans 8589940292 rc 0/0 00000100:00100000:2.0:1763343040.286642:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9668 00000100:00100000:1.0:1763343040.286922:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010311680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.286955:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343040.286980:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343040.286986:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010311552:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.287005:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343040.287029:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010311040 00000100:00100000:1.0:1763343040.287037:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010311040 00000100:00100000:1.0:1763343040.287072:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010311168 00000100:00100000:1.0:1763343040.287075:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010311168 00000100:00100000:1.0:1763343040.287090:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010311680 00000100:00100000:1.0:1763343040.287092:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010311680 00000100:00100000:1.0:1763343040.287107:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010311552 00000100:00100000:1.0:1763343040.287110:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010311552 00000100:00100000:1.0:1763343040.287127:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6828 00000100:00100000:1.0:1763343040.287134:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3657:x1848998010311040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343040.287295:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3657:x1848998010311040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 160us (976us total) trans 21474839027 rc 0/0 00000100:00100000:1.0:1763343040.287302:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6828 00000100:00100000:1.0:1763343040.287318:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6829 00000100:00100000:1.0:1763343040.287325:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3657:x1848998010311168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343040.287385:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3657:x1848998010311168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (994us total) trans 21474839028 rc 0/0 00000100:00100000:1.0:1763343040.287390:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6829 00000100:00100000:1.0:1763343040.287402:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6830 00000100:00100000:1.0:1763343040.287409:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3658:x1848998010311680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.287508:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3658:x1848998010311680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (551us total) trans 17179871729 rc 0/0 00000100:00100000:1.0:1763343040.287514:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6830 00000100:00100000:1.0:1763343040.287528:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6831 00000100:00100000:1.0:1763343040.287534:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3658:x1848998010311552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763343040.287590:0:28996:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343040.287593:0:28996:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343040.287595:0:28996:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343040.287598:0:28996:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343040.287600:0:28996:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343040.287659:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3658:x1848998010311552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (652us total) trans 17179871730 rc 0/0 00000100:00100000:1.0:1763343040.287665:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6831 00000004:00080000:1.0:1763343040.287717:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34060ad880/2, rc 0, transno 17179871730 00000100:00100000:1.0:1763343040.287724:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010311552:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763343040.287732:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34060ace00/2, rc 0, transno 17179871729 00000100:00100000:1.0:1763343040.287736:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010311680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343040.287889:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010310784:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343040.287921:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343040.287948:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010311296:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343040.287966:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343040.287983:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1763343040.287988:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340d10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010310912:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343040.288004:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343040.288017:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3535ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010311424:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343040.288036:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343040.288060:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010310784 00000100:00100000:3.0:1763343040.288064:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010310784 00000100:00100000:3.0:1763343040.288088:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010311296 00000100:00100000:3.0:1763343040.288091:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010311296 00000100:00100000:3.0:1763343040.288103:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010310912 00000100:00100000:3.0:1763343040.288105:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010310912 00000100:00100000:3.0:1763343040.288116:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010311424 00000100:00100000:3.0:1763343040.288118:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010311424 00000100:00100000:3.0:1763343040.288132:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6832 00000100:00100000:3.0:1763343040.288138:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3659:x1848998010310784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343040.288153:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:711 count 1 00010000:00010000:3.0:1763343040.288176:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405987e00/0x607405d401ae8c23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288195:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8a71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e02 expref: 18 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288208:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343040.288210:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343040.288214:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405987e00/0x607405d401ae8c23 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288238:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8a71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e02 expref: 18 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288252:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8a71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e02 expref: 18 pid: 8407 timeout: 1333 lvb_type: 0 00000100:00100000:3.0:1763343040.288276:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1848998010311808:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343040.288330:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c180 going to sleep for 11 seconds 00000100:00100000:3.0:1763343040.288349:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6833 00000100:00100000:3.0:1763343040.288357:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3659:x1848998010311296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343040.288368:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:713 count 1 00010000:00010000:3.0:1763343040.288380:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8c2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288391:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae8a9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e10 expref: 14 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288397:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343040.288399:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343040.288402:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8c2a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288420:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae8a9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e10 expref: 14 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288429:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae8a9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e10 expref: 14 pid: 8407 timeout: 1333 lvb_type: 0 00000100:00100000:3.0:1763343040.288438:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010311936:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343040.288461:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343040.288477:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6834 00000100:00100000:3.0:1763343040.288483:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3659:x1848998010310912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343040.288492:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:712 count 1 00002000:00010000:3.0:1763343040.288511:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343040.288516:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae8c31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288523:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.288525:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.288529:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae8c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288544:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae8c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288555:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae8c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288562:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae8c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288578:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343040.288783:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3659:x1848998010310912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 298us (775us total) trans 21474839029 rc 0/0 00000100:00100000:3.0:1763343040.288789:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6834 00000100:00100000:3.0:1763343040.288804:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6835 00000100:00100000:3.0:1763343040.288809:0:8410:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3659:x1848998010311424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343040.288820:0:8410:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:714 count 1 00002000:00010000:3.0:1763343040.288843:0:8410:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343040.288848:0:8410:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8c38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288855:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.288857:0:8410:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.288860:0:8410:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288869:0:8410:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288876:0:8410:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288882:0:8410:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.288894:0:8410:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343040.289000:0:8410:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010311424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 190us (962us total) trans 17179871731 rc 0/0 00000100:00100000:3.0:1763343040.289007:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6835 00010000:00010000:3.0:1763343040.289025:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343040.289031:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae8c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.289038:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405986400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343040.289042:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae8c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.289050:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae8c31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.289066:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae8c31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.289072:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405986400/0x607405d401ae8c31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.289087:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343040.289090:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.289095:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343040.289098:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.289105:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8c38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.289114:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8c38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.289121:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de7200/0x607405d401ae8c38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.289130:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343040.289131:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343040.289133:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343040.289139:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343040.289175:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d10f480/2, rc 0, transno 21474839029 00000100:00100000:3.0:1763343040.289181:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010310912:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763343040.289194:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3535ad1c00/2, rc 0, transno 17179871731 00000100:00100000:3.0:1763343040.289200:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3535ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010311424:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763343040.289385:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8abe lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.289394:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8abe lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.289399:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8abe lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.289404:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.289408:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8abe lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.289414:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8abe lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.289426:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873b900) 00010000:00010000:0.0:1763343040.289429:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.289432:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8abe lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.289438:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8abe lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.289453:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.289459:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.289464:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.289469:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3404b76800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.289471:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.289477:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.289484:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873b900) 00010000:00010000:0.0:1763343040.289486:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.289489:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b58 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.289494:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8b58 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.289510:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8c07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.289514:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8c07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.289519:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8c07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.289523:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.289526:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8c07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.289530:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8c07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.289537:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.289539:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.289542:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8c07 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.289546:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8c07 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00080000:2.0:1763343040.290070:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c3bb80/2, rc 0, transno 21474839028 00000100:00100000:2.0:1763343040.290076:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010311168:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763343040.290083:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d10c700/2, rc 0, transno 21474839027 00000100:00100000:2.0:1763343040.290086:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010311040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343040.294036:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.294501:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1848998010311808:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343040.294527:0:8408:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3405987e00/0x607405d401ae8c23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343040.294611:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993699328 00000100:00100000:3.0:1763343040.294638:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993699328 00000100:00100000:3.0:1763343040.294696:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9669 00000100:00100000:2.0:1763343040.294750:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.294776:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993699456 00000100:00100000:2.0:1763343040.294781:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993699456 00010000:00010000:2.0:1763343040.294804:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8a71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e02 expref: 19 pid: 8407 timeout: 1333 lvb_type: 0 00000100:00100000:2.0:1763343040.294840:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3191 00000100:00100000:2.0:1763343040.294848:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993699456:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.294865:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.294870:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8a71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e02 expref: 19 pid: 8407 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.294882:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8a71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e02 expref: 19 pid: 8407 timeout: 1333 lvb_type: 0 00000100:00100000:1.0:1763343040.294919:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010311936:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343040.294923:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56943:x1848997993699328:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.294936:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8c2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.294940:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343040.294960:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8c3f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e95 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.294990:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8a71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e02 expref: 19 pid: 8407 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.295003:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.295006:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.295009:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405987e00/0x607405d401ae8c23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.295018:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405987e00/0x607405d401ae8c23 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.295026:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c46 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.295038:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c46 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.295047:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c46 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.295059:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c4d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.295066:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.295073:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.295218:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8c54 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.295223:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343040.295227:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8c54 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.295234:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8c54 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343040.295243:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fe:0x0]: returning size 2 00000100:00100000:2.0:1763343040.295287:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993699456:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 439us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.295298:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3191 00000100:00100000:2.0:1763343040.295342:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.295361:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993699584 00000100:00100000:2.0:1763343040.295365:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993699584 00010000:00010000:2.0:1763343040.295379:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae8a9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e10 expref: 15 pid: 8407 timeout: 1333 lvb_type: 0 00000100:00100000:2.0:1763343040.295396:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3192 00000100:00100000:2.0:1763343040.295402:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993699584:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.295410:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.295413:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae8a9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e10 expref: 15 pid: 8407 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.295422:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae8a9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e10 expref: 15 pid: 8407 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.295435:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae8a9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e10 expref: 15 pid: 8407 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.295444:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.295446:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.295448:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.295456:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8c2a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.295474:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343040.295491:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993699584:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 89us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.295496:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3192 00010000:00010000:2.0:1763343040.295512:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.295518:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.295527:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.295534:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.295549:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343040.295740:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.295772:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993699712 00000100:00100000:0.0:1763343040.295776:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993699712 00000100:00100000:2.0:1763343040.295777:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010311296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7421us (7809us total) trans 17179871732 rc 0/0 00000100:00100000:2.0:1763343040.295784:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6833 00000100:00100000:0.0:1763343040.295799:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6836 00010000:00010000:3.0:1763343040.295901:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c46 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.295909:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c46 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.295914:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c46 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.295920:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c46 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.295926:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.295930:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c46 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.295937:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c46 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.295947:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873ab00) 00010000:00010000:3.0:1763343040.295950:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343040.295955:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c46 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.295956:0:8408:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3405987e00/0x607405d401ae8c23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.295961:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c46 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.295965:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405987e00/0x607405d401ae8c23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.295970:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.295972:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405987e00/0x607405d401ae8c23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.295980:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405987e00/0x607405d401ae8c23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.295981:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c4d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.295987:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.295991:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.295994:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.295994:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1763343040.295999:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c4d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.296006:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873a200) 00010000:00010000:3.0:1763343040.296008:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343040.296011:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c4d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.296016:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c4d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.296053:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8c3f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e95 expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.296067:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8c54 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e95 expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.296074:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:3.0:1763343040.296077:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763343040.296079:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a5e400, rc 0) 00000100:00100000:3.0:1763343040.296108:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56943:x1848997993699328:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1187us (2086us total) trans 8589940293 rc 0/0 00000100:00100000:1.0:1763343040.296113:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3659:x1848998010310784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7975us (8191us total) trans 21474839030 rc 0/0 00000100:00100000:3.0:1763343040.296115:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9669 00000100:00100000:0.0:1763343040.296137:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:55941:x1848997993699712:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343040.296153:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.296165:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9e9c expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.296183:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405987600/0x607405d401ae8bc8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e72 expref: 15 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343040.296191:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343040.296192:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343040.296253:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 15 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.296290:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3405987600/0x607405d401ae8bc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e72 expref: 15 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343040.296303:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3405987600/0x607405d401ae8bc8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e72 expref: 15 pid: 8408 timeout: 1333 lvb_type: 1 00000100:00100000:0.0:1763343040.296320:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010312064:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343040.296550:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31c00 going to sleep for 11 seconds 00010000:00010000:0.0:1763343040.296587:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763343040.296592:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.296598:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405987a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343040.296602:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.296609:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8c2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.296644:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8c2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.296651:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405987a00/0x607405d401ae8c2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.296663:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343040.296666:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3405987e00/0x607405d401ae8c23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.296672:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405987e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343040.296675:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405987e00/0x607405d401ae8c23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.296681:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405987e00/0x607405d401ae8c23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.296689:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3405987e00/0x607405d401ae8c23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.296694:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405987e00/0x607405d401ae8c23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.296704:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343040.296706:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343040.296707:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.296794:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763343040.296824:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340d10d880/2, rc 0, transno 21474839030 00000100:00100000:2.0:1763343040.296839:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340d10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010310784:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763343040.296854:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3511f38700/2, rc 0, transno 17179871732 00000100:00100000:2.0:1763343040.296858:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010311296:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.296951:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6832 00000100:00100000:0.0:1763343040.301185:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.301305:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010312064:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343040.301339:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 15 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.301359:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:1.0:1763343040.301419:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:55941:x1848997993699712:12345-192.168.204.21@tcp:101:bash.0 Request processed in 5613us (5679us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.301428:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6836 00000100:00100000:2.0:1763343040.301477:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993699840 00000100:00100000:2.0:1763343040.301486:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993699840 00010000:00010000:2.0:1763343040.301517:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405987600/0x607405d401ae8bc8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e72 expref: 15 pid: 8408 timeout: 1333 lvb_type: 1 00000100:00100000:2.0:1763343040.301556:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3193 00000100:00100000:2.0:1763343040.301564:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2431:x1848997993699840:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.301577:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.301583:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3405987600/0x607405d401ae8bc8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e72 expref: 15 pid: 8408 timeout: 1333 lvb_type: 1 00010000:00010000:2.0:1763343040.301594:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3405987600/0x607405d401ae8bc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e72 expref: 15 pid: 8408 timeout: 1333 lvb_type: 1 00010000:00010000:2.0:1763343040.301617:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405987600/0x607405d401ae8bc8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e72 expref: 15 pid: 8408 timeout: 1333 lvb_type: 1 00010000:00010000:2.0:1763343040.301659:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.301662:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.301669:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.301680:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.301713:0:13199:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 14 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343040.301731:0:13199:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13199:1848998010312192:192.168.204.21@tcp:105: 00000100:00100000:2.0:1763343040.301795:0:13199:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a352011d780 going to sleep for 11 seconds 00000100:00100000:0.0:1763343040.302491:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.303650:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993699968 00000100:00100000:1.0:1763343040.303663:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993699968 00000100:00100000:1.0:1763343040.303714:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6837 00000100:00100000:1.0:1763343040.303723:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993699968:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.303739:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.303758:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3404b76c00/0x607405d401ae8c69 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ea3 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343040.303808:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010312320:192.168.204.21@tcp:106: 00000100:00100000:1.0:1763343040.303880:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343040.304504:0:13199:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3bdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:13199:1848998010312192:192.168.204.21@tcp:105: 00010000:00010000:1.0:1763343040.304521:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343040.304566:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2431:x1848997993699840:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 3001us (3390us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.304575:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3193 00000100:00100000:3.0:1763343040.305248:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.305343:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993700096 00000100:00100000:0.0:1763343040.305350:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993700096 00000100:00100000:0.0:1763343040.305391:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6838 00000100:00100000:0.0:1763343040.305401:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:55941:x1848997993700096:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343040.305416:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.305433:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8c70 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9eaa expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343040.305455:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343040.305473:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343040.305475:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343040.305483:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8c70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eaa expref: 19 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.305496:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8c70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eaa expref: 19 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.305510:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:0.0:1763343040.305553:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:55941:x1848997993700096:12345-192.168.204.21@tcp:101:bash.0 Request processed in 154us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.305559:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6838 00002000:00010000:1.0:1763343040.309681:0:28996:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb mtime: 0 -> 1763343040 00002000:00010000:1.0:1763343040.309692:0:28996:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb atime: 0 -> 1763343040 00002000:00010000:1.0:1763343040.309694:0:28996:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb ctime: 0 -> 1763343040 00000100:00100000:1.0:1763343040.309716:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010312320:192.168.204.21@tcp:106: 00010000:00010000:1.0:1763343040.309753:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3404b76c00/0x607405d401ae8c69 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ea3 expref: 15 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343040.309776:0:28996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3404b76c00/0x607405d401ae8c69 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ea3 expref: 15 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343040.309788:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3404b76c00, rc 0) 00000100:00100000:1.0:1763343040.309877:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993699968:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 6154us (7387us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343040.309885:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6837 00000100:00100000:1.0:1763343040.315389:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.315428:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.315474:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.315549:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993700352 00000100:00100000:0.0:1763343040.315558:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993700352 00000100:00100000:3.0:1763343040.316278:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993700224 00000100:00100000:3.0:1763343040.316294:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993700224 00002000:00010000:3.0:1763343040.316326:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/715 (0->18446744073709551615) 00002000:00100000:3.0:1763343040.316346:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c70000 with x1848997993700224 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343040.316360:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537c70000. 00002000:00010000:0.0:1763343040.316385:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/713 (0->18446744073709551615) 00002000:00100000:0.0:1763343040.316391:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c71f80 with x1848997993700352 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343040.316398:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537c71f80. 00000100:00100000:3.0:1763343040.316399:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1656 00000100:00100000:0.0:1763343040.316423:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1657 00000100:00100000:0.0:1763343040.316433:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993700352:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:0.0:1763343040.316637:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2c9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343040.316641:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2c9:0x0] updating lvb mtime from disk: 0 -> 1763343040 00002000:00010000:0.0:1763343040.316644:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2c9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343040.316646:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2c9:0x0] updating lvb ctime from disk: 0 -> 1763343040 00002000:00010000:0.0:1763343040.316649:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2c9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343040.316720:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993700352:12345-192.168.204.21@tcp:10:bash.0 Request processed in 288us (1340us total) trans 21474839031 rc 0/0 00000100:00100000:0.0:1763343040.316727:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1657 00002000:00010000:0.0:1763343040.316732:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/713 (0->18446744073709551615) 00002000:00100000:0.0:1763343040.316734:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c71f80 with x1848997993700352 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343040.316738:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3537c71f80. 00000100:00100000:3.0:1763343040.316777:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993700224:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343040.316899:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343040.316902:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb mtime from disk: 1763343040 -> 1763343040 00002000:00010000:3.0:1763343040.316904:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb atime from disk: 1763343040 -> 0 00002000:00010000:3.0:1763343040.316907:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb ctime from disk: 1763343040 -> 1763343040 00002000:00010000:3.0:1763343040.316909:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343040.316938:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993700608 00000100:00100000:2.0:1763343040.316944:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993700608 00000100:00100000:3.0:1763343040.316953:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993700224:12345-192.168.204.21@tcp:10:bash.0 Request processed in 541us (1523us total) trans 17179871733 rc 0/0 00000100:00100000:3.0:1763343040.316962:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1656 00002000:00010000:3.0:1763343040.316966:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/715 (0->18446744073709551615) 00002000:00100000:3.0:1763343040.316969:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c70000 with x1848997993700224 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343040.316975:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3537c70000. 00000100:00100000:2.0:1763343040.316987:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3304 00000100:00100000:2.0:1763343040.316997:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56943:x1848997993700608:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343040.317141:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56943:x1848997993700608:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 145us (1665us total) trans 8589940294 rc 0/0 00000100:00100000:2.0:1763343040.317148:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3304 00000100:00100000:1.0:1763343040.325236:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.326550:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993700736 00000100:00100000:3.0:1763343040.326565:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993700736 00000100:00100000:3.0:1763343040.326656:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9670 00000100:00100000:3.0:1763343040.326666:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56943:x1848997993700736:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343040.326697:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343040.326723:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8c77 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9eb1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.326794:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8c7e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.326808:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8c7e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.326819:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8c7e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.326842:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c85 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.326849:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.326855:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.326924:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.326935:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e6b expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.326944:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.326975:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e6b expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.326989:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e6b expref: 266 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:3.0:1763343040.327003:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537b0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010312448:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343040.327095:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1763343040.334603:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.335109:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537b0c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010312448:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343040.335139:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343040.335194:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993700992 00000100:00100000:2.0:1763343040.335202:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993700992 00000100:00100000:2.0:1763343040.335264:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3305 00000100:00100000:2.0:1763343040.335277:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:39339:x1848997993700992:12345-192.168.204.21@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1763343040.336245:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:39339:x1848997993700992:12345-192.168.204.21@tcp:35:ldlm_bl.0 Request processed in 969us (1648us total) trans 8589940295 rc 0/0 00000100:00100000:2.0:1763343040.336255:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3305 00000100:00100000:1.0:1763343040.347505:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.348004:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993701120 00000100:00100000:2.0:1763343040.348013:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993701120 00010000:00010000:2.0:1763343040.348052:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e6b expref: 268 pid: 28422 timeout: 1333 lvb_type: 0 00000100:00100000:2.0:1763343040.348093:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3194 00000100:00100000:2.0:1763343040.348103:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:2430:x1848997993701120:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.348118:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.348125:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e6b expref: 268 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.348137:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e6b expref: 268 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.348160:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8bc1 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e6b expref: 268 pid: 28422 timeout: 1333 lvb_type: 0 00010000:00010000:2.0:1763343040.348175:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.348181:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.348191:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.348198:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.348234:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343040.348300:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:2430:x1848997993701120:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 197us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.348307:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3194 00010000:00010000:0.0:1763343040.348683:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348696:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343040.348742:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fe:0x0]: returning size 5 00000004:00200000:0.0:1763343040.348746:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343040.348764:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348776:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348785:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8c7e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348795:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8c7e lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348800:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8c7e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348806:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8c7e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348812:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.348816:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8c7e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348823:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8c7e lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348856:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a353873ab00) 00010000:00010000:0.0:1763343040.348859:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.348862:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8c7e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348868:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8c7e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348879:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348884:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c85 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348889:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348893:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.348896:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348901:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.348908:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a353873a200) 00010000:00010000:0.0:1763343040.349611:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.349617:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c85 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.349658:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8c85 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.349699:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8c77 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb1 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.349716:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb1 expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.349724:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.349728:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343040.349730:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6000, rc 0) 00000100:00100000:0.0:1763343040.349779:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56943:x1848997993700736:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 23114us (24552us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.349786:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9670 00000100:00100000:1.0:1763343040.361076:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.362681:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993701248 00000100:00100000:0.0:1763343040.362697:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993701248 00000100:00100000:0.0:1763343040.362777:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9671 00000100:00100000:0.0:1763343040.362790:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56944:x1848997993701248:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:0.0:1763343040.362817:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.362856:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8c93 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9eb8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.362949:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8c9a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.362962:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8c9a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.362973:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8c9a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.362985:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8ca1 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.362991:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.362998:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363069:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ca8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363077:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363083:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343040.363132:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fe:0x0]: returning size 5 00000004:00200000:0.0:1763343040.363136:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343040.363153:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363164:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363172:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8c9a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363178:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8c9a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363184:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8c9a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363190:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8c9a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363195:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.363199:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8c9a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363206:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8c9a lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363218:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4200) 00010000:00010000:0.0:1763343040.363221:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.363226:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8c9a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363232:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8c9a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363243:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363250:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8ca1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363256:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363261:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.363265:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363271:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363279:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4a00) 00010000:00010000:0.0:1763343040.363282:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.363285:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8ca1 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363292:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8ca1 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.363320:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8c93 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb8 expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.363335:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb8 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.363342:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.363345:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343040.363347:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:0.0:1763343040.363411:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56944:x1848997993701248:12345-192.168.204.21@tcp:101:rm.0 Request processed in 624us (2344us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.363419:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9671 00000100:00100000:3.0:1763343040.365420:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.368052:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993701504 00000100:00100000:0.0:1763343040.368066:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993701504 00000100:00100000:0.0:1763343040.368148:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9672 00000100:00100000:0.0:1763343040.368158:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56943:x1848997993701504:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.368180:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.368201:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8caf lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ebf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.368309:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.368324:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb1 expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.368333:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ca8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb8 expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.368342:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 5/0,1 mode: --/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.368376:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb8 expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.368388:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb8 expref: 268 pid: 6525 timeout: 1334 lvb_type: 0 00000100:00100000:0.0:1763343040.368400:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a350121b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010312576:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343040.368504:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb1 expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.368516:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb1 expref: 268 pid: 6525 timeout: 1334 lvb_type: 0 00000100:00100000:0.0:1763343040.368525:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3501218000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010312704:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343040.368547:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f316c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343040.378377:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a350121b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010312576:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343040.380248:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.380921:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3501218000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010312704:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343040.380954:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343040.383241:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993701632 00000100:00100000:2.0:1763343040.383256:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993701632 00010000:00010000:2.0:1763343040.383309:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb8 expref: 269 pid: 6525 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343040.383361:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3195 00000100:00100000:2.0:1763343040.383372:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35084c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:2430:x1848997993701632:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.383393:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.383400:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb8 expref: 269 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343040.383412:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb8 expref: 269 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343040.383434:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ca8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb8 expref: 269 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343040.383451:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.383456:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.383465:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.383472:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343040.383539:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35084c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:2430:x1848997993701632:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 169us (3300us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.383547:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3195 00000100:00100000:3.0:1763343040.384703:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.384751:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.384833:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993701760 00000100:00100000:1.0:1763343040.384849:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993701760 00010000:00010000:1.0:1763343040.384878:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb1 expref: 268 pid: 6525 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343040.384914:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3196 00000100:00100000:1.0:1763343040.384922:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:2430:x1848997993701760:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343040.384933:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343040.384938:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb1 expref: 268 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.384949:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb1 expref: 268 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.384966:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8c8c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eb1 expref: 268 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.384979:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:1.0:1763343040.384983:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.384992:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.385001:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.385020:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343040.385056:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:2430:x1848997993701760:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 135us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.385063:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3196 00010000:00010000:0.0:1763343040.385589:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.385598:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343040.385655:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fe:0x0]: returning size 5 00010000:00010000:0.0:1763343040.385785:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8caf lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ebf expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.385800:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ebf expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.385807:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.385809:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763343040.385812:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35029d5a00, rc 0) 00000100:00100000:0.0:1763343040.385858:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56943:x1848997993701504:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 17702us (20447us total) trans 8589940296 rc 0/0 00000100:00100000:0.0:1763343040.385866:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9672 00000100:00100000:0.0:1763343040.385884:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993702016 00000100:00100000:0.0:1763343040.385888:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993702016 00000100:00100000:0.0:1763343040.385907:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9673 00000100:00100000:0.0:1763343040.385913:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56944:x1848997993702016:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:0.0:1763343040.385947:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763343040.385958:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8c1c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e8e expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.385971:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8c54 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e95 expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.385981:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8c00 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e80 expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.385988:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.385991:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343040.386008:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8cc4 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.386017:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8cc4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.386023:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8cc4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.386032:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8ccb lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.386038:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8ccb lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.386044:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8ccb lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.386096:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.386104:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ebf expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.386111:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.386137:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ebf expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.386149:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ebf expref: 264 pid: 6525 timeout: 1334 lvb_type: 0 00000100:00100000:0.0:1763343040.386162:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3501218000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010312832:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343040.386213:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31c00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343040.392947:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.393304:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3501218000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010312832:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343040.393338:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343040.393404:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993702144 00000100:00100000:2.0:1763343040.393411:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993702144 00000100:00100000:2.0:1763343040.393467:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9674 00000100:00100000:2.0:1763343040.393476:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56943:x1848997993702144:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.393495:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.393514:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8cd9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ec6 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.393653:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ce0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.393665:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.393672:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ce0 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.393688:0:28422:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.393696:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ce0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343040.395025:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.399895:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993702272 00000100:00100000:2.0:1763343040.399912:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993702272 00010000:00010000:2.0:1763343040.399962:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ebf expref: 267 pid: 6525 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343040.399995:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3197 00000100:00100000:2.0:1763343040.400006:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:2429:x1848997993702272:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.400021:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.400028:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ebf expref: 267 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343040.400041:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ebf expref: 267 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343040.400062:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5a00/0x607405d401ae8cb6 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1fe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ebf expref: 267 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343040.400079:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.400084:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.400093:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.400099:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.400107:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ce0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.400112:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ce0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.400118:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ce0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.400149:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343040.400203:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:2429:x1848997993702272:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 199us (5181us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.400210:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3197 00010000:00010000:3.0:1763343040.400872:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.400881:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00000004:00080000:3.0:1763343040.401136:0:6525:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x1fe:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1763343040.401221:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401228:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401235:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401241:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.401245:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401253:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401435:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:3.0:1763343040.401439:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763343040.401442:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ce0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.401451:0:6525:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.401457:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ce0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.401485:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401492:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8cd2 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401510:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8cc4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401516:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8cc4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401521:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8cc4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401527:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8cc4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401531:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d5600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.401534:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8cc4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401540:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8cc4 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401547:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4200) 00010000:00010000:3.0:1763343040.401549:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343040.401552:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8cc4 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401557:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d5600/0x607405d401ae8cc4 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:3.0:1763343040.401570:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008accbce7 reply state 00000000cd2f00bd transno 8589940297 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8ccb lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401580:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8ccb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.401585:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4a00) 00010000:00010000:3.0:1763343040.401588:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343040.401590:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343040.401680:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56944:x1848997993702016:12345-192.168.204.21@tcp:36:rm.0 Request processed in 15762us (16924us total) trans 8589940297 rc 0/0 00000100:00100000:3.0:1763343040.401688:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9673 00010000:00010000:2.0:1763343040.401765:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.401772:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343040.401799:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fe:0x0]: returning size 5 00000004:00200000:2.0:1763343040.401803:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343040.401819:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.401866:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8cd9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ec6 expref: 267 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.401882:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ec6 expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.401889:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.401892:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343040.401894:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:2.0:1763343040.401933:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56943:x1848997993702144:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8458us (8996us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.401940:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9674 00000100:00100000:1.0:1763343040.410547:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.410752:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993702528 00000100:00100000:2.0:1763343040.410762:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993702528 00000100:00100000:3.0:1763343040.411983:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9675 00000100:00100000:3.0:1763343040.412003:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56943:x1848997993702528:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343040.412027:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343040.412047:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8ce7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ecd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.412146:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8cee lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.412160:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8cee lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343040.412171:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8cee lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343040.412181:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fe:0x0]: returning size 5 00010000:00010000:3.0:1763343040.412276:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8ce7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ecd expref: 269 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.412293:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8cee lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ecd expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.412301:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:3.0:1763343040.412304:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343040.412307:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7c00, rc 0) 00000100:00100000:3.0:1763343040.412377:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56943:x1848997993702528:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 382us (1839us total) trans 8589940298 rc 0/0 00000100:00100000:3.0:1763343040.412385:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9675 00000100:00100000:2.0:1763343040.415849:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.415937:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993702656 00000100:00100000:0.0:1763343040.415946:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993702656 00000100:00100000:0.0:1763343040.416007:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6839 00000100:00100000:0.0:1763343040.416017:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993702656:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:0.0:1763343040.416059:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae8cfc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.416078:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 15 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.416086:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343040.416088:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343040.416092:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae8cfc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.416126:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 15 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.416139:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 15 pid: 28996 timeout: 1334 lvb_type: 0 00000100:00100000:0.0:1763343040.416154:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3501218000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010312960:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343040.416230:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31c00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343040.423255:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.423337:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.423453:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993702912 00000100:00100000:3.0:1763343040.423462:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993702912 00002000:00100000:3.0:1763343040.423520:0:28426:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x2cb:0x0] (0->4) req@ffff9a3537c73800 x1848997993702912/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:536/0 lens 496/0 e 0 to 0 dl 1763343051 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343040.423530:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c73800 with x1848997993702912 ext(0->4) 00010000:00010000:3.0:1763343040.423538:0:28426:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 16 pid: 28996 timeout: 1334 lvb_type: 0 00010000:00010000:3.0:1763343040.423552:0:28426:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 16 pid: 28996 timeout: 1334 lvb_type: 0 00002000:00010000:3.0:1763343040.423560:0:28426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a3537c73800 00000100:00100000:3.0:1763343040.423593:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 112 00000100:00100000:3.0:1763343040.423604:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993702912:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:2.0:1763343040.424593:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993702784 00000100:00100000:2.0:1763343040.424600:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993702784 00000100:00100000:2.0:1763343040.424663:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9676 00000100:00100000:2.0:1763343040.424671:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56945:x1848997993702784:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.424687:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.424708:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d03 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ed4 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.424768:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8d0a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424781:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8d0a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424792:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8d0a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424801:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d11 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424808:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424813:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424858:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8d0a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424865:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8d0a lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424871:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8d0a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424877:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.424880:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8d0a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424887:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8d0a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424899:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935100) 00010000:00010000:2.0:1763343040.424901:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.424906:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8d0a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424912:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8d0a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424925:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424931:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d11 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424935:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424939:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.424941:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424946:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d11 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424953:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4a00) 00010000:00010000:2.0:1763343040.424955:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.424958:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d11 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424963:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d11 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.424987:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d03 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ed4 expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.424996:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935100) 00010000:00010000:2.0:1763343040.424998:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.425002:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d03 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ed4 expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.425019:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c800, rc 0) 00000100:00100000:0.0:1763343040.425254:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3501218000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010312960:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343040.425643:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2432:x1848997993702912:12345-192.168.204.21@tcp:4:bash.0 Request processed in 2038us (2303us total) trans 17179871734 rc 0/0 00000100:00100000:3.0:1763343040.425654:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 112 00002000:00100000:3.0:1763343040.425664:0:28426:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x2cb:0x0] (0->4) req@ffff9a3537c73800 x1848997993702912/t17179871734(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:536/0 lens 496/448 e 0 to 0 dl 1763343051 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343040.425674:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3537c73800 with x1848997993702912 ext(0->4) 00010000:00010000:3.0:1763343040.425681:0:28426:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 18 pid: 28996 timeout: 1334 lvb_type: 0 00010000:00010000:3.0:1763343040.425695:0:28426:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 18 pid: 28996 timeout: 1334 lvb_type: 0 00002000:00010000:3.0:1763343040.425703:0:28426:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a3537c73800 00010000:00010000:0.0:1763343040.425802:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae8cfc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343040.427463:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56945:x1848997993702784:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2784us (4208us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343040.427474:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9676 00000100:00100000:0.0:1763343040.432103:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.432183:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993703040 00000100:00100000:2.0:1763343040.432192:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993703040 00000100:00100000:2.0:1763343040.432249:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9677 00000100:00100000:2.0:1763343040.432259:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56945:x1848997993703040:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.432290:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.432314:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8d18 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9edb expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.432379:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d1f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432393:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d1f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432404:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d1f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432415:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d26 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432422:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432427:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432466:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d1f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432473:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d1f lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432479:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432484:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.432488:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d1f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432495:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d1f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432507:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935000) 00010000:00010000:2.0:1763343040.432510:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.432514:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d1f lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432520:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d1f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432533:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432539:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432544:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432548:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.432551:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432557:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d26 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432564:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4a00) 00010000:00010000:2.0:1763343040.432567:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.432570:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d26 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432575:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d26 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.432600:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8d18 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9edb expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.432610:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935000) 00010000:00010000:2.0:1763343040.432612:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.432616:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae8d18 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9edb expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.432664:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352ce00, rc 0) 00000100:00100000:2.0:1763343040.432716:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56945:x1848997993703040:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 458us (623us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343040.432723:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9677 00000100:00100000:0.0:1763343040.433522:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.433868:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993703168 00000100:00100000:1.0:1763343040.433875:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993703168 00010000:00010000:1.0:1763343040.433905:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 18 pid: 28996 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343040.433943:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3198 00000100:00100000:1.0:1763343040.433951:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993703168:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343040.433963:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763343040.433980:0:13199:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1763343040.433983:0:13199:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb atime from disk: 0 -> 1763343040 00002000:00010000:1.0:1763343040.433986:0:13199:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763343040.433991:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 18 pid: 28996 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.434008:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 18 pid: 28996 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.434026:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae8c62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9e9c expref: 18 pid: 28996 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.434040:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.434042:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.434047:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae8cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.434057:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae8cfc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.434088:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343040.434123:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993703168:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 174us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.434130:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3198 00010000:00010000:0.0:1763343040.434725:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae8cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.434735:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae8cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.434757:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae8cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.434765:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae8cfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.434772:0:28996:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae8cfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.434778:0:28996:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343040.434782:0:28996:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae8cfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.434789:0:28996:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae8cfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.434803:0:28996:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae8cfc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.434809:0:28996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d177800/0x607405d401ae8cfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343040.434872:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993702656:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 18856us (19033us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.434879:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6839 00000100:00100000:1.0:1763343040.445348:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.445437:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.445506:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993703424 00000100:00100000:2.0:1763343040.445516:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993703424 00000100:00100000:2.0:1763343040.445575:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993703552 00000100:00100000:2.0:1763343040.445579:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993703552 00000100:00100000:2.0:1763343040.445610:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9678 00000100:00100000:2.0:1763343040.445641:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56943:x1848997993703424:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:2.0:1763343040.445687:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.445712:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8ce0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ec6 expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.445732:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.445736:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343040.445762:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d2d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.445774:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d2d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.445783:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d2d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:2.0:1763343040.445989:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1525, 88 off128240 00000004:00080000:2.0:1763343040.445997:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1234113375266ns, next at 1234129925410ns, rc = 0 00000040:00080000:2.0:1763343040.446059:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1524, 88 off128240 00000004:00080000:2.0:1763343040.446064:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1234113443217ns, next at 1234129958002ns, rc = 0 00000040:00080000:2.0:1763343040.446097:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1525, 88 off128328 00000004:00080000:2.0:1763343040.446102:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1234113480861ns, next at 1234129958002ns, rc = 0 00000040:00080000:2.0:1763343040.446118:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1526, 88 off128328 00000004:00080000:2.0:1763343040.446122:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1234113501016ns, next at 1234129925410ns, rc = 0 00000100:00100000:0.0:1763343040.446219:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9679 00000100:00100000:0.0:1763343040.446230:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56945:x1848997993703552:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.446240:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.446254:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8d34 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ee2 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.446292:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8d3b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343040.446300:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8d3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343040.446308:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8d3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343040.446337:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343040.446342:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343040.446370:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8d34 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ee2 expref: 271 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.446384:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8d3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ee2 expref: 270 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.446391:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4300) 00010000:00010000:0.0:1763343040.446394:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343040.446397:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:0.0:1763343040.446461:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56945:x1848997993703552:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 233us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.446467:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9679 00010000:00010000:0.0:1763343040.453484:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8ccb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.453508:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8ccb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.453516:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8ccb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.453522:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35029d4800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.453527:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8ccb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.453535:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8ccb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.453555:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4a00) 00010000:00010000:0.0:1763343040.453559:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.453563:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8ccb lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.453569:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35029d4800/0x607405d401ae8ccb lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000001:00080000:3.0:1763343040.454888:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940299 is committed 00000004:00080000:3.0:1763343040.454900:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1004 committed 00000004:00080000:3.0:1763343040.454917:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1005 committed 00000004:00080000:3.0:1763343040.454924:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1004 committed 00000004:00080000:3.0:1763343040.454926:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1003 committed 00000100:00100000:1.0:1763343040.455133:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34050f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010313216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343040.455196:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343040.455236:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343040.455243:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537c73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010313088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343040.455262:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343040.455294:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010313216 00000100:00100000:1.0:1763343040.455302:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010313216 00000100:00100000:1.0:1763343040.455341:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010313088 00000100:00100000:1.0:1763343040.455344:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010313088 00000100:00100000:1.0:1763343040.455365:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6840 00000100:00100000:1.0:1763343040.455373:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3660:x1848998010313216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343040.455587:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3660:x1848998010313216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 214us (390us total) trans 21474839032 rc 0/0 00000100:00100000:1.0:1763343040.455595:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6840 00000100:00100000:1.0:1763343040.455615:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6841 00000100:00100000:1.0:1763343040.455649:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3660:x1848998010313088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763343040.455702:0:28996:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2c9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343040.455705:0:28996:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2c9:0x0] updating lvb mtime from disk: 1763343040 -> 1763343040 00002000:00010000:1.0:1763343040.455708:0:28996:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2c9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343040.455710:0:28996:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2c9:0x0] updating lvb ctime from disk: 1763343040 -> 1763343040 00002000:00010000:1.0:1763343040.455713:0:28996:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2c9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343040.455738:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3660:x1848998010313088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (474us total) trans 21474839033 rc 0/0 00000100:00100000:1.0:1763343040.455744:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6841 00000004:00080000:1.0:1763343040.455792:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537c73100/2, rc 0, transno 21474839033 00000100:00100000:1.0:1763343040.455798:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537c73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010313088:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343040.455807:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34050f4000/2, rc 0, transno 21474839032 00000100:00100000:1.0:1763343040.455810:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34050f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010313216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343040.455942:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000004:00010000:2.0:1763343040.455990:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000839ec15 reply state 00000000fe1a2346 transno 8589940299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d2d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456007:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456016:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.456019:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1763343040.456023:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1763343040.456089:0:28422:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1763343040.456103:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56943:x1848997993703424:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 10485us (10765us total) trans 8589940299 rc 0/0 00000100:00100000:2.0:1763343040.456110:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9678 00010000:00010000:2.0:1763343040.456130:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456137:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456143:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456148:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.456152:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456159:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456168:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.456170:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343040.456174:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d2d lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456179:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d2d lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343040.456197:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993703680 00000100:00100000:2.0:1763343040.456202:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993703680 00000100:00100000:2.0:1763343040.456223:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9680 00000100:00100000:2.0:1763343040.456229:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56945:x1848997993703680:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.456241:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.456255:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d42 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ee9 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.456321:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d49 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456332:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d49 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456339:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d49 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456352:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d50 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456358:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456364:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456402:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d49 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456408:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d49 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456413:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456422:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.456424:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456429:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d49 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456436:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4300) 00010000:00010000:2.0:1763343040.456439:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.456441:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d49 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456446:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d49 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456455:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456460:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d50 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456465:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456469:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.456471:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456477:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d50 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456483:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935000) 00010000:00010000:2.0:1763343040.456485:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.456488:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d50 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456493:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d50 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.456518:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d42 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ee9 expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.456527:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4300) 00010000:00010000:2.0:1763343040.456530:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.456534:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d42 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ee9 expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.456542:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d800, rc 0) 00000100:00100000:2.0:1763343040.456564:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56945:x1848997993703680:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 334us (623us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343040.456571:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9680 00000100:00100000:0.0:1763343040.456740:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010313344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343040.456775:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343040.456802:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343040.456807:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010313472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343040.456837:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343040.456864:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010313344 00000100:00100000:0.0:1763343040.456868:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010313344 00000100:00100000:0.0:1763343040.456893:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010313472 00000100:00100000:0.0:1763343040.456895:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010313472 00000100:00100000:0.0:1763343040.456912:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6842 00000100:00100000:0.0:1763343040.456919:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3657:x1848998010313344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343040.457040:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3657:x1848998010313344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (264us total) trans 17179871735 rc 0/0 00000100:00100000:0.0:1763343040.457047:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6842 00000100:00100000:0.0:1763343040.457061:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6843 00000100:00100000:0.0:1763343040.457067:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3657:x1848998010313472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343040.457133:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3657:x1848998010313472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (294us total) trans 17179871736 rc 0/0 00000100:00100000:0.0:1763343040.457139:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6843 00000004:00080000:0.0:1763343040.457175:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062cb800/2, rc 0, transno 17179871736 00000100:00100000:0.0:1763343040.457180:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010313472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343040.457188:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062c8000/2, rc 0, transno 17179871735 00000100:00100000:0.0:1763343040.457190:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010313344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343040.464069:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.464246:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993703808 00000100:00100000:1.0:1763343040.464257:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993703808 00000100:00100000:1.0:1763343040.464336:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9681 00000100:00100000:1.0:1763343040.464346:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56943:x1848997993703808:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.464373:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.464404:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8d57 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ef0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.464466:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8d57 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef0 expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.464482:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8d57 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef0 expref: 262 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.464500:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:1.0:1763343040.464503:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343040.464506:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3404b76c00, rc 0) 00000100:00100000:1.0:1763343040.464567:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56943:x1848997993703808:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 222us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.464574:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9681 00000100:00100000:3.0:1763343040.464898:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.465163:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993704064 00000100:00100000:2.0:1763343040.465169:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993704064 00000100:00100000:2.0:1763343040.465209:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9682 00000100:00100000:2.0:1763343040.465216:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56945:x1848997993704064:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.465227:0:6523:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.465230:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343040.465252:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8d3b lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ee2 expref: 262 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.465277:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4300) 00010000:00010000:2.0:1763343040.465285:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343040.465296:0:6523:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d5e lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ef7 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.465419:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d65 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.465429:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d65 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.465437:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d65 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.465448:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d6c lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.465455:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.465461:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.465896:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d73 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.465906:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d73 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.465914:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d73 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00200000:2.0:1763343040.465924:0:6523:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ff:0x0]: returning size 0 00010000:00010000:2.0:1763343040.465950:0:6523:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d65 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.465957:0:6523:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d65 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.465964:0:6523:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d65 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.465971:0:6523:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d65 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.465977:0:6523:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.465982:0:6523:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d65 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.465990:0:6523:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d65 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.465999:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3518935000) 00010000:00010000:2.0:1763343040.466002:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.466006:0:6523:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d65 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.466012:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d65 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00000004:00010000:2.0:1763343040.466024:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004a4f67bd reply state 00000000511d7e4e transno 8589940300 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d6c lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.466035:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.466041:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935100) 00010000:00010000:2.0:1763343040.466043:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343040.466045:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343040.466072:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d5e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef7 expref: 264 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.466093:0:6523:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d73 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef7 expref: 263 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.466101:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a3518935500) 00010000:00010000:2.0:1763343040.466104:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343040.466106:0:6523:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c800, rc 0) 00000100:00100000:2.0:1763343040.466166:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56945:x1848997993704064:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 949us (1268us total) trans 8589940300 rc 0/0 00000100:00100000:2.0:1763343040.466173:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9682 00000100:00100000:3.0:1763343040.471738:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.474087:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993704192 00000100:00100000:2.0:1763343040.474103:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993704192 00000100:00100000:2.0:1763343040.474176:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9683 00000100:00100000:2.0:1763343040.474187:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56943:x1848997993704192:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.474207:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.474230:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8d81 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9efe expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.474302:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8d88 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.474317:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8d88 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.474328:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8d88 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343040.474380:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1fe:0x0]: returning size 5 00000004:00200000:2.0:1763343040.474384:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343040.474405:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8d88 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.474429:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae8d81 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9efe expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.474445:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8d88 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9efe expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.474454:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.474458:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763343040.474461:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d400, rc 0) 00000100:00100000:2.0:1763343040.474538:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56943:x1848997993704192:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 352us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.474545:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9683 00000100:00100000:1.0:1763343040.475583:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.475672:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993704448 00000100:00100000:2.0:1763343040.475680:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993704448 00000100:00100000:2.0:1763343040.475720:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9684 00000100:00100000:2.0:1763343040.475729:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56945:x1848997993704448:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.475747:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.475763:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d8f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f05 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.475884:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d96 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.475897:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d73 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef7 expref: 266 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.475905:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d96 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.475938:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d73 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef7 expref: 266 pid: 6523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.475949:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d73 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef7 expref: 266 pid: 6523 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343040.475962:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010313600:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343040.476032:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35079f5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1763343040.482523:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.482656:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993704576 00000100:00100000:1.0:1763343040.482666:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993704576 00000100:00100000:1.0:1763343040.482712:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6844 00000100:00100000:1.0:1763343040.482721:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2429:x1848997993704576:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.482739:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.482760:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3404b77600/0x607405d401ae8d9d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f0c expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343040.482782:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cb:0x0] initial LVB size: 5, mtime: 0x691a7ac0, atime: 0x691a7ac0, ctime: 0x691a7ac0, blocks: 0x8 00010000:00010000:1.0:1763343040.482801:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.482803:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.482811:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3404b77600/0x607405d401ae8d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f0c expref: 17 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343040.482836:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3404b77600/0x607405d401ae8d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f0c expref: 17 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343040.482849:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3404b77600, rc 0) 00000100:00100000:1.0:1763343040.482905:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993704576:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 185us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.482911:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6844 00000100:00100000:2.0:1763343040.485238:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010313600:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343040.485269:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d96 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343040.485602:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.485806:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993704704 00000100:00100000:2.0:1763343040.485814:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993704704 00010000:00010000:2.0:1763343040.485854:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d73 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef7 expref: 267 pid: 6523 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343040.485889:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3199 00000100:00100000:2.0:1763343040.485898:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:2430:x1848997993704704:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.485912:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.485917:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d73 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef7 expref: 267 pid: 6523 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343040.485928:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d73 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef7 expref: 267 pid: 6523 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343040.485947:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8d73 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef7 expref: 267 pid: 6523 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343040.485962:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a3518935500) 00010000:00010000:2.0:1763343040.485967:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d96 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.485975:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d96 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.485981:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d96 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.485999:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343040.486068:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d96 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.486076:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d96 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343040.486096:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ff:0x0]: returning size 0 00000004:00080000:3.0:1763343040.486586:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2cb:0x0], index 0: 0 00000004:00080000:3.0:1763343040.486596:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2cd:0x0], index 1: 0 00000004:00080000:3.0:1763343040.486601:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2ce:0x0], index 1: 0 00000004:00080000:3.0:1763343040.486605:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2cc:0x0], index 0: 0 00000100:00100000:2.0:1763343040.486668:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:2430:x1848997993704704:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 769us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.486676:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3199 00010000:00010000:3.0:1763343040.487023:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d96 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.487031:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d96 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.487038:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d96 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.487044:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.487049:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d96 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.487056:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d96 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.487066:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a3518935500) 00010000:00010000:3.0:1763343040.487070:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343040.487073:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d96 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.487079:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8d96 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.487129:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d8f lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f05 expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.487138:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a3518935500) 00010000:00010000:3.0:1763343040.487140:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343040.487143:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8d8f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f05 expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.487156:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d800, rc 0) 00000100:00100000:3.0:1763343040.487209:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56945:x1848997993704448:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 11481us (11631us total) trans 8589940301 rc 301/301 00000100:00100000:3.0:1763343040.487216:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9684 00000100:00100000:0.0:1763343040.496324:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.497550:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993704960 00000100:00100000:2.0:1763343040.497564:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993704960 00000100:00100000:1.0:1763343040.497769:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3306 00000100:00100000:1.0:1763343040.497780:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56945:x1848997993704960:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343040.499567:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56945:x1848997993704960:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1779us (3244us total) trans 8589940302 rc 0/0 00000100:00100000:1.0:1763343040.499579:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3306 00000100:00100000:2.0:1763343040.503442:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.507165:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993705216 00000100:00100000:1.0:1763343040.507180:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993705216 00000100:00100000:1.0:1763343040.507256:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3307 00000100:00100000:1.0:1763343040.507266:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56945:x1848997993705216:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343040.507526:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56945:x1848997993705216:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 261us (4094us total) trans 8589940303 rc 0/0 00000100:00100000:1.0:1763343040.507534:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3307 00000100:00100000:2.0:1763343040.537931:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.538074:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993705472 00000100:00100000:3.0:1763343040.538084:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993705472 00000100:00100000:3.0:1763343040.538147:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9685 00000100:00100000:3.0:1763343040.538158:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:55941:x1848997993705472:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343040.538184:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343040.538210:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8dab lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f13 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.538461:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae8db2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.538475:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae8db2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.538486:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae8db2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.538500:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8db9 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.538507:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8db9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.538512:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8db9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.538568:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8dc0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.538577:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.538583:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343040.538592:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ff:0x0]: returning size 0 00010000:00010000:2.0:1763343040.539467:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae8db2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.539480:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae8db2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.539487:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae8db2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.539493:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.539497:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae8db2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.539508:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae8db2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.539521:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616600) 00010000:00010000:2.0:1763343040.539524:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.539529:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae8db2 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.539535:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae8db2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.539548:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8db9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.539555:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8db9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.539561:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8db9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.539565:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.539569:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8db9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.539575:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8db9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.539581:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935100) 00010000:00010000:2.0:1763343040.539584:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.539587:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8db9 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.539592:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8db9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.539686:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8dab lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f13 expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.539706:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f13 expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.539714:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a3404616c00) 00010000:00010000:2.0:1763343040.539716:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343040.539719:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6600, rc 0) 00000100:00100000:2.0:1763343040.539797:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:55941:x1848997993705472:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1641us (1875us total) trans 8589940304 rc 0/0 00000100:00100000:2.0:1763343040.539806:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9685 00000100:00100000:2.0:1763343040.547356:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.548947:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993705600 00000100:00100000:0.0:1763343040.548962:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993705600 00000100:00100000:1.0:1763343040.549760:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9686 00000100:00100000:1.0:1763343040.549775:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:55941:x1848997993705600:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343040.549802:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.549836:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae8dce lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f1a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.549875:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8dd5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.549889:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.549901:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.550014:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76200/0x607405d401ae8dce lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f1a expref: 271 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.550034:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f1a expref: 270 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.550043:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a3404616c00) 00010000:00010000:1.0:1763343040.550046:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343040.550049:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3404b76800, rc 0) 00000100:00100000:1.0:1763343040.550121:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:55941:x1848997993705600:12345-192.168.204.21@tcp:101:bash.0 Request processed in 350us (2778us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.550128:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9686 00000100:00100000:1.0:1763343040.554602:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.554725:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993705728 00000100:00100000:0.0:1763343040.554736:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993705728 00000100:00100000:0.0:1763343040.554799:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6845 00000100:00100000:0.0:1763343040.554810:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993705728:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:0.0:1763343040.555551:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993705728:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 739us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.555559:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6845 00000100:00100000:2.0:1763343040.555773:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.555849:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993705984 00000100:00100000:0.0:1763343040.555855:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993705984 00000100:00100000:0.0:1763343040.555896:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9687 00000100:00100000:0.0:1763343040.555904:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:55941:x1848997993705984:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343040.555949:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343040.555976:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8dc0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f13 expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.555994:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a3404616c00) 00010000:00010000:0.0:1763343040.555999:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343040.556172:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ddc lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.556187:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ddc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.556197:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ddc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000001:00080000:0.0:1763343040.556240:0:28422:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940305 00000004:00010000:0.0:1763343040.556263:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004a92d54c reply state 000000005ee044f1 transno 8589940306 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ddc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.556274:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ddc lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.556280:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a3404616c00) 00010000:00010000:0.0:1763343040.556283:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343040.556286:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343040.556363:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:55941:x1848997993705984:12345-192.168.204.21@tcp:36:bash.0 Request processed in 459us (590us total) trans 8589940306 rc 0/0 00000100:00100000:0.0:1763343040.556370:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9687 00000020:00080000:0.0:1763343040.556374:0:28422:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343040.557519:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.557723:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993706112 00000100:00100000:0.0:1763343040.557732:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993706112 00000100:00100000:0.0:1763343040.557779:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6846 00000100:00100000:0.0:1763343040.557788:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993706112:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:0.0:1763343040.557897:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993706112:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 109us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.557903:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6846 00000100:00100000:3.0:1763343040.558244:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.558393:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993706240 00000100:00100000:1.0:1763343040.558398:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993706240 00000100:00100000:1.0:1763343040.558439:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9688 00000100:00100000:1.0:1763343040.558446:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:55941:x1848997993706240:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343040.558462:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.558483:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8de3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f21 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.558531:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8de3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f21 expref: 273 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.558544:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8de3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f21 expref: 273 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.558561:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a3404616c00) 00010000:00010000:1.0:1763343040.558565:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343040.558569:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3404b76e00, rc 0) 00000100:00100000:1.0:1763343040.558609:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:55941:x1848997993706240:12345-192.168.204.21@tcp:101:bash.0 Request processed in 163us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.558615:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9688 00000100:00100000:2.0:1763343040.561248:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.561339:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.561416:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993706368 00000100:00100000:3.0:1763343040.561427:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993706368 00000100:00100000:3.0:1763343040.561493:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1658 00000100:00100000:3.0:1763343040.561504:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993706368:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:3.0:1763343040.561561:0:28426:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae8dea lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.561575:0:28426:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.561578:0:28426:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.561584:0:28426:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae8dea lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.561601:0:28426:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae8dea lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.561734:0:28426:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae8dea lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.561742:0:28426:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae8dea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.561750:0:28426:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae8dea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.561756:0:28426:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343040.561760:0:28426:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae8dea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.561768:0:28426:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae8dea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.561784:0:28426:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae8dea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.561791:0:28426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae8dea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28426 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343040.561866:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993706368:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 363us (627us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763343040.561874:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1658 00000100:00100000:0.0:1763343040.562246:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993706624 00000100:00100000:0.0:1763343040.562251:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993706624 00000100:00100000:0.0:1763343040.562284:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9689 00000100:00100000:0.0:1763343040.562292:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c3bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:55941:x1848997993706624:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343040.562304:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.562307:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343040.562326:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8de3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f21 expref: 273 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.562340:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a3404616c00) 00010000:00010000:0.0:1763343040.562345:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343040.562354:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8df1 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f28 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.562392:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8df8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.562404:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8df8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.562411:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8df8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:0.0:1763343040.562681:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1526, 88 off128416 00000004:00080000:0.0:1763343040.562690:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1234230068488ns, next at 1234129958002ns, rc = 0 00000040:00080000:0.0:1763343040.562720:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1527, 88 off128416 00000004:00080000:0.0:1763343040.562725:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1234230104123ns, next at 1234129925410ns, rc = 0 00000040:00080000:0.0:1763343040.562749:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1528, 88 off128504 00000004:00080000:0.0:1763343040.562754:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1234230133453ns, next at 1234129925410ns, rc = 0 00000040:00080000:0.0:1763343040.562764:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1527, 88 off128504 00000004:00080000:0.0:1763343040.562767:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1234230146585ns, next at 1234129958002ns, rc = 0 00000001:00080000:3.0:1763343040.565851:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940307 is committed 00000004:00080000:3.0:1763343040.565865:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1007 committed 00010000:00010000:2.0:1763343040.566085:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.566097:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d6c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.566103:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.566109:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.566112:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.566120:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d6c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.566135:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3518935100) 00010000:00010000:2.0:1763343040.566139:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.566144:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d6c lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.566149:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8d6c lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.566172:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ddc lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.566177:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ddc lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.566182:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ddc lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.566186:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.566189:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ddc lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.566194:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ddc lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.566202:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a3404616c00) 00010000:00010000:2.0:1763343040.566204:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.566207:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ddc lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.566213:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ddc lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1ff:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00080000:3.0:1763343040.566244:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1006 committed 00000004:00080000:3.0:1763343040.566367:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1005 committed 00000004:00080000:3.0:1763343040.566374:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1006 committed 00000100:00100000:1.0:1763343040.566560:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34050f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010313856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343040.566649:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343040.566687:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763343040.566693:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34050f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010313728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343040.566715:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343040.566747:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010313856 00000100:00100000:1.0:1763343040.566754:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010313856 00000100:00100000:1.0:1763343040.566793:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010313728 00000100:00100000:1.0:1763343040.566795:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010313728 00000100:00100000:1.0:1763343040.566813:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6847 00000100:00100000:1.0:1763343040.566830:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3660:x1848998010313856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343040.567001:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3660:x1848998010313856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (352us total) trans 21474839034 rc 0/0 00000100:00100000:1.0:1763343040.567009:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6847 00000100:00100000:1.0:1763343040.567025:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6848 00000100:00100000:1.0:1763343040.567031:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3660:x1848998010313728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343040.567102:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3660:x1848998010313728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (385us total) trans 21474839035 rc 0/0 00000100:00100000:1.0:1763343040.567108:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6848 00000004:00080000:1.0:1763343040.567150:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34050f5500/2, rc 0, transno 21474839035 00000100:00100000:2.0:1763343040.567156:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010313984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.567156:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34050f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010313728:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343040.567165:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34050f7100/2, rc 0, transno 21474839034 00000100:00100000:1.0:1763343040.567168:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34050f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010313856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343040.567183:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.567260:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343040.567266:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340664a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010314112:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343040.567290:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343040.567364:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010313984 00000100:00100000:0.0:1763343040.567369:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010313984 00000100:00100000:0.0:1763343040.567392:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010314112 00000100:00100000:0.0:1763343040.567395:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010314112 00000100:00100000:0.0:1763343040.567407:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6849 00000100:00100000:0.0:1763343040.567413:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3657:x1848998010313984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.567504:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6850 00000100:00100000:1.0:1763343040.567511:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e9cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3657:x1848998010314112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343040.567519:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3657:x1848998010313984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (336us total) trans 17179871737 rc 0/0 00000100:00100000:0.0:1763343040.567525:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6849 00010000:00010000:0.0:1763343040.567577:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8df8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ff:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f28 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.567589:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a3404616c00) 00000100:00100000:1.0:1763343040.567590:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e9cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3657:x1848998010314112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (287us total) trans 17179871738 rc 0/0 00010000:00010000:0.0:1763343040.567592:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:1.0:1763343040.567596:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6850 00010000:00010000:0.0:1763343040.567605:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8df1 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f28 expref: 265 pid: 28422 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763343040.567636:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8df8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1ff:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f28 expref: 264 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.567667:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a3404616c00) 00010000:00010000:0.0:1763343040.567670:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763343040.567672:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:0.0:1763343040.567721:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c3bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993706624:12345-192.168.204.21@tcp:101:bash.0 Request processed in 5431us (6382us total) trans 8589940307 rc 0/0 00000100:00100000:0.0:1763343040.567728:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9689 00000004:00080000:2.0:1763343040.567966:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340664a300/2, rc 0, transno 17179871738 00000100:00100000:2.0:1763343040.567972:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340664a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010314112:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343040.567982:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c3bdf80/2, rc 0, transno 17179871737 00000100:00100000:2.0:1763343040.567985:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010313984:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343040.570988:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.571078:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993706752 00000100:00100000:1.0:1763343040.571087:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993706752 00000100:00100000:1.0:1763343040.571145:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6851 00000100:00100000:1.0:1763343040.571156:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:55941:x1848997993706752:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343040.571172:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.571194:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76200/0x607405d401ae8dff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f2f expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343040.571222:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343040.571241:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.571244:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.571252:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76200/0x607405d401ae8dff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f2f expref: 21 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.571275:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76200/0x607405d401ae8dff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f2f expref: 21 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.571287:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3404b76200, rc 0) 00000100:00100000:1.0:1763343040.571343:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:55941:x1848997993706752:12345-192.168.204.21@tcp:101:bash.0 Request processed in 189us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.571350:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6851 00000100:00100000:3.0:1763343040.571980:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.572104:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993706880 00000100:00100000:0.0:1763343040.572110:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993706880 00000100:00100000:0.0:1763343040.572153:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9690 00000100:00100000:0.0:1763343040.572160:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56943:x1848997993706880:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.572175:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.572189:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8e06 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f36 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.572219:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8e0d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.572231:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8e0d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.572242:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8e0d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.572355:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8e06 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f36 expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.572373:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176600/0x607405d401ae8e0d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f36 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.572386:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.572389:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343040.572393:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176600, rc 0) 00000100:00100000:0.0:1763343040.572441:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56943:x1848997993706880:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 280us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.572447:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9690 00000100:00100000:2.0:1763343040.573395:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.573499:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993707008 00000100:00100000:1.0:1763343040.573505:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993707008 00000100:00100000:1.0:1763343040.573576:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6852 00000100:00100000:1.0:1763343040.573585:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993707008:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343040.573599:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.573646:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3537b6cc00/0x607405d401ae8e14 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f3d expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343040.573670:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343040.573686:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.573688:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.573696:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3537b6cc00/0x607405d401ae8e14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f3d expref: 18 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.573715:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a3537b6cc00/0x607405d401ae8e14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f3d expref: 18 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.573724:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3537b6cc00, rc 0) 00000100:00100000:1.0:1763343040.573764:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:55941:x1848997993707008:12345-192.168.204.21@tcp:101:bash.0 Request processed in 180us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.573771:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6852 00000100:00100000:2.0:1763343040.575001:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.575200:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993707136 00000100:00100000:1.0:1763343040.575209:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993707136 00000100:00100000:1.0:1763343040.575271:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1659 00000100:00100000:1.0:1763343040.575281:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993707136:12345-192.168.204.21@tcp:4:lfs.0 00002000:00010000:1.0:1763343040.575322:0:24024:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343040.575330:0:24024:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6c200/0x607405d401ae8e1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.575340:0:24024:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.575342:0:24024:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.575346:0:24024:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6c200/0x607405d401ae8e1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.575358:0:24024:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6c200/0x607405d401ae8e1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343040.576384:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.576416:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.576909:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993707392 00000100:00100000:3.0:1763343040.576916:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993707392 00002000:00010000:3.0:1763343040.576944:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/717 (0->18446744073709551615) 00002000:00100000:3.0:1763343040.576949:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062cbb80 with x1848997993707392 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343040.576959:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34062cbb80. 00000100:00100000:3.0:1763343040.576978:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993707264 00000100:00100000:3.0:1763343040.576981:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993707264 00002000:00010000:3.0:1763343040.576990:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/715 (0->18446744073709551615) 00002000:00100000:3.0:1763343040.576993:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062cb100 with x1848997993707264 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343040.576998:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34062cb100. 00000100:00100000:3.0:1763343040.577022:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1660 00000100:00100000:3.0:1763343040.577030:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993707392:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343040.577146:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2cd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343040.577150:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2cd:0x0] updating lvb mtime from disk: 0 -> 1763343040 00002000:00010000:3.0:1763343040.577152:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2cd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343040.577154:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2cd:0x0] updating lvb ctime from disk: 0 -> 1763343040 00002000:00010000:3.0:1763343040.577156:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2cd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343040.577205:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993707392:12345-192.168.204.21@tcp:10:bash.0 Request processed in 175us (825us total) trans 17179871739 rc 0/0 00000100:00100000:3.0:1763343040.577212:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1660 00002000:00010000:3.0:1763343040.577215:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/717 (0->18446744073709551615) 00002000:00100000:3.0:1763343040.577219:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062cbb80 with x1848997993707392 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343040.577223:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34062cbb80. 00000100:00100000:3.0:1763343040.577240:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1661 00000100:00100000:3.0:1763343040.577246:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993707264:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343040.578453:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2cb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343040.578458:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2cb:0x0] updating lvb mtime from disk: 0 -> 1763343040 00002000:00010000:2.0:1763343040.578461:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2cb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343040.578463:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2cb:0x0] updating lvb ctime from disk: 0 -> 1763343040 00002000:00010000:2.0:1763343040.578465:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2cb:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343040.578506:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2430:x1848997993707264:12345-192.168.204.21@tcp:10:bash.0 Request processed in 1258us (2087us total) trans 21474839037 rc 0/0 00000100:00100000:2.0:1763343040.578515:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1661 00002000:00010000:2.0:1763343040.578519:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/715 (0->18446744073709551615) 00002000:00100000:2.0:1763343040.578522:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34062cb100 with x1848997993707264 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343040.578527:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34062cb100. 00000001:00080000:0.0:1763343040.580200:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839036 is committed 00000001:00080000:0.0:1763343040.580216:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839035 is committed 00000100:00100000:3.0:1763343040.586340:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.586612:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993707648 00000100:00100000:0.0:1763343040.586653:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993707648 00000100:00100000:0.0:1763343040.586706:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3308 00000100:00100000:0.0:1763343040.586716:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993707648:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343040.587010:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:55941:x1848997993707648:12345-192.168.204.21@tcp:35:bash.0 Request processed in 293us (676us total) trans 8589940308 rc 0/0 00000100:00100000:0.0:1763343040.587018:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3308 00002000:00010000:1.0:1763343040.587946:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2ca:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1763343040.587952:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2ca:0x0] updating lvb mtime from disk: 0 -> 1763343040 00002000:00010000:1.0:1763343040.587955:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2ca:0x0] updating lvb ctime from disk: 0 -> 1763343040 00002000:00010000:1.0:1763343040.587958:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2ca:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763343040.587971:0:24024:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6c200/0x607405d401ae8e1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.587983:0:24024:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6c200/0x607405d401ae8e1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.587992:0:24024:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6c200/0x607405d401ae8e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.587999:0:24024:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3537b6c200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343040.588004:0:24024:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6c200/0x607405d401ae8e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.588013:0:24024:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6c200/0x607405d401ae8e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.588033:0:24024:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6c200/0x607405d401ae8e1b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.588041:0:24024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6c200/0x607405d401ae8e1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24024 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343040.588109:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2430:x1848997993707136:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 12828us (13112us total) trans 21474839036 rc 0/0 00000100:00100000:1.0:1763343040.588118:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1659 00000100:00100000:3.0:1763343040.602347:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.602451:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993707776 00000100:00100000:1.0:1763343040.602464:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993707776 00000100:00100000:1.0:1763343040.602529:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9691 00000100:00100000:1.0:1763343040.602539:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56946:x1848997993707776:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:1.0:1763343040.602564:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.602589:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae8e22 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f44 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.602740:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8e29 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.602757:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8e29 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.602770:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8e29 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.602783:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e30 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.602790:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.602795:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.602894:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae8e37 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.602904:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae8e37 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.602911:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae8e37 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343040.602959:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1ff:0x0]: returning size 5 00000004:00200000:1.0:1763343040.602963:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343040.602983:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae8e37 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.602994:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae8e37 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603002:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8e29 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603007:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8e29 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603013:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8e29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603018:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8e29 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603024:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3537b6d200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.603027:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8e29 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603035:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8e29 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603046:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039dc200) 00010000:00010000:1.0:1763343040.603050:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343040.603054:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8e29 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603060:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8e29 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603072:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603077:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e30 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603083:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603087:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d170600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.603090:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603094:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e30 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603100:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039dc500) 00010000:00010000:1.0:1763343040.603102:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343040.603105:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e30 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603109:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e30 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.603136:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae8e22 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f44 expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.603149:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae8e37 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f44 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.603155:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a3404616c00) 00010000:00010000:1.0:1763343040.603157:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343040.603159:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d171200, rc 0) 00000100:00100000:1.0:1763343040.603216:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56946:x1848997993707776:12345-192.168.204.21@tcp:101:rm.0 Request processed in 679us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.603223:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9691 00000100:00100000:3.0:1763343040.623840:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.623915:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.624123:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993708032 00000100:00100000:1.0:1763343040.624134:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993708032 00000100:00100000:1.0:1763343040.624191:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993708288 00000100:00100000:1.0:1763343040.624194:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993708288 00000100:00100000:1.0:1763343040.624235:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9692 00000100:00100000:1.0:1763343040.624245:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56946:x1848997993708032:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:1.0:1763343040.624303:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343040.624330:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8df8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1ff:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f28 expref: 268 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.624353:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171200/0x607405d401ae8e37 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f44 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.624366:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8dd5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1ff:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f1a expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.624377:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a3404616c00) 00010000:00010000:1.0:1763343040.624388:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343040.624413:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e3e lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.624426:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e3e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.624435:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e3e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.624448:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae8e45 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.624454:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae8e45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.624461:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae8e45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.624540:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae8e4c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.624547:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae8e4c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.624553:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae8e4c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000040:00080000:1.0:1763343040.624875:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1528, 64 off128568 00000004:00080000:1.0:1763343040.624883:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1234292262046ns, next at 1235292259329ns, rc = 0 00000040:00080000:1.0:1763343040.624906:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1529, 64 off128568 00000004:00080000:1.0:1763343040.624910:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1234292289308ns, next at 1235292288054ns, rc = 0 00000040:00080000:1.0:1763343040.624920:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1530, 64 off128632 00000040:00080000:1.0:1763343040.624929:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1529, 64 off128632 00010000:00010000:1.0:1763343040.624986:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae8e53 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.624995:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae8e53 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.625003:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae8e53 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.625010:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae8e53 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.625016:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae8e53 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.625026:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae8e53 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.625042:0:6525:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763343040.625059:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343040.625064:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae8e53 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.625070:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d171600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343040.625074:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae8e53 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.625080:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae8e53 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.625088:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a34039dce00) 00010000:00010000:1.0:1763343040.625091:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343040.625095:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae8e53 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.625100:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171600/0x607405d401ae8e53 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343040.625318:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9693 00000100:00100000:2.0:1763343040.625329:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56943:x1848997993708288:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:2.0:1763343040.625361:0:6523:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.625374:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae8d88 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1fe:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9efe expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.625386:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.625390:0:6523:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343040.625437:0:6523:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8e5a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.625446:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8e5a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.625453:0:6523:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8e5a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00000004:00010000:2.0:1763343040.625513:0:6523:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007b840bdc reply state 000000000f2419b5 transno 8589940310 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8e5a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.625525:0:6523:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8e5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:2.0:1763343040.625531:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.625533:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343040.625537:0:6523:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343040.625658:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56943:x1848997993708288:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 330us (1776us total) trans 8589940310 rc 0/0 00000100:00100000:2.0:1763343040.625666:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9693 00010000:00010000:0.0:1763343040.625929:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae8e4c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.625937:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae8e4c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.625943:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae8e4c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.625948:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d171000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.625953:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae8e4c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.625958:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae8e4c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.625966:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1ff:0x0].0x0 (ffff9a34039dce00) 00010000:00010000:0.0:1763343040.625969:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343040.625971:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae8e4c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.625978:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d171000/0x607405d401ae8e4c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.626093:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e3e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.626099:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e3e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.626105:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e3e lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.626111:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e3e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.626116:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d170600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.626119:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e3e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.626124:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e3e lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.626132:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039dc200) 00010000:00010000:0.0:1763343040.626134:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.626137:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e3e lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.626143:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8e3e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:0.0:1763343040.626154:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000089825ad4 reply state 0000000052171488 transno 8589940309 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae8e45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.626163:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae8e45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.626169:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039dc500) 00010000:00010000:0.0:1763343040.626172:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343040.626174:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343040.626206:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56946:x1848997993708032:12345-192.168.204.21@tcp:36:rm.0 Request processed in 1962us (2384us total) trans 8589940309 rc 0/0 00000100:00100000:0.0:1763343040.626212:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9692 00010000:00010000:2.0:1763343040.628784:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.628789:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.628792:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343040.636053:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.636169:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993708416 00000100:00100000:1.0:1763343040.636179:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993708416 00000100:00100000:1.0:1763343040.636241:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6853 00000100:00100000:1.0:1763343040.636253:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:56943:x1848997993708416:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.636452:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.636472:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d171600/0x607405d401ae8e61 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f4b expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343040.636501:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ca:0x0] initial LVB size: 4096, mtime: 0x691a7ac0, atime: 0x0, ctime: 0x691a7ac0, blocks: 0x8 00010000:00010000:1.0:1763343040.636522:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.636524:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.636532:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d171600/0x607405d401ae8e61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f4b expref: 13 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.636547:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d171600/0x607405d401ae8e61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f4b expref: 13 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.636559:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d171600, rc 0) 00000100:00100000:1.0:1763343040.637429:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:56943:x1848997993708416:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1172us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.637441:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6853 00000100:00100000:3.0:1763343040.645332:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.645383:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.645716:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993708672 00000100:00100000:0.0:1763343040.645728:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993708672 00000100:00100000:0.0:1763343040.645799:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9694 00000100:00100000:0.0:1763343040.645810:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56947:x1848997993708672:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.645845:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.645869:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8e68 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f59 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.645940:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8e6f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.645954:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8e6f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.645966:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8e6f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.645977:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8e76 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.645983:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8e76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.645988:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8e76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646026:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8e6f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646033:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8e6f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646039:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8e6f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646045:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8e6f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646051:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.646055:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8e6f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646063:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8e6f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646075:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4a00) 00010000:00010000:0.0:1763343040.646078:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.646083:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8e6f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646089:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8e6f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646103:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8e76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646109:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8e76 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646115:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8e76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646120:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.646123:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8e76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646129:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8e76 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646135:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039dc500) 00010000:00010000:0.0:1763343040.646138:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.646141:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8e76 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646147:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8e76 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.646173:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8e68 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f59 expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.646182:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4a00) 00010000:00010000:0.0:1763343040.646184:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.646187:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8e68 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f59 expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.646204:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:1.0:1763343040.646363:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993708544 00000100:00100000:1.0:1763343040.646369:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993708544 00000100:00100000:1.0:1763343040.646408:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6854 00000100:00100000:1.0:1763343040.646415:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:56943:x1848997993708544:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.646425:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.646438:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d171200/0x607405d401ae8e7d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f52 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343040.646459:0:8408:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343040.646475:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.646478:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.646484:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d171200/0x607405d401ae8e7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f52 expref: 20 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.646502:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d171200/0x607405d401ae8e7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f52 expref: 20 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.646512:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d171200, rc 0) 00000100:00100000:1.0:1763343040.648030:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:56943:x1848997993708544:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1607us (2702us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.648042:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6854 00000100:00100000:0.0:1763343040.648131:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56947:x1848997993708672:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2322us (2746us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343040.648139:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9694 00000100:00100000:2.0:1763343040.652164:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.652211:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.652301:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993708800 00000100:00100000:0.0:1763343040.652322:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993708800 00002000:00010000:0.0:1763343040.652365:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/714 (5->18446744073709551615) 00002000:00100000:0.0:1763343040.652370:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a353876c700 with x1848997993708800 ext(5->18446744073709551615) 00002000:00010000:0.0:1763343040.652383:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a353876c700. 00000100:00100000:0.0:1763343040.652415:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993708928 00000100:00100000:0.0:1763343040.652419:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993708928 00002000:00010000:0.0:1763343040.652432:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/716 (0->18446744073709551615) 00002000:00100000:0.0:1763343040.652435:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a353876ca80 with x1848997993708928 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343040.652441:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a353876ca80. 00000100:00100000:0.0:1763343040.652462:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1662 00000100:00100000:0.0:1763343040.652471:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993708800:12345-192.168.204.21@tcp:10:lfs.0 00000100:00100000:1.0:1763343040.652494:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1663 00000100:00100000:1.0:1763343040.652503:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993708928:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:1.0:1763343040.652657:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2cc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343040.652662:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2cc:0x0] updating lvb mtime from disk: 0 -> 1763343040 00002000:00010000:1.0:1763343040.652664:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2cc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343040.652666:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2cc:0x0] updating lvb ctime from disk: 0 -> 1763343040 00002000:00010000:1.0:1763343040.652668:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2cc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343040.652723:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993708928:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 222us (511us total) trans 17179871740 rc 0/0 00000100:00100000:1.0:1763343040.652730:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1663 00002000:00010000:1.0:1763343040.652734:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/716 (0->18446744073709551615) 00002000:00100000:1.0:1763343040.652736:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a353876ca80 with x1848997993708928 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343040.652740:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a353876ca80. 00002000:00010000:0.0:1763343040.652777:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2ca:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763343040.652780:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2ca:0x0] updating lvb mtime from disk: 1763343040 -> 1763343040 00002000:00010000:0.0:1763343040.652783:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2ca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343040.652789:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2ca:0x0] updating lvb ctime from disk: 1763343040 -> 1763343040 00002000:00010000:0.0:1763343040.652792:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2ca:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343040.652817:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993708800:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 347us (663us total) trans 21474839038 rc 0/0 00000100:00100000:0.0:1763343040.652837:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1662 00002000:00010000:0.0:1763343040.652840:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/714 (5->18446744073709551615) 00002000:00100000:0.0:1763343040.652843:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a353876c700 with x1848997993708800 ext(5->18446744073709551615) 00002000:00010000:0.0:1763343040.652847:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a353876c700. 00000100:00100000:2.0:1763343040.654677:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.654737:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993709056 00000100:00100000:0.0:1763343040.654746:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993709056 00000100:00100000:0.0:1763343040.654794:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9695 00000100:00100000:0.0:1763343040.654803:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56947:x1848997993709056:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.654828:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.654850:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8e84 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f60 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.654927:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8e8b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.654941:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8e8b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.654952:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8e8b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.654962:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8e92 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.654969:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8e92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.654975:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8e92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655007:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8e8b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655013:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8e8b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655119:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8e8b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655126:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8e8b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655132:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.655137:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8e8b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655144:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8e8b lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655156:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4c00) 00010000:00010000:0.0:1763343040.655159:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.655163:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8e8b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655170:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8e8b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655183:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8e92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655307:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8e92 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655314:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8e92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655319:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3404b76800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.655322:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8e92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655332:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8e92 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655340:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039dc500) 00010000:00010000:0.0:1763343040.655342:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.655345:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8e92 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655350:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8e92 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.655376:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8e84 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f60 expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.655386:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4c00) 00010000:00010000:0.0:1763343040.655389:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.655392:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8e84 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f60 expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.655406:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:0.0:1763343040.655720:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56947:x1848997993709056:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 916us (1052us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343040.655729:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9695 00000100:00100000:3.0:1763343040.657101:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.657206:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993709312 00000100:00100000:0.0:1763343040.657215:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993709312 00000100:00100000:0.0:1763343040.657263:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9696 00000100:00100000:0.0:1763343040.657272:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56943:x1848997993709312:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343040.657355:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8e99 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.657371:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8e99 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.657382:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8e99 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00010000:0.0:1763343040.657490:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d564cf0f reply state 00000000ffa3e014 transno 8589940311 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8e99 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.657502:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8e99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.657508:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.657511:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343040.657514:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343040.657609:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56943:x1848997993709312:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 337us (513us total) trans 8589940311 rc 0/0 00000100:00100000:0.0:1763343040.657616:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9696 00000100:00100000:2.0:1763343040.658138:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.658699:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993709440 00000100:00100000:0.0:1763343040.658708:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993709440 00000100:00100000:0.0:1763343040.658758:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9697 00000100:00100000:0.0:1763343040.658767:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56947:x1848997993709440:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.658782:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.658801:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8ea0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f67 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.658953:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ea7 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.658964:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.658974:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343040.659011:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343040.659021:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343040.659051:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae8ea0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f67 expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.659069:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f67 expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.659077:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4a00) 00010000:00010000:0.0:1763343040.659079:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343040.659082:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:0.0:1763343040.659217:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56947:x1848997993709440:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 451us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.659224:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9697 00000100:00100000:2.0:1763343040.661691:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.662303:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993709568 00000100:00100000:1.0:1763343040.662314:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993709568 00000100:00100000:1.0:1763343040.662382:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6855 00000100:00100000:1.0:1763343040.662392:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2431:x1848997993709568:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:1.0:1763343040.662557:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763343040.662561:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb mtime from disk: 1763343040 -> 1763343040 00002000:00010000:1.0:1763343040.662563:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb atime from disk: 1763343040 -> 1763343040 00002000:00010000:1.0:1763343040.662565:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb ctime from disk: 1763343040 -> 1763343040 00002000:00010000:1.0:1763343040.662568:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1763343040.662643:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2431:x1848997993709568:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 251us (960us total) trans 17179871741 rc 0/0 00000100:00100000:1.0:1763343040.662652:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6855 00000100:00100000:3.0:1763343040.663967:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.664433:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993709696 00000100:00100000:0.0:1763343040.664442:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993709696 00000100:00100000:0.0:1763343040.664509:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9698 00000100:00100000:2.0:1763343040.664516:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.664523:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56947:x1848997993709696:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.664545:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.664567:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8eae lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f6e expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.664665:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8eb5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664684:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664696:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664706:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8ebc lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664713:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8ebc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664720:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8ebc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664756:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664764:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8eb5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664771:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664778:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403a5e400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.664783:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664791:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8eb5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664805:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4a00) 00010000:00010000:0.0:1763343040.664808:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.664814:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8eb5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664831:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8eb5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664844:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8ebc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664850:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8ebc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664854:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8ebc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664858:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403a5fe00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.664860:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8ebc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664866:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8ebc lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664873:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039dc500) 00010000:00010000:0.0:1763343040.664875:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.664878:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8ebc lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664883:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8ebc lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.664909:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8eae lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f6e expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.664918:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4a00) 00010000:00010000:0.0:1763343040.664920:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.664923:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae8eae lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f6e expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.664932:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:0.0:1763343040.664989:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56947:x1848997993709696:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 471us (1028us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343040.664996:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9698 00000100:00100000:1.0:1763343040.665387:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993709952 00000100:00100000:1.0:1763343040.665393:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993709952 00000100:00100000:1.0:1763343040.665432:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3309 00000100:00100000:1.0:1763343040.665441:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56943:x1848997993709952:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:1.0:1763343040.665479:0:14879:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1fe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8cee lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ecd expref: 270 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.665507:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343040.665517:0:14879:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8d57 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef0 expref: 270 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.665525:0:14879:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343040.665558:0:14879:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8d57 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef0 expref: 270 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.665570:0:14879:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8d57 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef0 expref: 270 pid: 6525 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343040.665583:0:14879:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34050f4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010314240:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343040.665675:0:14879:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c900 going to sleep for 11 seconds 00000100:00100000:2.0:1763343040.667983:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.668071:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.668148:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993710080 00000100:00100000:3.0:1763343040.668159:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993710080 00010000:00010000:3.0:1763343040.668194:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8d57 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef0 expref: 271 pid: 6525 timeout: 1334 lvb_type: 0 00000100:00100000:3.0:1763343040.668237:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3200 00000100:00100000:3.0:1763343040.668246:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:2432:x1848997993710080:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343040.668261:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343040.668268:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8d57 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef0 expref: 271 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:3.0:1763343040.668280:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8d57 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef0 expref: 271 pid: 6525 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343040.668280:0:14879:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34050f4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14879:1848998010314240:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343040.668307:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76c00/0x607405d401ae8d57 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ef0 expref: 271 pid: 6525 timeout: 1334 lvb_type: 0 00000100:00100000:0.0:1763343040.668382:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993710336 00000100:00100000:0.0:1763343040.668387:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993710336 00000100:00100000:0.0:1763343040.668427:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9699 00000100:00100000:0.0:1763343040.668435:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34097a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56947:x1848997993710336:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.668451:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.668453:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343040.668461:0:14879:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343040.668468:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae8ea7 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f67 expref: 272 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.668488:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4a00) 00010000:00010000:0.0:1763343040.668499:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343040.668515:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8eca lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f75 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.668588:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:3.0:1763343040.668593:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343040.668603:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 00010000:00010000:3.0:1763343040.668610:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343040.668616:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8ed1 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.668662:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8ed1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.668666:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343040.668672:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8ed1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.668690:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ed8 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.668697:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ed8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.668703:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ed8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.668727:0:14879:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343040.668735:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00000100:00100000:3.0:1763343040.668739:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:2432:x1848997993710080:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 493us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343040.668746:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3200 00000040:00080000:1.0:1763343040.668977:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1531, 88 off128720 00000004:00080000:1.0:1763343040.668987:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1234336365297ns, next at 1235292288054ns, rc = 0 00000040:00080000:1.0:1763343040.669031:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1530, 88 off128720 00000004:00080000:1.0:1763343040.669037:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1234336415557ns, next at 1235292259329ns, rc = 0 00000040:00080000:1.0:1763343040.669094:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1531, 88 off128808 00000004:00080000:1.0:1763343040.669100:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1234336478792ns, next at 1235292259329ns, rc = 0 00010000:00010000:0.0:1763343040.669121:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8edf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00000040:00080000:1.0:1763343040.669123:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1532, 88 off128808 00000004:00080000:1.0:1763343040.669131:0:14879:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1234336510152ns, next at 1235292288054ns, rc = 0 00010000:00010000:0.0:1763343040.669136:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8edf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.669145:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8edf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343040.669155:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x201:0x0]: returning size 0 00010000:00010000:0.0:1763343040.669203:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8ed1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.669211:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8ed1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.669216:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8ed1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.669223:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.669228:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8ed1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.669235:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8ed1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.669245:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4c00) 00010000:00010000:0.0:1763343040.669249:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.669253:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8ed1 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.669260:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae8ed1 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:0.0:1763343040.669270:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000405d2e3e reply state 00000000c78fd1ab transno 8589940312 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ed8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.669280:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ed8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.669289:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039dc500) 00010000:00010000:0.0:1763343040.669291:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343040.669293:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343040.669320:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76800/0x607405d401ae8eca lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f75 expref: 273 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.669335:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8edf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f75 expref: 272 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.669342:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4e00) 00010000:00010000:0.0:1763343040.669344:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343040.669347:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058ddc00, rc 0) 00000100:00100000:0.0:1763343040.669383:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34097a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56947:x1848997993710336:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 949us (1312us total) trans 8589940312 rc 0/0 00000100:00100000:0.0:1763343040.669390:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9699 00000001:00080000:1.0:1763343040.671851:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940313 is committed 00000004:00080000:1.0:1763343040.671864:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1009 committed 00010000:00010000:0.0:1763343040.672177:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8e5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343040.672192:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8e5a lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 00000004:00080000:1.0:1763343040.672201:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1010 committed 00010000:00010000:0.0:1763343040.672201:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8e5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343040.672213:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.672219:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8e5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343040.672226:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8e5a lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343040.672244:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.672247:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.672252:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8e5a lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343040.672259:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae8e5a lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 00010000:00010000:0.0:1763343040.672279:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae8e45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.672285:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae8e45 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.672290:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae8e45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.672294:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d170000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.672296:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae8e45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.672305:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae8e45 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.672313:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039dc500) 00010000:00010000:0.0:1763343040.672315:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.672318:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae8e45 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.672324:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170000/0x607405d401ae8e45 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.672334:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8e99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.672339:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8e99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.672345:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8e99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.672350:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3404b76e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.672353:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8e99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.672372:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8e99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.672380:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.672382:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.672385:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8e99 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.672391:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76e00/0x607405d401ae8e99 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.672404:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ed8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.672409:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ed8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.672414:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ed8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.672419:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.672422:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ed8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.672427:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ed8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.672434:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039dc500) 00010000:00010000:0.0:1763343040.672436:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.672439:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ed8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.672445:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae8ed8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:0.0:1763343040.673015:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010314368:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1763343040.673086:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1009 committed 00000004:00080000:1.0:1763343040.673090:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1008 committed 00000100:00100000:0.0:1763343040.673307:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343040.673348:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010314880:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343040.673362:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010314624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343040.673396:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.673407:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010314752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343040.673432:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1763343040.673437:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343040.673443:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010314496:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343040.673468:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010315264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343040.673475:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.673498:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343040.673503:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010315008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343040.673532:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763343040.674007:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1007 committed 00000004:00080000:1.0:1763343040.674019:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1008 committed 00000100:00100000:3.0:1763343040.674330:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.674401:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010314368 00000100:00100000:2.0:1763343040.674411:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010314368 00000100:00100000:2.0:1763343040.674463:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010314880 00000100:00100000:2.0:1763343040.674466:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010314880 00000100:00100000:2.0:1763343040.674486:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010314752 00000100:00100000:2.0:1763343040.674489:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010314752 00000100:00100000:2.0:1763343040.674504:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010314496 00000100:00100000:2.0:1763343040.674507:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010314496 00000100:00100000:2.0:1763343040.674521:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010315264 00000100:00100000:2.0:1763343040.674524:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010315264 00000100:00100000:2.0:1763343040.674539:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010315008 00000100:00100000:2.0:1763343040.674542:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010315008 00000100:00100000:2.0:1763343040.674563:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6856 00000100:00100000:2.0:1763343040.674571:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3659:x1848998010314368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343040.674597:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:717 count 1 00010000:00010000:2.0:1763343040.674642:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae8eed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.674663:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3537b6cc00/0x607405d401ae8e14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f3d expref: 21 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.674671:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343040.674673:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343040.674677:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae8eed lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.674707:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3537b6cc00/0x607405d401ae8e14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f3d expref: 21 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.674719:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3537b6cc00/0x607405d401ae8e14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f3d expref: 21 pid: 8408 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343040.674733:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406553480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010315392:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343040.674793:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35079f5240 going to sleep for 11 seconds 00000100:00100000:2.0:1763343040.674808:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6857 00000100:00100000:2.0:1763343040.674816:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3659:x1848998010314880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343040.674842:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:715 count 1 00010000:00010000:2.0:1763343040.674856:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8ef4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343040.674867:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6858 00010000:00010000:2.0:1763343040.674869:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76200/0x607405d401ae8dff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f2f expref: 13 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.674878:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343040.674882:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1763343040.674883:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3658:x1848998010314752:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763343040.674885:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8ef4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.674910:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76200/0x607405d401ae8dff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f2f expref: 13 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.674918:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76200/0x607405d401ae8dff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f2f expref: 13 pid: 8408 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343040.674928:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010315520:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343040.674956:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35079f5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1763343040.674973:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6859 00000100:00100000:2.0:1763343040.674980:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3659:x1848998010314496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343040.674992:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:718 count 1 00002000:00010000:2.0:1763343040.675011:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343040.675016:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae8efb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.675024:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.675025:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.675030:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae8efb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.675041:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae8efb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.675051:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae8efb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.675059:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae8efb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.675080:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1763343040.675121:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2cc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343040.675124:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2cc:0x0] updating lvb mtime from disk: 1763343040 -> 1763343040 00002000:00010000:0.0:1763343040.675127:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2cc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343040.675129:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2cc:0x0] updating lvb ctime from disk: 1763343040 -> 1763343040 00002000:00010000:0.0:1763343040.675131:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2cc:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343040.675184:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3658:x1848998010314752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 306us (1748us total) trans 17179871742 rc 0/0 00000100:00100000:0.0:1763343040.675191:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6858 00000100:00100000:0.0:1763343040.675214:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6860 00000100:00100000:0.0:1763343040.675223:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3658:x1848998010315264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343040.675269:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3659:x1848998010314496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 287us (1793us total) trans 17179871743 rc 0/0 00000100:00100000:2.0:1763343040.675276:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6859 00002000:00010000:0.0:1763343040.675292:0:8407:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2ca:0x0] updating lvb size from disk: 5 -> 5 00000100:00100000:2.0:1763343040.675296:0:28993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6861 00002000:00010000:0.0:1763343040.675298:0:8407:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2ca:0x0] updating lvb mtime from disk: 1763343040 -> 1763343040 00002000:00010000:0.0:1763343040.675302:0:8407:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2ca:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1763343040.675308:0:28993:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3659:x1848998010315008:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:0.0:1763343040.675311:0:8407:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2ca:0x0] updating lvb ctime from disk: 1763343040 -> 1763343040 00002000:00010000:0.0:1763343040.675315:0:8407:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2ca:0x0] updating lvb blocks from disk: 8 -> 8 00002000:00080000:2.0:1763343040.675321:0:28993:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:716 count 1 00002000:00010000:2.0:1763343040.675344:0:28993:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343040.675349:0:28993:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae8f02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343040.675350:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3658:x1848998010315264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 128us (1851us total) trans 21474839039 rc 0/0 00010000:00010000:2.0:1763343040.675360:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.675362:0:28993:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.675365:0:28993:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae8f02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343040.675380:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6860 00010000:00010000:2.0:1763343040.675382:0:28993:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae8f02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.675393:0:28993:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae8f02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.675399:0:28993:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae8f02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343040.675409:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993710592 00000100:00100000:0.0:1763343040.675416:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993710592 00010000:00010000:2.0:1763343040.675417:0:28993:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763343040.675454:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9700 00000100:00100000:0.0:1763343040.675464:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56947:x1848997993710592:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.675480:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.675497:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae8f09 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f7c expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343040.675552:0:28993:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3659:x1848998010315008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 246us (2019us total) trans 21474839040 rc 0/0 00000100:00100000:2.0:1763343040.675558:0:28993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6861 00010000:00010000:2.0:1763343040.675592:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343040.675599:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae8efb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.675607:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343040.675612:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae8efb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.675655:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae8efb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.675656:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f10 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.675681:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8edf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f75 expref: 264 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.675683:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae8efb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.675695:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f10 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.675698:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae8efb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.675718:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343040.675722:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae8f02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.675726:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8edf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f75 expref: 264 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.675736:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343040.675741:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae8f02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.675752:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae8f02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.675754:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8edf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f75 expref: 264 pid: 28422 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343040.675773:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae8f02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343040.675778:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010315648:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343040.675788:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352da00/0x607405d401ae8f02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28993 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.675801:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.675803:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.675805:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.675813:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343040.675843:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31c00 going to sleep for 11 seconds 00000100:00100000:2.0:1763343040.675862:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343040.675885:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010314624 00000100:00100000:0.0:1763343040.675891:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010314624 00000100:00100000:2.0:1763343040.675895:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34097a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010315136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343040.675922:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6862 00000100:00100000:2.0:1763343040.675927:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343040.675935:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3657:x1848998010314624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343040.675963:0:27833:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010315136 00000100:00100000:2.0:1763343040.675969:0:27833:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010315136 00000100:00100000:2.0:1763343040.675999:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6863 00002000:00010000:0.0:1763343040.676008:0:28995:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb size from disk: 5 -> 5 00000100:00100000:2.0:1763343040.676009:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3657:x1848998010315136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343040.676014:0:28995:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb mtime from disk: 1763343040 -> 1763343040 00002000:00010000:0.0:1763343040.676018:0:28995:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb atime from disk: 1763343040 -> 1763343040 00002000:00010000:0.0:1763343040.676020:0:28995:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb ctime from disk: 1763343040 -> 1763343040 00002000:00010000:0.0:1763343040.676023:0:28995:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2cb:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1763343040.676061:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3657:x1848998010314624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 130us (199us total) trans 17179871744 rc 0/0 00000100:00100000:0.0:1763343040.676068:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6862 00002000:00010000:2.0:1763343040.676077:0:27833:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2c9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343040.676081:0:27833:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2c9:0x0] updating lvb mtime from disk: 1763343040 -> 1763343040 00002000:00010000:2.0:1763343040.676083:0:27833:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2c9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343040.676085:0:27833:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2c9:0x0] updating lvb ctime from disk: 1763343040 -> 1763343040 00002000:00010000:2.0:1763343040.676087:0:27833:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2c9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343040.676115:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3657:x1848998010315136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (188us total) trans 21474839041 rc 0/0 00000100:00100000:2.0:1763343040.676121:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6863 00000004:00080000:2.0:1763343040.676169:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3403ad6300/2, rc 0, transno 17179871742 00000100:00100000:2.0:1763343040.676175:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010314752:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343040.676187:0:3658:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474839035 gen 2 00000004:00080000:2.0:1763343040.676191:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537b0ea00, transno 21474838996 00000004:00080000:2.0:1763343040.676195:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537b0f480, transno 21474838997 00000004:00080000:2.0:1763343040.676197:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537b0fb80, transno 21474838998 00000004:00080000:2.0:1763343040.676200:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537b0e300, transno 21474838999 00000004:00080000:2.0:1763343040.676202:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340ccc2680, transno 21474839000 00000004:00080000:2.0:1763343040.676205:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340ccc3800, transno 21474839001 00000004:00080000:2.0:1763343040.676207:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b3100, transno 21474839003 00000004:00080000:2.0:1763343040.676210:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b0700, transno 21474839004 00000004:00080000:2.0:1763343040.676212:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b1500, transno 21474839005 00000004:00080000:2.0:1763343040.676214:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b0a80, transno 21474839006 00000004:00080000:2.0:1763343040.676216:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b2d80, transno 21474839007 00000004:00080000:2.0:1763343040.676219:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b0e00, transno 21474839008 00000004:00080000:2.0:1763343040.676221:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340664aa00, transno 21474839011 00000004:00080000:2.0:1763343040.676224:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406648e00, transno 21474839012 00000004:00080000:2.0:1763343040.676227:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b5f80, transno 21474839013 00000004:00080000:2.0:1763343040.676230:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095b5500, transno 21474839014 00000004:00080000:2.0:1763343040.676233:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a351fc76680, transno 21474839018 00000004:00080000:2.0:1763343040.676235:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a351fc77100, transno 21474839019 00000004:00080000:2.0:1763343040.676238:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a351fc74000, transno 21474839020 00000004:00080000:2.0:1763343040.676241:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a351fc77b80, transno 21474839021 00000004:00080000:2.0:1763343040.676243:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340465e300, transno 21474839022 00000004:00080000:2.0:1763343040.676246:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340465e680, transno 21474839023 00000004:00080000:2.0:1763343040.676249:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062f1880, transno 21474839024 00000004:00080000:2.0:1763343040.676251:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062f1500, transno 21474839025 00000004:00080000:2.0:1763343040.676254:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d10c700, transno 21474839027 00000004:00080000:2.0:1763343040.676256:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c3bb80, transno 21474839028 00000004:00080000:2.0:1763343040.676258:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d10f480, transno 21474839029 00000004:00080000:2.0:1763343040.676261:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340d10d880, transno 21474839030 00000004:00080000:2.0:1763343040.676264:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34050f4000, transno 21474839032 00000004:00080000:2.0:1763343040.676267:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c73100, transno 21474839033 00000004:00080000:2.0:1763343040.676269:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34050f7100, transno 21474839034 00000004:00080000:2.0:1763343040.676272:0:3658:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34050f5500, transno 21474839035 00000100:00100000:2.0:1763343040.676278:0:3658:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a3406552680 x1848998010315264/t21474839039(21474839039) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763343056 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763343040.676287:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406552680/2, rc 0, transno 21474839039 00000100:00100000:2.0:1763343040.676290:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010315264:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763343040.676310:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3403ad4380/2, rc 0, transno 17179871744 00000100:00100000:2.0:1763343040.676314:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010314624:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763343040.676322:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34097a4a80/2, rc 0, transno 21474839041 00000100:00100000:2.0:1763343040.676325:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010315136:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763343040.676343:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3403ad4000/2, rc 0, transno 17179871743 00000100:00100000:2.0:1763343040.676347:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010314496:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1763343040.676356:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34097a5880/2, rc 0, transno 21474839040 00000100:00100000:2.0:1763343040.676360:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010315008:0@lo:6:osp-syn-0-0.0 00000004:00010000:0.0:1763343040.676740:0:14879:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000873df423 reply state 00000000aef64d1f transno 8589940313 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343040.676759:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343040.676768:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:0.0:1763343040.676771:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1763343040.676774:0:14879:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343040.676780:0:14879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00000004:00080000:1.0:1763343040.676783:0:32355:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 4 in progress, 1 in flight, 32 done 00010000:00010000:0.0:1763343040.676784:0:14879:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343040.676791:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae8cee lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ecd expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1763343040.676884:0:14879:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763343040.676907:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56943:x1848997993709952:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 11466us (12392us total) trans 8589940313 rc 0/0 00000100:00100000:0.0:1763343040.676915:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3309 00010000:00010000:1.0:1763343040.677204:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343040.677213:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343040.677220:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343040.677225:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d170200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.677229:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343040.677235:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343040.677244:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:1.0:1763343040.677247:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343040.677250:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343040.677256:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170200/0x607405d401ae8ec3 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14879 initiator: MDT0 00000100:00100000:0.0:1763343040.686297:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010315520:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343040.686334:0:28648:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8ef4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343040.687207:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406553480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010315392:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343040.687227:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae8eed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343040.688145:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.688547:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010315648:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343040.688571:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f10 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343040.688691:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.688818:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.688894:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993710720 00000100:00100000:2.0:1763343040.688902:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993710720 00010000:00010000:2.0:1763343040.688940:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3537b6cc00/0x607405d401ae8e14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f3d expref: 22 pid: 8408 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343040.689208:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993710976 00000100:00100000:1.0:1763343040.689213:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993710976 00010000:00010000:1.0:1763343040.689232:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8edf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f75 expref: 263 pid: 28422 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343040.689258:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993710848 00000100:00100000:1.0:1763343040.689271:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993710848 00010000:00010000:1.0:1763343040.689286:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76200/0x607405d401ae8dff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f2f expref: 14 pid: 8408 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343040.689303:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3201 00000100:00100000:1.0:1763343040.689310:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2429:x1848997993710720:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343040.689324:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343040.689330:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3537b6cc00/0x607405d401ae8e14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f3d expref: 22 pid: 8408 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.689341:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3537b6cc00/0x607405d401ae8e14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f3d expref: 22 pid: 8408 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.689363:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3537b6cc00/0x607405d401ae8e14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f3d expref: 22 pid: 8408 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.689378:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.689380:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.689385:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae8eed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.689394:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae8eed lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.689420:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343040.689470:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993710720:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 159us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.689477:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3201 00000100:00100000:1.0:1763343040.689495:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3202 00000100:00100000:1.0:1763343040.689501:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35084c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:2429:x1848997993710976:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343040.689510:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343040.689516:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8edf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f75 expref: 263 pid: 28422 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.689524:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8edf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f75 expref: 263 pid: 28422 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.689538:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8edf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f75 expref: 263 pid: 28422 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.689550:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4e00) 00010000:00010000:1.0:1763343040.689554:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f10 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.689561:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f10 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.689568:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f10 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.689583:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343040.689602:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35084c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:2429:x1848997993710976:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 100us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.689609:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3202 00000100:00100000:1.0:1763343040.689674:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3203 00000100:00100000:1.0:1763343040.689682:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993710848:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343040.689690:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343040.689694:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76200/0x607405d401ae8dff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f2f expref: 14 pid: 8408 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.689703:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76200/0x607405d401ae8dff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f2f expref: 14 pid: 8408 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.689716:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3404b76200/0x607405d401ae8dff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f2f expref: 14 pid: 8408 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.689725:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.689727:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.689730:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8ef4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.689736:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8ef4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.689755:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343040.689773:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993710848:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 92us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.689779:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3203 00010000:00010000:1.0:1763343040.689804:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae8eed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.689813:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae8eed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.689838:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae8eed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.689846:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae8eed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.689863:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343040.690089:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3659:x1848998010314368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15518us (16781us total) trans 17179871745 rc 0/0 00000100:00100000:1.0:1763343040.690096:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6856 00010000:00010000:1.0:1763343040.690119:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343040.690124:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae8eed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.690132:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343040.690136:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae8eed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.690144:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae8eed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.690156:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae8eed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.690164:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae8eed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.690185:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343040.690186:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343040.690188:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343040.690219:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3403ad5180/2, rc 0, transno 17179871745 00000100:00100000:1.0:1763343040.690226:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010314368:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.690277:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:1.0:1763343040.690396:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f10 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.690404:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f10 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343040.690426:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x201:0x0]: returning size 0 00000004:00080000:1.0:1763343040.690577:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2cf:0x0], index 1: 0 00000004:00080000:1.0:1763343040.690583:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2cd:0x0], index 0: 0 00000004:00080000:1.0:1763343040.690587:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2ce:0x0], index 0: 0 00000004:00080000:1.0:1763343040.690591:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2d0:0x0], index 1: 0 00010000:00010000:1.0:1763343040.690707:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f10 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.690715:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f10 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.690721:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f10 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.690727:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.690730:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f10 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.690740:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f10 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.690750:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4e00) 00010000:00010000:1.0:1763343040.690753:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343040.690756:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f10 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.690762:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f10 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.690807:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae8f09 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f7c expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.690817:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4e00) 00010000:00010000:1.0:1763343040.690832:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343040.690836:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae8f09 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x201:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f7c expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.690850:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc600, rc 0) 00000100:00100000:1.0:1763343040.690885:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56947:x1848997993710592:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 15423us (16557us total) trans 8589940314 rc 301/301 00000100:00100000:1.0:1763343040.690891:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9700 00000100:00100000:1.0:1763343040.690910:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993711104 00000100:00100000:1.0:1763343040.690915:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993711104 00000100:00100000:1.0:1763343040.690943:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9701 00000100:00100000:1.0:1763343040.690950:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+261:56943:x1848997993711104:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.690968:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.690983:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8f1e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f83 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.691019:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8f1e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f83 expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.691030:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d170600/0x607405d401ae8f1e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f83 expref: 262 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.691045:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:1.0:1763343040.691047:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343040.691049:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d170600, rc 0) 00000100:00100000:1.0:1763343040.691074:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56943:x1848997993711104:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 124us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.691080:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9701 00010000:00010000:1.0:1763343040.691173:0:28648:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8ef4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.691182:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8ef4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.691191:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8ef4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.691197:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8ef4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.691212:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343040.691376:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3659:x1848998010314880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16560us (17979us total) trans 21474839042 rc 0/0 00000100:00100000:1.0:1763343040.691383:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6857 00000004:00080000:1.0:1763343040.691422:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34097a4e00/2, rc 0, transno 21474839042 00000100:00100000:1.0:1763343040.691428:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34097a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010314880:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763343040.692712:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343040.692722:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8ef4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.692740:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343040.692744:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8ef4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.692757:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8ef4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.692776:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8ef4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.692784:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae8ef4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.692810:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.692812:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.692814:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343040.700414:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.700495:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993711360 00000100:00100000:0.0:1763343040.700505:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993711360 00000100:00100000:0.0:1763343040.700570:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3310 00000100:00100000:0.0:1763343040.700580:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:56947:x1848997993711360:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343040.700926:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56947:x1848997993711360:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 347us (522us total) trans 8589940315 rc 0/0 00000100:00100000:0.0:1763343040.700934:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3310 00000100:00100000:2.0:1763343040.702155:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.702214:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993711616 00000100:00100000:0.0:1763343040.702222:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993711616 00000100:00100000:0.0:1763343040.702271:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3311 00000100:00100000:0.0:1763343040.702279:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56943:x1848997993711616:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:0.0:1763343040.702485:0:6526:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x1fe:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763343040.702547:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1533, 64 off128872 00000040:00080000:0.0:1763343040.702569:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1532, 64 off128872 00000040:00080000:0.0:1763343040.702577:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1533, 64 off128936 00000040:00080000:0.0:1763343040.702585:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1534, 64 off128936 00010000:00010000:0.0:1763343040.702683:0:6526:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae8f25 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.702700:0:6526:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae8f25 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.702711:0:6526:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae8f25 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.702718:0:6526:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae8f25 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.702723:0:6526:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae8f25 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.702729:0:6526:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae8f25 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 00010000:00010000:0.0:1763343040.702747:0:6526:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343040.702928:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56943:x1848997993711616:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 648us (776us total) trans 8589940316 rc 0/0 00000100:00100000:0.0:1763343040.702937:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3311 00010000:00010000:2.0:1763343040.703132:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343040.703140:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae8f25 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343040.703147:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343040.703151:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae8f25 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343040.703158:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae8f25 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343040.703170:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1fe:0x0].0x0 (ffff9a353873bc00) 00010000:00010000:2.0:1763343040.703173:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343040.703178:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae8f25 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343040.703183:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae8f25 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 00010000:00010000:2.0:1763343040.703192:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.703194:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.703196:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343040.708141:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.708242:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.708726:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993711872 00000100:00100000:0.0:1763343040.708738:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993711872 00000100:00100000:0.0:1763343040.708789:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3312 00000100:00100000:0.0:1763343040.708799:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56947:x1848997993711872:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343040.709069:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56947:x1848997993711872:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 270us (937us total) trans 8589940317 rc 0/0 00000100:00100000:0.0:1763343040.709087:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3312 00000100:00100000:3.0:1763343040.709327:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993712128 00000100:00100000:3.0:1763343040.709333:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993712128 00000100:00100000:3.0:1763343040.709384:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9702 00000100:00100000:3.0:1763343040.709400:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56943:x1848997993712128:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343040.709413:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343040.709446:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8f2c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f8a expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.709515:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8f33 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709528:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8f33 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709540:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8f33 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709552:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8f3a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709559:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8f3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709566:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8f3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709696:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8f41 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709705:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8f41 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709712:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8f41 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343040.709723:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x201:0x0]: returning size 0 00010000:00010000:3.0:1763343040.709771:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8f33 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709779:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8f33 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709789:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8f33 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709795:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8f33 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709801:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.709805:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8f33 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709813:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8f33 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709837:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bd700) 00010000:00010000:3.0:1763343040.709840:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343040.709844:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8f33 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709850:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae8f33 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709871:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8f3a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709877:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8f3a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709882:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8f3a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709887:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.709890:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8f3a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709899:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8f3a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709906:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bdb00) 00010000:00010000:3.0:1763343040.709908:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343040.709910:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8f3a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709916:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8f3a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.709952:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8f2c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f8a expref: 268 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.709965:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8f41 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f8a expref: 267 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.709972:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34037bd300) 00010000:00010000:3.0:1763343040.709974:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343040.709977:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6000, rc 0) 00000100:00100000:3.0:1763343040.710020:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56943:x1848997993712128:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 622us (1778us total) trans 8589940318 rc 0/0 00000100:00100000:3.0:1763343040.710026:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9702 00000100:00100000:1.0:1763343040.718584:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.718690:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993712256 00000100:00100000:0.0:1763343040.718699:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993712256 00000100:00100000:0.0:1763343040.718755:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6864 00000100:00100000:0.0:1763343040.718765:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993712256:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.718782:0:28648:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.718801:0:28648:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae8f4f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f91 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343040.718833:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343040.718853:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343040.718855:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343040.718864:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae8f4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f91 expref: 22 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343040.718879:0:28648:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae8f4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f91 expref: 22 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343040.718892:0:28648:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc000, rc 0) 00000100:00100000:0.0:1763343040.718939:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993712256:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 176us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.718946:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6864 00000100:00100000:2.0:1763343040.721976:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.722429:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993712512 00000100:00100000:0.0:1763343040.722439:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993712512 00000100:00100000:0.0:1763343040.722498:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9703 00000100:00100000:0.0:1763343040.722507:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:55941:x1848997993712512:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343040.722533:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.722536:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343040.722560:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae8f41 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f8a expref: 267 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.722578:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34037bd300) 00010000:00010000:0.0:1763343040.722589:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343040.722603:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae8f56 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f98 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.722727:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae8f5d lrc: 3/0,1 mode: --/CW res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.722740:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae8f5d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x201:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.722749:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae8f5d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x201:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343040.722761:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x201:0x0]: returning size 0 00010000:00010000:0.0:1763343040.722879:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae8f56 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x201:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f98 expref: 269 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.722892:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae8f5d lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x201:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f98 expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.722898:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4500) 00010000:00010000:0.0:1763343040.722901:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1763343040.722904:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dda00, rc 0) 00000100:00100000:0.0:1763343040.722969:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:55941:x1848997993712512:12345-192.168.204.21@tcp:101:bash.0 Request processed in 463us (1001us total) trans 8589940319 rc 0/0 00000100:00100000:0.0:1763343040.722977:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9703 00000100:00100000:3.0:1763343040.725790:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.730280:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993712640 00000100:00100000:0.0:1763343040.730293:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993712640 00000100:00100000:0.0:1763343040.730356:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9704 00000100:00100000:0.0:1763343040.730365:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56943:x1848997993712640:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.730383:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.730403:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae8f6b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9f9f expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.730456:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae8f6b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f9f expref: 269 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.730470:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae8f6b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f9f expref: 269 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.730486:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4500) 00010000:00010000:0.0:1763343040.730490:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343040.730494:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dcc00, rc 0) 00000100:00100000:0.0:1763343040.730558:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56943:x1848997993712640:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 194us (4777us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.730565:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9704 00000100:00100000:2.0:1763343040.732401:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1848998010315904:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.732463:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.732504:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1848998010316416:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.732528:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.732543:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010316928:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.732560:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.732583:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1763343040.732588:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07eb4ce3-eb55-46ce-8a00-00f8f23465ad:3660:1848998010315776:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.732614:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.732667:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1848998010316288:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.732690:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.732707:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1848998010316800:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.732724:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.732752:0:6529:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010315904 00000100:00100000:2.0:1763343040.732758:0:6529:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010315904 00000100:00100000:2.0:1763343040.732794:0:6529:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010316928 00000100:00100000:2.0:1763343040.732796:0:6529:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010316928 00000100:00100000:2.0:1763343040.732812:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:2.0:1763343040.732829:0:6529:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3660:x1848998010315904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.732879:0:6529:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3660:x1848998010315904:12345-0@lo:400:kworker.0 Request processed in 60us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.732885:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:2.0:1763343040.732901:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:2.0:1763343040.732906:0:6529:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1848998010316928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.732933:0:6529:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1848998010316928:12345-0@lo:400:kworker.0 Request processed in 27us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.732938:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:2.0:1763343040.732958:0:32346:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010315776 00000100:00100000:2.0:1763343040.732961:0:32346:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010315776 00000100:00100000:2.0:1763343040.732986:0:32346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1763343040.732993:0:32346:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537a87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb4ce3-eb55-46ce-8a00-00f8f23465ad+23:3660:x1848998010315776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733019:0:32346:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537a87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07eb4ce3-eb55-46ce-8a00-00f8f23465ad+23:3660:x1848998010315776:12345-0@lo:400:kworker.0 Request processed in 27us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.733024:0:32346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1763343040.733049:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010316288 00000100:00100000:2.0:1763343040.733052:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010316288 00000100:00100000:2.0:1763343040.733074:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:2.0:1763343040.733079:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3660:x1848998010316288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733121:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3660:x1848998010316288:12345-0@lo:400:kworker.0 Request processed in 41us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.733126:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:2.0:1763343040.733151:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3403ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1848998010316032:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733172:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.733199:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1848998010316544:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733218:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.733234:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1848998010317056:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733253:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.733271:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1763343040.733277:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1848998010316160:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733296:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.733311:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1848998010316672:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733332:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.733357:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010316416 00000100:00100000:2.0:1763343040.733362:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010316416 00000100:00100000:2.0:1763343040.733389:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010316800 00000100:00100000:2.0:1763343040.733392:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010316800 00000100:00100000:2.0:1763343040.733404:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010316032 00000100:00100000:2.0:1763343040.733406:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010316032 00000100:00100000:2.0:1763343040.733416:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010316544 00000100:00100000:2.0:1763343040.733418:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010316544 00000100:00100000:2.0:1763343040.733431:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010317056 00000100:00100000:2.0:1763343040.733434:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010317056 00000100:00100000:2.0:1763343040.733443:0:6523:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010316672 00000100:00100000:2.0:1763343040.733445:0:6523:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010316672 00000100:00100000:2.0:1763343040.733458:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:2.0:1763343040.733463:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1848998010316416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733494:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1848998010316416:12345-0@lo:400:kworker.0 Request processed in 30us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.733500:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:2.0:1763343040.733514:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:2.0:1763343040.733520:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1848998010316800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733545:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1848998010316800:12345-0@lo:400:kworker.0 Request processed in 25us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.733550:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:2.0:1763343040.733559:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:2.0:1763343040.733564:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1848998010316032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733592:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1848998010316032:12345-0@lo:400:kworker.0 Request processed in 28us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.733597:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:2.0:1763343040.733608:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1763343040.733614:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1848998010316544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733657:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1848998010316544:12345-0@lo:400:kworker.0 Request processed in 43us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.733662:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1763343040.733673:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:2.0:1763343040.733678:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1848998010317056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733701:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1848998010317056:12345-0@lo:400:kworker.0 Request processed in 22us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.733706:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:2.0:1763343040.733715:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:2.0:1763343040.733720:0:6523:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1848998010316672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733741:0:6523:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1848998010316672:12345-0@lo:400:kworker.0 Request processed in 20us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.733746:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00080000:2.0:1763343040.733769:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1763343040.733773:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1763343040.733779:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010316160 00000100:00100000:2.0:1763343040.733783:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010316160 00000100:00100000:2.0:1763343040.733802:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:2.0:1763343040.733806:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1848998010316160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733843:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1848998010316160:12345-0@lo:400:kworker.0 Request processed in 36us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.733849:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00100000:2.0:1763343040.733886:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1848998010316160:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733896:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1848998010316672:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733903:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1848998010316032:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733910:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1848998010316544:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733919:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1848998010317056:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733948:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07eb4ce3-eb55-46ce-8a00-00f8f23465ad:3660:1848998010315776:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733959:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1848998010316288:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733967:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1848998010316800:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733976:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3403ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1848998010315904:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733986:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1848998010316416:0@lo:400:kworker.0 00000100:00100000:2.0:1763343040.733995:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010316928:0@lo:400:kworker.0 00000100:00100000:0.0:1763343040.736118:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.737381:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993712768 00000100:00100000:3.0:1763343040.737394:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993712768 00000100:00100000:3.0:1763343040.737466:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9705 00000100:00100000:3.0:1763343040.737476:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:55941:x1848997993712768:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343040.737502:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343040.737525:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8f72 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9fa6 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.737561:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8f79 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.737575:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8f79 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.737586:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8f79 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.737724:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae8f72 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x201:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fa6 expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.737743:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8f79 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fa6 expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.737751:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4500) 00010000:00010000:3.0:1763343040.737754:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343040.737759:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7200, rc 0) 00000100:00100000:3.0:1763343040.737831:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:55941:x1848997993712768:12345-192.168.204.21@tcp:101:bash.0 Request processed in 345us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343040.737839:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9705 00000100:00100000:1.0:1763343040.739040:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34050f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1848998010317184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1763343040.739091:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343040.739474:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010317184 00000100:00100000:3.0:1763343040.739483:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010317184 00000100:00100000:0.0:1763343040.739603:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010317312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1763343040.739650:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.742611:0:6529:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010317312 00000100:00100000:1.0:1763343040.742715:0:13006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:1.0:1763343040.742736:0:13006:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3658:x1848998010317184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1763343040.742786:0:13006:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445650432 avail 1299410944 00000100:00100000:1.0:1763343040.742856:0:13006:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3658:x1848998010317184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (3763us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.742863:0:13006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1763343040.742900:0:6529:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010317312 00000100:00100000:1.0:1763343040.742918:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34050f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1848998010317184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1763343040.742942:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1763343040.742951:0:6529:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1848998010317312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1763343040.742970:0:6529:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446187008 avail 1299947520 00000100:00100000:2.0:1763343040.743017:0:6529:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1848998010317312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (3367us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.743023:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:1.0:1763343040.743058:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010317312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1763343040.744232:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.744974:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993713024 00000100:00100000:1.0:1763343040.744983:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993713024 00000100:00100000:1.0:1763343040.745037:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3313 00000100:00100000:1.0:1763343040.745046:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56943:x1848997993713024:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343040.745252:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56943:x1848997993713024:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 207us (1024us total) trans 8589940320 rc 0/0 00000100:00100000:1.0:1763343040.745264:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3313 00000100:00100000:2.0:1763343040.748844:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.749089:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993713280 00000100:00100000:0.0:1763343040.749100:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993713280 00000100:00100000:0.0:1763343040.749163:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9706 00000100:00100000:0.0:1763343040.749173:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:55941:x1848997993713280:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343040.749227:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343040.749254:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae8f5d lrc: 0/0,0 mode: --/CW res: [0x200000405:0x201:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f98 expref: 271 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.749286:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4500) 00010000:00010000:0.0:1763343040.749291:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343040.749477:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae8f80 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.749491:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae8f80 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x201:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.749502:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae8f80 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x201:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:0.0:1763343040.749548:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940321 00000004:00010000:0.0:1763343040.749572:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a332018a reply state 00000000f91df3d6 transno 8589940322 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae8f80 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x201:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.749589:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae8f80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x201:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.749595:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4500) 00010000:00010000:0.0:1763343040.749597:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343040.749600:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343040.749743:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:55941:x1848997993713280:12345-192.168.204.21@tcp:36:bash.0 Request processed in 571us (908us total) trans 8589940322 rc 0/0 00000100:00100000:0.0:1763343040.749751:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9706 00000020:00080000:0.0:1763343040.749756:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343040.750212:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.752501:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993713536 00000100:00100000:0.0:1763343040.752517:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993713536 00000100:00100000:0.0:1763343040.753106:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9707 00000100:00100000:0.0:1763343040.753122:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56943:x1848997993713536:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.753154:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.753183:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae8f87 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9fad expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.753264:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae8f8e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753278:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae8f8e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753290:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae8f8e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753304:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f95 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753311:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753319:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753433:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8f9c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753444:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8f9c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753452:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8f9c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:0.0:1763343040.753463:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x201:0x0]: returning size 0 00010000:00010000:0.0:1763343040.753547:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae8f8e lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753556:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae8f8e lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753563:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae8f8e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753569:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.753574:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae8f8e lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753582:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae8f8e lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753594:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:0.0:1763343040.753598:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.753603:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae8f8e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753614:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae8f8e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753656:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f95 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753663:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f95 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753669:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753674:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.753677:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f95 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753683:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f95 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753691:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4e00) 00010000:00010000:0.0:1763343040.753694:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.753698:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f95 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753704:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae8f95 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.753746:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae8f87 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fad expref: 276 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.753762:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8f9c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fad expref: 275 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.753776:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4500) 00010000:00010000:0.0:1763343040.753779:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343040.753781:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058ddc00, rc 0) 00000100:00100000:0.0:1763343040.753874:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:56943:x1848997993713536:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 756us (3662us total) trans 8589940323 rc 0/0 00000100:00100000:0.0:1763343040.753883:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9707 00000100:00100000:3.0:1763343040.758554:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.758901:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993713792 00000100:00100000:0.0:1763343040.758914:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993713792 00000100:00100000:0.0:1763343040.759278:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9708 00000100:00100000:0.0:1763343040.759289:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:55941:x1848997993713792:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343040.759313:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.759317:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343040.759345:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae8f6b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f9f expref: 275 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.759364:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4500) 00010000:00010000:0.0:1763343040.759369:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343040.759383:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae8faa lrc: 2/0,0 mode: --/EX res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9fb4 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.759431:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8fb1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.759443:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8f9c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fad expref: 275 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.759452:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8fb1 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x201:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.759484:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8f9c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fad expref: 275 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.759496:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8f9c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fad expref: 275 pid: 28422 timeout: 1334 lvb_type: 0 00000100:00100000:0.0:1763343040.759510:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010317440:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343040.759601:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31a80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343040.760471:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.761293:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993714048 00000100:00100000:1.0:1763343040.761303:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993714048 00000100:00100000:1.0:1763343040.761363:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3314 00000100:00100000:1.0:1763343040.761373:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:56943:x1848997993714048:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343040.761593:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:56943:x1848997993714048:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 221us (1125us total) trans 8589940324 rc 0/0 00000100:00100000:1.0:1763343040.761601:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3314 00000100:00100000:3.0:1763343040.766486:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.767357:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010317440:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343040.767388:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8fb1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x201:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343040.767428:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993714176 00000100:00100000:2.0:1763343040.767437:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993714176 00000100:00100000:2.0:1763343040.767497:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3315 00000100:00100000:2.0:1763343040.767506:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:56943:x1848997993714176:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:2.0:1763343040.767695:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:56943:x1848997993714176:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 189us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.767703:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3315 00000100:00100000:0.0:1763343040.768428:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.768851:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993714304 00000100:00100000:1.0:1763343040.768859:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993714304 00010000:00010000:1.0:1763343040.768892:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8f9c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fad expref: 277 pid: 28422 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343040.768927:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3204 00000100:00100000:1.0:1763343040.768936:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:2429:x1848997993714304:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343040.768950:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343040.768956:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8f9c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fad expref: 277 pid: 28422 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.768967:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8f9c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fad expref: 277 pid: 28422 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.768987:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae8f9c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fad expref: 277 pid: 28422 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.769004:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4500) 00010000:00010000:1.0:1763343040.769010:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8fb1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x201:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.769020:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8fb1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.769027:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8fb1 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.769050:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343040.769089:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:2429:x1848997993714304:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 154us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.769096:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3204 00010000:00010000:2.0:1763343040.769166:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8fb1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.769174:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8fb1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:2.0:1763343040.769406:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1535, 88 off129024 00000004:00080000:2.0:1763343040.769415:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1234436793469ns, next at 1235292288054ns, rc = 0 00000040:00080000:2.0:1763343040.769453:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1534, 88 off129024 00000004:00080000:2.0:1763343040.769458:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1234436837279ns, next at 1235292259329ns, rc = 0 00000040:00080000:2.0:1763343040.769471:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1535, 88 off129112 00000004:00080000:2.0:1763343040.769474:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1234436853529ns, next at 1235292259329ns, rc = 0 00000040:00080000:2.0:1763343040.769482:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1536, 88 off129112 00000004:00080000:2.0:1763343040.769485:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1234436864561ns, next at 1235292288054ns, rc = 0 00000001:00080000:1.0:1763343040.780659:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940325 is committed 00000004:00080000:1.0:1763343040.780673:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1011 committed 00000004:00080000:1.0:1763343040.780689:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1012 committed 00000004:00080000:1.0:1763343040.780697:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1011 committed 00000004:00080000:1.0:1763343040.780699:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1010 committed 00010000:00010000:2.0:1763343040.780786:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae8f80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.780799:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae8f80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.780808:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae8f80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.780814:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.780830:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae8f80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.780838:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae8f80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.780856:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4500) 00010000:00010000:2.0:1763343040.780858:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.780863:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae8f80 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.780869:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae8f80 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.780932:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x201:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fb4 expref: 264 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.780946:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4500) 00010000:00010000:2.0:1763343040.780948:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343040.780965:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae8faa lrc: 0/0,0 mode: --/EX res: [0x200000405:0x201:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fb4 expref: 264 pid: 28422 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343040.780979:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x201:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fb4 expref: 263 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.781015:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4500) 00010000:00010000:2.0:1763343040.781019:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343040.781021:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a5fe00, rc 0) 00000100:00100000:2.0:1763343040.781108:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:55941:x1848997993713792:12345-192.168.204.21@tcp:101:bash.0 Request processed in 21819us (22561us total) trans 8589940325 rc 0/0 00000100:00100000:2.0:1763343040.781119:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9708 00000100:00100000:2.0:1763343040.781582:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010317568:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343040.781680:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343040.781715:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343040.781721:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340683b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010317952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343040.781745:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343040.781815:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010317568 00000100:00100000:0.0:1763343040.781832:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010317568 00000100:00100000:0.0:1763343040.781881:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010317952 00000100:00100000:0.0:1763343040.781885:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010317952 00000100:00100000:0.0:1763343040.781910:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6865 00000100:00100000:0.0:1763343040.781919:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3660:x1848998010317568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343040.781944:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:713 count 1 00010000:00010000:0.0:1763343040.781969:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8fb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.781987:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8c70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eaa expref: 12 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.781996:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343040.781999:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343040.782003:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8fb8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.782027:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8c70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eaa expref: 12 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.782040:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8c70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eaa expref: 12 pid: 8408 timeout: 1334 lvb_type: 0 00000100:00100000:0.0:1763343040.782052:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406838380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010318080:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343040.782099:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31a80 going to sleep for 11 seconds 00000100:00100000:0.0:1763343040.782116:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6866 00000100:00100000:0.0:1763343040.782123:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3660:x1848998010317952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343040.782411:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3660:x1848998010317952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 287us (665us total) trans 21474839043 rc 0/0 00000100:00100000:0.0:1763343040.782419:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6866 00000100:00100000:2.0:1763343040.782616:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010318208:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763343040.782680:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763343040.782726:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340683b800/2, rc 0, transno 21474839043 00000100:00100000:2.0:1763343040.782732:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340683b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010317952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343040.782741:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343040.782747:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010318592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343040.782770:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343040.782839:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010318208 00000100:00100000:3.0:1763343040.782845:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010318208 00000100:00100000:3.0:1763343040.782881:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010318592 00000100:00100000:3.0:1763343040.782885:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010318592 00000100:00100000:3.0:1763343040.782906:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6867 00000100:00100000:3.0:1763343040.782913:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3660:x1848998010318208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343040.782927:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:715 count 1 00010000:00010000:3.0:1763343040.782944:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae8fbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.782957:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3404b77600/0x607405d401ae8d9d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f0c expref: 21 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343040.782964:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.782966:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.782968:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae8fbf lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.782988:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a3404b77600/0x607405d401ae8d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f0c expref: 21 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343040.782998:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a3404b77600/0x607405d401ae8d9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f0c expref: 21 pid: 28996 timeout: 1334 lvb_type: 1 00000100:00100000:3.0:1763343040.783008:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010318720:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343040.783044:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c180 going to sleep for 11 seconds 00000100:00100000:3.0:1763343040.783060:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6868 00000100:00100000:3.0:1763343040.783067:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3660:x1848998010318592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343040.783175:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3660:x1848998010318592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (403us total) trans 17179871746 rc 0/0 00000100:00100000:3.0:1763343040.783181:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6868 00000004:00080000:3.0:1763343040.783208:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3404ba7100/2, rc 0, transno 17179871746 00000100:00100000:3.0:1763343040.783213:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010318592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.783544:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010317824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343040.783574:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343040.783606:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010318464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.783655:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343040.783682:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1763343040.783689:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010317696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343040.783710:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343040.783727:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010318336:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.783747:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343040.783772:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010317824 00000100:00100000:1.0:1763343040.783776:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010317824 00000100:00100000:1.0:1763343040.783799:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010318464 00000100:00100000:1.0:1763343040.783801:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010318464 00000100:00100000:1.0:1763343040.783814:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010317696 00000100:00100000:1.0:1763343040.783828:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010317696 00000100:00100000:1.0:1763343040.783843:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010318336 00000100:00100000:1.0:1763343040.783846:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010318336 00000100:00100000:1.0:1763343040.783861:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6869 00000100:00100000:1.0:1763343040.783867:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3658:x1848998010317824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343040.783969:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3658:x1848998010317824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (393us total) trans 21474839044 rc 0/0 00000100:00100000:1.0:1763343040.783975:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6869 00000100:00100000:1.0:1763343040.783992:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6870 00000100:00100000:1.0:1763343040.783998:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3658:x1848998010318464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763343040.784055:0:28994:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2cf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343040.784058:0:28994:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2cf:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763343040.784061:0:28994:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2cf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343040.784063:0:28994:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2cf:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763343040.784065:0:28994:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2cf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343040.784090:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3658:x1848998010318464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (434us total) trans 17179871747 rc 0/0 00000100:00100000:1.0:1763343040.784096:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6870 00000100:00100000:1.0:1763343040.784109:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6871 00000100:00100000:1.0:1763343040.784116:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3658:x1848998010317696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343040.784127:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:714 count 1 00010000:00010000:1.0:1763343040.784141:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae8fc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.784154:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d171600/0x607405d401ae8e61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f4b expref: 12 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.784163:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343040.784164:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343040.784168:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae8fc6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.784190:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d171600/0x607405d401ae8e61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f4b expref: 12 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.784201:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340d171600/0x607405d401ae8e61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f4b expref: 12 pid: 8408 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343040.784212:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34050f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010318848:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343040.784242:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c600 going to sleep for 11 seconds 00000100:00100000:0.0:1763343040.784422:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6872 00000100:00100000:0.0:1763343040.784431:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3658:x1848998010318336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343040.784443:0:8408:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:716 count 1 00010000:00010000:0.0:1763343040.784455:0:8408:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae8fcd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.784466:0:8408:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340d171200/0x607405d401ae8e7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f52 expref: 21 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.784473:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343040.784475:0:8408:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343040.784478:0:8408:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae8fcd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.784495:0:8408:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340d171200/0x607405d401ae8e7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f52 expref: 21 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.784505:0:8408:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340d171200/0x607405d401ae8e7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f52 expref: 21 pid: 8408 timeout: 1334 lvb_type: 0 00000100:00100000:0.0:1763343040.784515:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406839180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010318976:192.168.204.21@tcp:104: 00000004:00080000:1.0:1763343040.784752:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34062c9500/2, rc 0, transno 21474839044 00000100:00100000:1.0:1763343040.784758:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010317824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343040.784863:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31f00 going to sleep for 11 seconds 00000004:00080000:1.0:1763343040.790047:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3404ba5880/2, rc 0, transno 17179871747 00000100:00100000:1.0:1763343040.790064:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010318464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763343040.790364:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34050f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010318848:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343040.790389:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae8fc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343040.790543:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.790616:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406839180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010318976:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343040.790654:0:8408:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae8fcd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343040.790722:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010318720:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343040.790736:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae8fbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343040.790830:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.791161:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.791188:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993714432 00000100:00100000:1.0:1763343040.791195:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993714432 00010000:00010000:1.0:1763343040.791231:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a3404b77600/0x607405d401ae8d9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f0c expref: 22 pid: 28996 timeout: 1334 lvb_type: 1 00000100:00100000:2.0:1763343040.791286:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993714688 00000100:00100000:2.0:1763343040.791290:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993714688 00010000:00010000:2.0:1763343040.791307:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d171200/0x607405d401ae8e7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f52 expref: 23 pid: 8408 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343040.791343:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3205 00000100:00100000:2.0:1763343040.791353:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993714432:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.791368:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.791373:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a3404b77600/0x607405d401ae8d9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f0c expref: 23 pid: 28996 timeout: 1334 lvb_type: 1 00010000:00010000:2.0:1763343040.791383:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a3404b77600/0x607405d401ae8d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f0c expref: 23 pid: 28996 timeout: 1334 lvb_type: 1 00010000:00010000:2.0:1763343040.791406:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3404b77600/0x607405d401ae8d9d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f0c expref: 23 pid: 28996 timeout: 1334 lvb_type: 1 00010000:00010000:2.0:1763343040.791422:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.791424:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.791429:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae8fbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.791444:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae8fbf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.791465:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343040.791510:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993714432:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 159us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.791518:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3205 00000100:00100000:2.0:1763343040.791536:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3206 00000100:00100000:2.0:1763343040.791543:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993714688:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343040.791552:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343040.791556:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340d171200/0x607405d401ae8e7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f52 expref: 21 pid: 8408 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343040.791566:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340d171200/0x607405d401ae8e7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f52 expref: 21 pid: 8408 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343040.791577:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d171200/0x607405d401ae8e7d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f52 expref: 21 pid: 8408 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343040.791586:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.791588:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.791591:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae8fcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.791598:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae8fcd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.791616:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343040.791663:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993714688:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 120us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.791669:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3206 00010000:00010000:2.0:1763343040.791691:0:8408:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae8fcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.791699:0:8408:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae8fcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.791708:0:8408:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae8fcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.791716:0:8408:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae8fcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.791731:0:8408:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343040.791957:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3658:x1848998010318336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7527us (8208us total) trans 17179871748 rc 0/0 00000100:00100000:2.0:1763343040.791964:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6872 00010000:00010000:2.0:1763343040.791985:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343040.791991:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae8fcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.791998:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058ddc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343040.792002:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae8fcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.792012:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae8fcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.792025:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae8fcd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.792032:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae8fcd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.792047:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.792049:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.792051:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343040.796344:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae8fbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.796362:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae8fbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.796373:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae8fbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.796381:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae8fbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.796416:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343040.796811:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3660:x1848998010318208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13895us (14126us total) trans 17179871749 rc 0/0 00000100:00100000:3.0:1763343040.796835:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6867 00000004:00080000:3.0:1763343040.796907:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3404ba4380/2, rc 0, transno 17179871749 00000100:00100000:3.0:1763343040.796914:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010318208:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1763343040.797181:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343040.797189:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae8fbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.797198:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343040.797201:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae8fbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.797211:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae8fbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.797233:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae8fbf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.797240:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae8fbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.797259:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.797261:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.797272:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343040.798274:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.798342:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406838380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010318080:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343040.798363:0:28648:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8fb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343040.798406:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000004:00080000:0.0:1763343040.798457:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3404ba6a00/2, rc 0, transno 17179871748 00000100:00100000:0.0:1763343040.798463:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010318336:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343040.798528:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993714560 00000100:00100000:3.0:1763343040.798535:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993714560 00010000:00010000:3.0:1763343040.798567:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d171600/0x607405d401ae8e61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f4b expref: 13 pid: 8408 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343040.798653:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993714816 00000100:00100000:2.0:1763343040.798657:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993714816 00000100:00100000:2.0:1763343040.798684:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6873 00000100:00100000:2.0:1763343040.798690:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:55941:x1848997993714816:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343040.798702:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.798717:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae8fd4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9fbb expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.798742:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae8f4f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f91 expref: 21 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343040.798749:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.798752:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343040.798756:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae8fd4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fbb expref: 21 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.798784:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae8f4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f91 expref: 21 pid: 28648 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343040.798794:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae8f4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f91 expref: 21 pid: 28648 timeout: 1334 lvb_type: 1 00000100:00100000:2.0:1763343040.798808:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010319104:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343040.798891:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509fc2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343040.798972:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993714944 00000100:00100000:3.0:1763343040.798977:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993714944 00010000:00010000:3.0:1763343040.798990:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8c70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eaa expref: 14 pid: 8408 timeout: 1334 lvb_type: 0 00000100:00100000:3.0:1763343040.799010:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3207 00000100:00100000:3.0:1763343040.799017:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993714560:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343040.799026:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343040.799031:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d171600/0x607405d401ae8e61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f4b expref: 14 pid: 8408 timeout: 1334 lvb_type: 0 00010000:00010000:3.0:1763343040.799041:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d171600/0x607405d401ae8e61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f4b expref: 14 pid: 8408 timeout: 1334 lvb_type: 0 00010000:00010000:3.0:1763343040.799059:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d171600/0x607405d401ae8e61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f4b expref: 14 pid: 8408 timeout: 1334 lvb_type: 0 00010000:00010000:3.0:1763343040.799072:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.799074:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.799079:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae8fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799092:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae8fc6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799112:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343040.799138:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993714560:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 121us (7976us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343040.799145:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3207 00000100:00100000:3.0:1763343040.799162:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3208 00000100:00100000:3.0:1763343040.799169:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2432:x1848997993714944:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343040.799177:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343040.799182:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8c70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eaa expref: 12 pid: 8408 timeout: 1334 lvb_type: 0 00010000:00010000:3.0:1763343040.799191:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8c70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eaa expref: 12 pid: 8408 timeout: 1334 lvb_type: 0 00010000:00010000:3.0:1763343040.799203:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176200/0x607405d401ae8c70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9eaa expref: 12 pid: 8408 timeout: 1334 lvb_type: 0 00010000:00010000:3.0:1763343040.799212:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.799214:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.799217:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799223:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8fb8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799245:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343040.799264:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2432:x1848997993714944:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 96us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343040.799271:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3208 00010000:00010000:3.0:1763343040.799293:0:28648:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799300:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799309:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799316:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799334:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343040.799554:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3660:x1848998010317568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17636us (17873us total) trans 21474839045 rc 0/0 00000100:00100000:3.0:1763343040.799563:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6865 00010000:00010000:3.0:1763343040.799581:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343040.799587:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799594:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3403a5e400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343040.799598:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799606:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8fb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799641:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8fb8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799649:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5e400/0x607405d401ae8fb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799665:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343040.799667:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343040.799669:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343040.799694:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035e9f80/2, rc 0, transno 21474839045 00000100:00100000:3.0:1763343040.799700:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010317568:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1763343040.799717:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae8fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799725:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae8fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799732:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae8fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799738:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae8fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799756:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343040.799952:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3658:x1848998010317696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15836us (16239us total) trans 21474839046 rc 0/0 00000100:00100000:3.0:1763343040.799959:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6871 00010000:00010000:3.0:1763343040.799978:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343040.799982:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae8fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799989:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3537b6cc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343040.799991:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae8fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.799998:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae8fc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.800008:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae8fc6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.800016:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae8fc6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.800028:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343040.800030:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343040.800031:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343040.800049:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34035e9500/2, rc 0, transno 21474839046 00000100:00100000:3.0:1763343040.800054:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010317696:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343040.804915:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.805020:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010319104:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343040.805057:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae8fd4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fbb expref: 21 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.805079:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d400, rc 0) 00000100:00100000:2.0:1763343040.805142:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:55941:x1848997993714816:12345-192.168.204.21@tcp:101:bash.0 Request processed in 6450us (6873us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343040.805151:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6873 00000100:00100000:3.0:1763343040.805575:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993715328 00000100:00100000:3.0:1763343040.805583:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993715328 00010000:00010000:3.0:1763343040.805616:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae8f4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f91 expref: 21 pid: 28648 timeout: 1334 lvb_type: 1 00000100:00100000:3.0:1763343040.805680:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3209 00000100:00100000:3.0:1763343040.805689:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35084c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993715328:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343040.805703:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343040.805709:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae8f4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f91 expref: 21 pid: 28648 timeout: 1334 lvb_type: 1 00010000:00010000:3.0:1763343040.805720:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae8f4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f91 expref: 21 pid: 28648 timeout: 1334 lvb_type: 1 00010000:00010000:3.0:1763343040.805743:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae8f4f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9f91 expref: 21 pid: 28648 timeout: 1334 lvb_type: 1 00010000:00010000:3.0:1763343040.805756:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.805758:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.805765:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae8fd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fbb expref: 20 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.805775:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae8fd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fbb expref: 20 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.805808:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae8fd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fbb expref: 20 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343040.805838:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3404ba4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1848998010319232:192.168.204.21@tcp:105: 00000100:00100000:3.0:1763343040.805896:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343040.811106:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.811218:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993715200 00000100:00100000:2.0:1763343040.811237:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993715200 00000100:00100000:2.0:1763343040.811299:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9709 00000100:00100000:2.0:1763343040.811310:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56948:x1848997993715200:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.811336:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.811359:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8fdb lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9fc2 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.811435:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8fe2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811450:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8fe2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811460:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8fe2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811473:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8fe9 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811484:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811491:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811599:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8ff0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811608:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811615:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343040.811651:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x201:0x0]: returning size 2 00010000:00010000:2.0:1763343040.811737:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8fe2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811745:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8fe2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811751:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8fe2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811756:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.811761:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8fe2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811767:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8fe2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811779:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343040.811783:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.811788:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8fe2 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811794:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae8fe2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811806:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811811:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811827:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811832:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.811835:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811841:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811848:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc000) 00010000:00010000:2.0:1763343040.811850:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.811853:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8fe9 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811859:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae8fe9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.811895:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae8fdb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fc2 expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.811913:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fc2 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.811919:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4500) 00010000:00010000:2.0:1763343040.811922:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343040.811924:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c800, rc 0) 00000100:00100000:2.0:1763343040.811982:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56948:x1848997993715200:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 674us (887us total) trans 8589940326 rc 0/0 00000100:00100000:2.0:1763343040.811990:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9709 00000100:00100000:3.0:1763343040.812432:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3404ba4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1848998010319232:192.168.204.21@tcp:105: 00010000:00010000:3.0:1763343040.812453:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343040.813038:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.814595:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993715456 00000100:00100000:2.0:1763343040.814607:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993715456 00000100:00100000:1.0:1763343040.815588:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6874 00000100:00100000:1.0:1763343040.815605:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:55941:x1848997993715456:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343040.815668:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.815690:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8ffe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9fc9 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343040.815714:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343040.815737:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.815739:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343040.815748:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8ffe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fc9 expref: 12 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.815763:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8ffe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fc9 expref: 12 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.815774:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3537b6d200, rc 0) 00000100:00100000:1.0:1763343040.815862:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:55941:x1848997993715456:12345-192.168.204.21@tcp:101:bash.0 Request processed in 263us (2824us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.815869:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6874 00000100:00100000:2.0:1763343040.817445:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.817535:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993715712 00000100:00100000:3.0:1763343040.817553:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993715712 00000100:00100000:3.0:1763343040.817675:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3316 00000100:00100000:3.0:1763343040.817690:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56948:x1848997993715712:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343040.817895:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35084c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993715328:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 12202us (12987us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.817908:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3209 00000100:00100000:3.0:1763343040.818008:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56948:x1848997993715712:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 321us (568us total) trans 8589940327 rc 0/0 00000100:00100000:3.0:1763343040.818017:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3316 00000100:00100000:1.0:1763343040.823547:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.823667:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.823828:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993715968 00000100:00100000:2.0:1763343040.823840:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993715968 00002000:00010000:2.0:1763343040.823880:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/717 (0->18446744073709551615) 00002000:00100000:2.0:1763343040.823885:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34050f5880 with x1848997993715968 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343040.823896:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34050f5880. 00000100:00100000:2.0:1763343040.823916:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993715840 00000100:00100000:2.0:1763343040.823919:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993715840 00002000:00010000:2.0:1763343040.823930:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/719 (0->18446744073709551615) 00002000:00100000:2.0:1763343040.823933:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34050f7100 with x1848997993715840 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343040.823938:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34050f7100. 00000100:00100000:2.0:1763343040.823963:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1664 00000100:00100000:2.0:1763343040.823973:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993715968:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343040.824148:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2cd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343040.824152:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2cd:0x0] updating lvb mtime from disk: 0 -> 1763343040 00002000:00010000:2.0:1763343040.824155:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2cd:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343040.824158:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2cd:0x0] updating lvb ctime from disk: 0 -> 1763343040 00002000:00010000:2.0:1763343040.824160:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2cd:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343040.824220:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993715968:12345-192.168.204.21@tcp:10:bash.0 Request processed in 247us (685us total) trans 21474839047 rc 0/0 00000100:00100000:2.0:1763343040.824228:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1664 00002000:00010000:2.0:1763343040.824232:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/717 (0->18446744073709551615) 00002000:00100000:2.0:1763343040.824235:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34050f5880 with x1848997993715968 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343040.824240:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34050f5880. 00000100:00100000:2.0:1763343040.824257:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1665 00000100:00100000:2.0:1763343040.824265:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993715840:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343040.824341:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2cf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343040.824344:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2cf:0x0] updating lvb mtime from disk: 0 -> 1763343040 00002000:00010000:2.0:1763343040.824346:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2cf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343040.824348:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2cf:0x0] updating lvb ctime from disk: 0 -> 1763343040 00002000:00010000:2.0:1763343040.824351:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2cf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343040.824373:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993715840:12345-192.168.204.21@tcp:10:bash.0 Request processed in 109us (706us total) trans 17179871750 rc 0/0 00000100:00100000:2.0:1763343040.824379:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1665 00002000:00010000:2.0:1763343040.824382:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/719 (0->18446744073709551615) 00002000:00100000:2.0:1763343040.824385:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34050f7100 with x1848997993715840 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343040.824389:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34050f7100. 00000100:00100000:0.0:1763343040.835747:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.835967:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993716224 00000100:00100000:3.0:1763343040.835986:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993716224 00000100:00100000:3.0:1763343040.836069:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3317 00000100:00100000:3.0:1763343040.836080:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:55941:x1848997993716224:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:3.0:1763343040.836510:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:55941:x1848997993716224:12345-192.168.204.21@tcp:35:bash.0 Request processed in 429us (770us total) trans 8589940328 rc 0/0 00000100:00100000:3.0:1763343040.836519:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3317 00000100:00100000:2.0:1763343040.863826:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.863938:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993716480 00000100:00100000:1.0:1763343040.863951:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993716480 00000100:00100000:1.0:1763343040.864021:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9710 00000100:00100000:1.0:1763343040.864032:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56950:x1848997993716480:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:1.0:1763343040.864098:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763343040.864128:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae8fb1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x201:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fb4 expref: 267 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.864151:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae8ff0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x201:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fc2 expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.864163:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae8f79 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x201:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fa6 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.864175:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a34039e4500) 00010000:00010000:1.0:1763343040.864186:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343040.864215:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae9005 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.864228:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae9005 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.864239:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae9005 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.864250:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae900c lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.864256:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae900c lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.864266:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae900c lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.864540:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9013 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.864549:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9013 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.864556:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9013 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000040:00080000:1.0:1763343040.868595:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1537, 64 off129176 00000040:00080000:1.0:1763343040.868658:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1536, 64 off129176 00000040:00080000:1.0:1763343040.868672:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1537, 64 off129240 00000040:00080000:1.0:1763343040.868681:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1538, 64 off129240 00010000:00010000:1.0:1763343040.868764:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae901a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x201:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.868782:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae901a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.868794:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae901a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.868803:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae901a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.868810:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae901a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.868828:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae901a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.870639:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343040.870653:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae901a lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.870667:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34068abc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343040.870672:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae901a lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.870681:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae901a lrc: 5/0,0 mode: PW/PW res: [0x200000405:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.870696:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a3510289300) 00010000:00010000:2.0:1763343040.870699:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763343040.870704:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae901a lrc: 3/0,0 mode: --/PW res: [0x200000405:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.870714:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.870716:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343040.870718:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343040.870850:0:6525:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1763343040.870858:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae901a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x201:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.870894:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9013 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.870900:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9013 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.870906:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9013 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.870911:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34068aa000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.870914:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9013 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.870920:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9013 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.870928:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x201:0x0].0x0 (ffff9a3510289300) 00010000:00010000:1.0:1763343040.870931:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763343040.870934:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9013 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.870939:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9013 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.871095:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae9005 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.871102:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae9005 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.871111:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae9005 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.871116:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae9005 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.871121:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3537b6cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.871124:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae9005 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.871129:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae9005 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.871136:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289500) 00010000:00010000:1.0:1763343040.871139:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343040.871142:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae9005 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.871147:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae9005 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:1.0:1763343040.871161:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c76fe38b reply state 00000000f0e95bc7 transno 8589940329 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae900c lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.871172:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae900c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343040.871178:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289700) 00010000:00010000:1.0:1763343040.871181:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343040.871183:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343040.871273:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56950:x1848997993716480:12345-192.168.204.21@tcp:36:rm.0 Request processed in 7237us (7463us total) trans 8589940329 rc 0/0 00000100:00100000:1.0:1763343040.871287:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9710 00000100:00100000:1.0:1763343040.878107:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.878408:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993716736 00000100:00100000:2.0:1763343040.878423:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993716736 00000100:00100000:2.0:1763343040.878521:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9711 00000100:00100000:2.0:1763343040.878532:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56949:x1848997993716736:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.878571:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.878604:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae9021 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9fd0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.880083:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9028 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880110:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9028 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880124:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9028 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880141:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae902f lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880148:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae902f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880154:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae902f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880204:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9028 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880212:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9028 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880218:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9028 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880226:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9028 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880231:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.880237:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9028 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880245:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9028 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880258:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343040.880262:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.880267:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9028 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880273:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9028 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880293:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae902f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880299:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae902f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880305:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae902f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880309:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.880312:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae902f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880317:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae902f lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880324:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289700) 00010000:00010000:2.0:1763343040.880327:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.880330:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae902f lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880335:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae902f lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.880373:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae9021 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fd0 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.880385:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343040.880388:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343040.880392:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae9021 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fd0 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.880415:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352da00, rc 0) 00000100:00100000:2.0:1763343040.883842:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56949:x1848997993716736:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 5281us (5721us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343040.883862:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9711 00000100:00100000:0.0:1763343040.894765:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.897059:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993716864 00000100:00100000:2.0:1763343040.897082:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993716864 00000100:00100000:2.0:1763343040.899196:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9712 00000100:00100000:2.0:1763343040.899228:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56949:x1848997993716864:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.899260:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.899313:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae9036 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9fd7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.899418:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae903d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899435:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae903d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899450:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae903d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899462:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9044 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899469:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9044 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899475:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9044 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899528:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae903d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899534:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae903d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899540:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae903d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899546:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae903d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899552:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.899556:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae903d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899562:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae903d lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899575:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343040.899579:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.899583:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae903d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899589:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae903d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899605:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9044 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899610:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9044 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899616:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9044 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899650:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.899653:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9044 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899659:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9044 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899665:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289700) 00010000:00010000:2.0:1763343040.899667:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.899670:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9044 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899675:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9044 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.899706:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae9036 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fd7 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.899717:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343040.899719:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.899722:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae9036 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fd7 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.899735:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352da00, rc 0) 00000100:00100000:2.0:1763343040.899845:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56949:x1848997993716864:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 632us (5096us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343040.899854:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9712 00000100:00100000:1.0:1763343040.912897:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.913002:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993716992 00000100:00100000:2.0:1763343040.913016:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993716992 00000100:00100000:2.0:1763343040.913095:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9713 00000100:00100000:2.0:1763343040.913107:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56951:x1848997993716992:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.913135:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.913166:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae904b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9fde expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.913267:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9052 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913286:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9052 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913308:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9052 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913321:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9059 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913329:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9059 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913336:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9059 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913390:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9052 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913397:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9052 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913404:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9052 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913411:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9052 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913422:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.913427:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9052 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913436:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9052 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913452:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343040.913455:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.913461:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9052 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913467:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9052 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913481:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9059 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913487:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9059 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913492:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9059 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913496:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.913499:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9059 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913504:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9059 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913509:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289700) 00010000:00010000:2.0:1763343040.913511:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.913515:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9059 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913520:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9059 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343040.913548:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae904b lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fde expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.913557:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343040.913559:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.913562:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae904b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fde expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.913575:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352da00, rc 0) 00000100:00100000:2.0:1763343040.913708:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56951:x1848997993716992:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 603us (825us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343040.913717:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9713 00000100:00100000:3.0:1763343040.916042:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.916187:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993717120 00000100:00100000:1.0:1763343040.916200:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993717120 00000100:00100000:1.0:1763343040.916278:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9714 00000100:00100000:1.0:1763343040.916289:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56951:x1848997993717120:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.916316:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.916347:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9060 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9fe5 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.916428:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9067 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916443:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9067 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916456:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9067 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916468:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae906e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916475:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae906e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916481:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae906e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916532:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9067 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916543:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9067 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916550:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9067 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916556:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34068abc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.916560:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9067 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916567:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9067 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916580:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289500) 00010000:00010000:1.0:1763343040.916583:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343040.916588:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9067 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916594:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9067 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916607:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae906e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916612:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae906e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916660:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae906e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916667:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34068ab800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343040.916670:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae906e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916679:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae906e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916687:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289700) 00010000:00010000:1.0:1763343040.916689:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343040.916692:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae906e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916698:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae906e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.916725:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9060 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fe5 expref: 267 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.916735:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289500) 00010000:00010000:1.0:1763343040.916738:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343040.916741:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9060 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fe5 expref: 267 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.916754:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34068aa000, rc 0) 00000100:00100000:1.0:1763343040.916837:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56951:x1848997993717120:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 549us (808us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343040.916844:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9714 00000100:00100000:3.0:1763343040.923243:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.923365:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993717248 00000100:00100000:1.0:1763343040.923379:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993717248 00000100:00100000:1.0:1763343040.923452:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9715 00000100:00100000:1.0:1763343040.923465:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56951:x1848997993717248:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343040.923494:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343040.923528:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9075 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9fec expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.923615:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae907c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.923656:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae907c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.923671:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae907c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343040.923740:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1763343040.923747:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343040.923791:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9075 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fec expref: 268 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.923810:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae907c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fec expref: 267 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343040.923831:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289300) 00010000:00010000:1.0:1763343040.923835:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343040.923839:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3537b6cc00, rc 0) 00000100:00100000:1.0:1763343040.923916:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56951:x1848997993717248:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 454us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.923925:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9715 00010000:00010000:3.0:1763343040.928415:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343040.934583:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.934664:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993717504 00000100:00100000:1.0:1763343040.934681:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993717504 00000100:00100000:0.0:1763343040.934776:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9716 00000100:00100000:0.0:1763343040.934793:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56952:x1848997993717504:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343040.934832:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.934865:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9083 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ff3 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.934976:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae908a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.934993:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae908a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935007:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae908a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935017:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9091 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935024:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9091 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935029:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9091 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935078:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae908a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935085:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae908a lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935092:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae908a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935098:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.935103:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae908a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935111:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae908a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935129:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289300) 00010000:00010000:0.0:1763343040.935132:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.935137:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae908a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935144:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae908a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935159:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9091 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935165:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9091 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935172:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9091 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935176:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343040.935178:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9091 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935183:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9091 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935189:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289700) 00010000:00010000:0.0:1763343040.935191:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343040.935194:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9091 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935198:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9091 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343040.935230:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9083 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ff3 expref: 268 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.935240:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289300) 00010000:00010000:0.0:1763343040.935243:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343040.935247:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9083 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ff3 expref: 268 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.935257:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd800, rc 0) 00000100:00100000:0.0:1763343040.935347:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56952:x1848997993717504:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 559us (780us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343040.935356:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9716 00000100:00100000:0.0:1763343040.948125:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343040.949854:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993717760 00000100:00100000:1.0:1763343040.949874:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993717760 00000100:00100000:2.0:1763343040.950515:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9717 00000100:00100000:2.0:1763343040.950529:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56951:x1848997993717760:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.950561:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.950565:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343040.950606:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae907c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fec expref: 267 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.950659:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289300) 00010000:00010000:2.0:1763343040.951158:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343040.951185:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae9098 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffac9ffa expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.951324:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae909f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.951340:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae909f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.951352:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae909f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.951364:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae90a6 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.951372:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae90a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.951379:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae90a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.951961:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae90ad lrc: 3/1,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.951972:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae90ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.951980:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae90ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343040.951990:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x202:0x0]: returning size 0 00010000:00010000:2.0:1763343040.952019:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae909f lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.952027:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae909f lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.952039:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae909f lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.952045:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343040.952050:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae909f lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.952059:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae909f lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.952069:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343040.952072:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343040.952077:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae909f lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.952083:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae909f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:2.0:1763343040.952095:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000726bece7 reply state 000000005e0c79b7 transno 8589940330 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae90a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.952107:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae90a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.952113:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289700) 00010000:00010000:2.0:1763343040.952116:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343040.952119:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343040.952150:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae9098 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ffa expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.952168:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae90ad lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ffa expref: 268 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.952181:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34037bc000) 00010000:00010000:2.0:1763343040.952184:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343040.952187:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d600, rc 0) 00000100:00100000:2.0:1763343040.952288:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56951:x1848997993717760:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1760us (4178us total) trans 8589940330 rc 0/0 00000100:00100000:2.0:1763343040.952297:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9717 00000100:00100000:3.0:1763343040.958146:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.958890:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.961051:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993718016 00000100:00100000:2.0:1763343040.961075:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993718016 00000100:00100000:2.0:1763343040.961168:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993718272 00000100:00100000:2.0:1763343040.961172:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993718272 00000100:00100000:2.0:1763343040.961204:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9718 00000100:00100000:2.0:1763343040.961214:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3404ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56951:x1848997993718016:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343040.961251:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343040.961291:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae90bb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca001 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.961474:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae90c2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.961493:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae90ad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ffa expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.961502:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae90c2 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343040.961544:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae90ad lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ffa expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343040.961564:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae90ad lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ffa expref: 271 pid: 28422 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343040.961580:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010319360:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343040.961731:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509fc2240 going to sleep for 11 seconds 00000100:00100000:3.0:1763343040.962077:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9719 00000100:00100000:3.0:1763343040.962091:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56953:x1848997993718272:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343040.962103:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343040.962114:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae90c9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca008 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.962174:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90d0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.962186:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.962199:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343040.962212:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x202:0x0]: returning size 0 00010000:00010000:3.0:1763343040.962315:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.962325:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90d0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.962332:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90d0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.962338:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.962342:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90d0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.962350:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90d0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.962365:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34037bc000) 00010000:00010000:3.0:1763343040.962368:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763343040.962374:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90d0 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.962381:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90d0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343040.962430:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae90c9 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x202:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca008 expref: 273 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.962440:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34037bc000) 00010000:00010000:3.0:1763343040.962442:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343040.962446:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae90c9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x202:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca008 expref: 273 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.962527:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6200, rc 0) 00000100:00100000:3.0:1763343040.962603:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56953:x1848997993718272:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 515us (3715us total) trans 8589940331 rc 301/301 00000100:00100000:3.0:1763343040.962611:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9719 00000100:00100000:3.0:1763343040.964800:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343040.965421:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010319360:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343040.965461:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae90c2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:1.0:1763343040.965572:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993718400 00000100:00100000:1.0:1763343040.965581:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993718400 00010000:00010000:1.0:1763343040.965990:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae90ad lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ffa expref: 272 pid: 28422 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343040.967033:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3210 00000100:00100000:1.0:1763343040.967056:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:2429:x1848997993718400:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343040.967082:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343040.967092:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae90ad lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ffa expref: 272 pid: 28422 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.967108:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae90ad lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ffa expref: 272 pid: 28422 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.967140:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae90ad lrc: 0/0,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9ffa expref: 272 pid: 28422 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343040.967164:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34037bc000) 00010000:00010000:1.0:1763343040.967170:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae90c2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.967181:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae90c2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.967190:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae90c2 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343040.968290:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343040.968927:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:2429:x1848997993718400:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 1870us (4127us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343040.968943:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3210 00010000:00010000:3.0:1763343040.969155:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae90c2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.969167:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae90c2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343040.969200:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x202:0x0]: returning size 0 00000100:00100000:2.0:1763343040.969312:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000004:00080000:3.0:1763343040.969462:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2cf:0x0], index 0: 0 00000004:00080000:3.0:1763343040.969472:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2d1:0x0], index 1: 0 00000004:00080000:3.0:1763343040.969478:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2d2:0x0], index 1: 0 00000004:00080000:3.0:1763343040.969482:0:28422:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2d0:0x0], index 0: 0 00010000:00010000:3.0:1763343040.969647:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae90c2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.969657:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae90c2 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.969665:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae90c2 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.969672:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.969677:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae90c2 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.969686:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae90c2 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.969704:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34037bc000) 00010000:00010000:3.0:1763343040.969708:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343040.969718:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae90c2 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.969724:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae90c2 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.969787:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae90bb lrc: 1/0,0 mode: --/CR res: [0x200000405:0x202:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca001 expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.969798:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34037bc000) 00010000:00010000:3.0:1763343040.969801:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343040.969804:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae90bb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x202:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca001 expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.969833:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352dc00, rc 0) 00000100:00100000:3.0:1763343040.969891:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3404ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56951:x1848997993718016:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8677us (11760us total) trans 8589940332 rc 301/301 00000100:00100000:3.0:1763343040.969899:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9718 00000100:00100000:1.0:1763343040.969955:0:32358:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34035e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32358:1848998010319488:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1763343040.970010:0:32358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343040.970054:0:32358:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343040.970192:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993718656 00000100:00100000:0.0:1763343040.970203:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993718656 00000100:00100000:3.0:1763343040.970239:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010319488 00000100:00100000:3.0:1763343040.970243:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010319488 00000100:00100000:0.0:1763343040.970266:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3318 00000100:00100000:0.0:1763343040.970276:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56953:x1848997993718656:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343040.970330:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6875 00000100:00100000:3.0:1763343040.970337:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:32358:x1848998010319488:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1763343040.970379:0:28996:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 738 00000100:00100000:0.0:1763343040.970493:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56953:x1848997993718656:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 218us (1181us total) trans 8589940333 rc 0/0 00000100:00100000:0.0:1763343040.970501:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3318 00000100:00100000:2.0:1763343040.974919:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.975490:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:32358:x1848998010319488:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5148us (5475us total) trans 17179871751 rc 0/0 00000100:00100000:1.0:1763343040.975902:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993718912 00000100:00100000:1.0:1763343040.975915:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993718912 00000100:00100000:1.0:1763343040.975973:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3319 00000100:00100000:1.0:1763343040.975983:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56951:x1848997993718912:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343040.976228:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56951:x1848997993718912:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 244us (1319us total) trans 8589940334 rc 0/0 00000100:00100000:1.0:1763343040.976236:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3319 00000100:00100000:3.0:1763343040.976708:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6875 00000100:00100000:0.0:1763343040.978154:0:32358:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34035e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:32358:1848998010319488:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1763343040.978180:0:32358:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2d2:0x0]-[0x2c0000401:0x301:0x0] 00000100:00100000:2.0:1763343040.978586:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.978919:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993719168 00000100:00100000:3.0:1763343040.978929:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993719168 00000100:00100000:3.0:1763343040.978987:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9720 00000100:00100000:3.0:1763343040.978996:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56953:x1848997993719168:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343040.979023:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343040.979055:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae90e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca00f expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.979153:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90ec lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979171:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90ec lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979185:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90ec lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979199:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae90f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979212:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae90f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979219:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae90f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979374:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae90fa lrc: 3/1,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979382:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae90fa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979389:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae90fa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343040.979401:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x202:0x0]: returning size 0 00010000:00010000:3.0:1763343040.979502:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90ec lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979510:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90ec lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979517:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979524:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.979529:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90ec lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979536:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90ec lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979550:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bd700) 00010000:00010000:3.0:1763343040.979554:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343040.979560:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90ec lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979567:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae90ec lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979579:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae90f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979585:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae90f3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979591:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae90f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979597:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343040.979600:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae90f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979606:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae90f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979613:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289700) 00010000:00010000:3.0:1763343040.979615:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343040.979667:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae90f3 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979676:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae90f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343040.979724:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae90e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca00f expref: 275 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.979750:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae90fa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca00f expref: 274 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.979757:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34037bdb00) 00010000:00010000:3.0:1763343040.979760:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343040.979763:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6600, rc 0) 00000100:00100000:3.0:1763343040.979859:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:56953:x1848997993719168:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 862us (1275us total) trans 8589940335 rc 0/0 00000100:00100000:3.0:1763343040.979867:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9720 00000100:00100000:2.0:1763343040.981923:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.982395:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993719424 00000100:00100000:0.0:1763343040.982408:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993719424 00000100:00100000:0.0:1763343040.982476:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3320 00000100:00100000:0.0:1763343040.982486:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:56951:x1848997993719424:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343040.982827:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:56951:x1848997993719424:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 327us (903us total) trans 8589940336 rc 0/0 00000100:00100000:0.0:1763343040.982836:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3320 00000100:00100000:2.0:1763343040.984965:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.985042:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993719552 00000100:00100000:3.0:1763343040.985053:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993719552 00000100:00100000:3.0:1763343040.985119:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6876 00000100:00100000:3.0:1763343040.985131:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993719552:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343040.985157:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343040.985187:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9108 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca016 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343040.985219:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343040.985244:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.985247:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343040.985260:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9108 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca016 expref: 14 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343040.985280:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9108 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca016 expref: 14 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343040.985303:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7c00, rc 0) 00000100:00100000:3.0:1763343040.985738:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993719552:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 606us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343040.985747:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6876 00000100:00100000:2.0:1763343040.989442:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.989792:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993719808 00000100:00100000:3.0:1763343040.989812:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993719808 00000100:00100000:0.0:1763343040.990795:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9721 00000100:00100000:0.0:1763343040.990850:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:55941:x1848997993719808:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343040.990889:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.990892:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343040.990930:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae90fa lrc: 0/0,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca00f expref: 275 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.990950:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34037bdb00) 00010000:00010000:0.0:1763343040.990965:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343040.990985:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae910f lrc: 2/0,0 mode: --/CW res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca01d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.991168:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9116 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.991182:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9116 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x202:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.991192:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9116 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x202:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343040.991207:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x202:0x0]: returning size 0 00010000:00010000:0.0:1763343040.991346:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae910f lrc: 0/0,0 mode: --/CW res: [0x200000405:0x202:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca01d expref: 277 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.991369:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9116 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x202:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca01d expref: 276 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.991451:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:0.0:1763343040.991454:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1763343040.991457:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd200, rc 0) 00000100:00100000:2.0:1763343040.992533:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.992669:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993719936 00000100:00100000:3.0:1763343040.992680:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993719936 00000100:00100000:3.0:1763343040.992736:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9722 00000100:00100000:3.0:1763343040.992744:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:56953:x1848997993719936:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343040.992766:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343040.992786:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9124 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca024 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.992939:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9124 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca024 expref: 278 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.992955:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9124 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca024 expref: 278 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343040.992978:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:3.0:1763343040.992980:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343040.992985:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6200, rc 0) 00000100:00100000:3.0:1763343040.993046:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+278:56953:x1848997993719936:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 302us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343040.993054:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9722 00000100:00100000:0.0:1763343040.995059:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:55941:x1848997993719808:12345-192.168.204.21@tcp:101:bash.0 Request processed in 4234us (5617us total) trans 8589940337 rc 0/0 00000100:00100000:0.0:1763343040.995075:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9721 00000100:00100000:3.0:1763343040.995305:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343040.995925:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993720064 00000100:00100000:0.0:1763343040.995939:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993720064 00000100:00100000:0.0:1763343040.996005:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9723 00000100:00100000:0.0:1763343040.996015:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:55941:x1848997993720064:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343040.996045:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343040.996071:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae912b lrc: 2/0,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca02b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.996113:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9132 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.996128:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9132 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.996140:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9132 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343040.996290:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae912b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca02b expref: 279 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.996317:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9132 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca02b expref: 278 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343040.996937:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:0.0:1763343040.996941:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343040.996946:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058ddc00, rc 0) 00000100:00100000:0.0:1763343040.997043:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+278:55941:x1848997993720064:12345-192.168.204.21@tcp:101:bash.0 Request processed in 1027us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343040.997051:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9723 00000100:00100000:1.0:1763343040.999119:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343040.999238:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993720320 00000100:00100000:3.0:1763343040.999253:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993720320 00000100:00100000:3.0:1763343040.999325:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3321 00000100:00100000:3.0:1763343040.999337:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+278:56953:x1848997993720320:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343040.999660:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+279:56953:x1848997993720320:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 323us (551us total) trans 8589940338 rc 0/0 00000100:00100000:3.0:1763343040.999679:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3321 00000100:00100000:2.0:1763343041.003534:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.003665:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993720832 00000100:00100000:0.0:1763343041.003680:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993720832 00000100:00100000:0.0:1763343041.003771:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9724 00000100:00100000:0.0:1763343041.003784:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+279:55941:x1848997993720832:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:0.0:1763343041.003877:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343041.003914:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9116 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x202:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca01d expref: 279 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.003939:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:0.0:1763343041.003947:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343041.004205:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9139 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.004223:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9139 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x202:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.004235:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9139 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x202:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000001:00080000:0.0:1763343041.004307:0:10042:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940339 00000004:00010000:0.0:1763343041.004344:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000492a14b6 reply state 00000000be30f0ad transno 8589940340 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9139 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x202:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.004359:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9139 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x202:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.004366:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:0.0:1763343041.004369:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343041.004373:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00080000:2.0:1763343041.004504:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1763343041.004552:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.004612:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993720576 00000100:00100000:1.0:1763343041.004632:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993720576 00000100:00100000:1.0:1763343041.004674:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9725 00000100:00100000:1.0:1763343041.004683:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340d1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:56953:x1848997993720576:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343041.004695:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.004713:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae9140 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca032 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.004779:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9147 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.004789:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9147 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.004797:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9147 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.004807:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae914e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.004825:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae914e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.004832:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae914e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.004938:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683e600/0x607405d401ae9155 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.004947:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683e600/0x607405d401ae9155 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.004953:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683e600/0x607405d401ae9155 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343041.005105:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x202:0x0]: returning size 0 00010000:00010000:1.0:1763343041.005167:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9147 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.005175:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9147 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.005181:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9147 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.005187:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9147 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.005192:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34068aa000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343041.005196:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9147 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.005204:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9147 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.005217:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289500) 00010000:00010000:1.0:1763343041.005220:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343041.005224:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9147 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.005230:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae9147 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.005240:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae914e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.005245:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae914e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.005250:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae914e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.005255:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34068abc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343041.005257:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae914e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.005317:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae914e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.005325:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289700) 00010000:00010000:1.0:1763343041.005327:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343041.005329:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae914e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.005335:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae914e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.005366:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae9140 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca032 expref: 285 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.005383:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683e600/0x607405d401ae9155 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca032 expref: 284 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.005390:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:1.0:1763343041.005392:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343041.005394:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340683e600, rc 0) 00000100:00100000:1.0:1763343041.006084:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340d1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+284:56953:x1848997993720576:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1397us (1527us total) trans 8589940341 rc 0/0 00000100:00100000:1.0:1763343041.006094:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9725 00000100:00100000:0.0:1763343041.007129:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:55941:x1848997993720832:12345-192.168.204.21@tcp:36:bash.0 Request processed in 3340us (3602us total) trans 8589940340 rc 0/0 00000100:00100000:0.0:1763343041.007141:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9724 00000020:00080000:0.0:1763343041.007147:0:10042:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343041.011353:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.011594:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.011716:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993721088 00000100:00100000:0.0:1763343041.011730:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993721088 00000100:00100000:0.0:1763343041.011802:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3322 00000100:00100000:0.0:1763343041.011823:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:56953:x1848997993721088:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343041.012109:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+284:56953:x1848997993721088:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 296us (770us total) trans 8589940342 rc 0/0 00000100:00100000:0.0:1763343041.012118:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3322 00000100:00100000:1.0:1763343041.012334:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993721344 00000100:00100000:1.0:1763343041.012340:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993721344 00000100:00100000:1.0:1763343041.012378:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9726 00000100:00100000:1.0:1763343041.012385:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+284:55941:x1848997993721344:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343041.012398:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.012402:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343041.012435:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9124 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca024 expref: 284 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.012455:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:1.0:1763343041.012461:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343041.012476:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f400/0x607405d401ae9163 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca039 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.012526:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f000/0x607405d401ae916a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.012545:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683e600/0x607405d401ae9155 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca032 expref: 284 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.012556:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f000/0x607405d401ae916a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x202:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.012597:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683e600/0x607405d401ae9155 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca032 expref: 284 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.012611:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683e600/0x607405d401ae9155 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca032 expref: 284 pid: 10041 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343041.012652:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010319616:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343041.012739:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1763343041.015511:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.015830:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993721472 00000100:00100000:1.0:1763343041.015843:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993721472 00000100:00100000:0.0:1763343041.016088:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010319616:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343041.016125:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f000/0x607405d401ae916a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x202:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:2.0:1763343041.016823:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3323 00000100:00100000:2.0:1763343041.016843:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+285:56953:x1848997993721472:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:2.0:1763343041.017082:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+285:56953:x1848997993721472:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 245us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.017090:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3323 00000100:00100000:3.0:1763343041.017925:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.018251:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993721600 00000100:00100000:1.0:1763343041.018270:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993721600 00010000:00010000:1.0:1763343041.018309:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683e600/0x607405d401ae9155 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca032 expref: 285 pid: 10041 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343041.018351:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3211 00000100:00100000:1.0:1763343041.018360:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+285:2429:x1848997993721600:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343041.018376:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343041.018384:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683e600/0x607405d401ae9155 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca032 expref: 285 pid: 10041 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343041.018398:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683e600/0x607405d401ae9155 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca032 expref: 285 pid: 10041 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343041.018426:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683e600/0x607405d401ae9155 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca032 expref: 285 pid: 10041 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343041.018444:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:1.0:1763343041.018450:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f000/0x607405d401ae916a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x202:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.018462:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f000/0x607405d401ae916a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.018471:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f000/0x607405d401ae916a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.018509:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343041.018538:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f000/0x607405d401ae916a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.018547:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f000/0x607405d401ae916a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:1.0:1763343041.018559:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+284:2429:x1848997993721600:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 201us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.018566:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3211 00000040:00080000:0.0:1763343041.018891:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1538, 88 off129328 00000004:00080000:0.0:1763343041.018902:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1234686280658ns, next at 1235292259329ns, rc = 0 00000040:00080000:1.0:1763343041.018981:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1539, 88 off129328 00000004:00080000:1.0:1763343041.018989:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1234686368376ns, next at 1235292288054ns, rc = 0 00000040:00080000:1.0:1763343041.019011:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1540, 88 off129416 00000004:00080000:1.0:1763343041.019016:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1234686394963ns, next at 1235292288054ns, rc = 0 00000040:00080000:1.0:1763343041.019028:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1539, 88 off129416 00000004:00080000:1.0:1763343041.019032:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1234686411728ns, next at 1235292259329ns, rc = 0 00000001:00080000:1.0:1763343041.024070:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940343 is committed 00000004:00080000:1.0:1763343041.024093:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1014 committed 00000004:00080000:1.0:1763343041.024105:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1013 committed 00010000:00010000:0.0:1763343041.024430:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae900c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.024445:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae900c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.024453:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae900c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.024459:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3537b6c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343041.024465:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae900c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.024474:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae900c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.024495:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289700) 00010000:00010000:0.0:1763343041.024499:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343041.024505:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae900c lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.024511:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae900c lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.024533:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae90a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343041.024539:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae90a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343041.024549:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae90a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343041.024554:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343041.024557:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae90a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343041.024563:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae90a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343041.024569:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289700) 00010000:00010000:0.0:1763343041.024571:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343041.024574:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae90a6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343041.024580:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae90a6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343041.024601:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9139 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.024606:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9139 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.024611:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9139 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.024615:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343041.024617:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9139 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.024662:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9139 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.024671:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:0.0:1763343041.024673:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343041.024677:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9139 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.024683:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9139 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000100:00100000:0.0:1763343041.024717:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010320128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343041.024809:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343041.024866:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343041.024874:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010319744:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343041.024896:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763343041.025028:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1012 committed 00000100:00100000:3.0:1763343041.025140:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010320256:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343041.025174:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343041.025196:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343041.025201:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010320640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343041.025221:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343041.025246:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010320000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343041.025272:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343041.025291:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010320512:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343041.025310:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343041.025326:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1763343041.025331:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010319872:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763343041.025352:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343041.025368:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010320384:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343041.025392:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343041.025429:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010320128 00000100:00100000:3.0:1763343041.025438:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010320128 00000100:00100000:3.0:1763343041.025509:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010319744 00000100:00100000:3.0:1763343041.025513:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010319744 00000100:00100000:3.0:1763343041.025530:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010320256 00000100:00100000:3.0:1763343041.025532:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010320256 00000100:00100000:3.0:1763343041.025552:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010320640 00000100:00100000:3.0:1763343041.025555:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010320640 00000100:00100000:3.0:1763343041.025575:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010320000 00000100:00100000:3.0:1763343041.025577:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010320000 00000100:00100000:3.0:1763343041.025587:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010320512 00000100:00100000:3.0:1763343041.025589:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010320512 00000100:00100000:3.0:1763343041.025597:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010319872 00000100:00100000:3.0:1763343041.025599:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010319872 00000100:00100000:3.0:1763343041.025607:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010320384 00000100:00100000:3.0:1763343041.025609:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010320384 00000100:00100000:3.0:1763343041.025650:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6877 00000100:00100000:3.0:1763343041.025660:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3659:x1848998010320128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343041.025918:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010320128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 260us (1109us total) trans 21474839048 rc 0/0 00000100:00100000:3.0:1763343041.025926:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6877 00000100:00100000:3.0:1763343041.025945:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6878 00000100:00100000:3.0:1763343041.025951:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3659:x1848998010319744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343041.025967:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:717 count 1 00010000:00010000:3.0:1763343041.025989:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae9171 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.026012:0:28648:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8ffe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fc9 expref: 13 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.026022:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343041.026025:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343041.026029:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae9171 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.026063:0:28648:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8ffe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fc9 expref: 13 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.026081:0:28648:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8ffe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fc9 expref: 13 pid: 28994 timeout: 1334 lvb_type: 0 00000100:00100000:3.0:1763343041.026094:0:28648:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010320768:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343041.026172:0:28648:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c840 going to sleep for 11 seconds 00000100:00100000:3.0:1763343041.026196:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6879 00000100:00100000:3.0:1763343041.026204:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3660:x1848998010320256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343041.026221:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:719 count 1 00010000:00010000:3.0:1763343041.026239:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae9178 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.026252:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae8fd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fbb expref: 20 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.026259:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343041.026260:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343041.026263:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae9178 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.026285:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae8fd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fbb expref: 20 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.026299:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae8fd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fbb expref: 20 pid: 28996 timeout: 1334 lvb_type: 0 00000100:00100000:3.0:1763343041.026310:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340a65b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010320896:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343041.026335:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343041.026355:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6880 00000100:00100000:3.0:1763343041.026361:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3660:x1848998010320640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343041.026483:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3660:x1848998010320640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (1259us total) trans 17179871752 rc 0/0 00000100:00100000:3.0:1763343041.026491:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6880 00000100:00100000:3.0:1763343041.026507:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6881 00000100:00100000:3.0:1763343041.026512:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3658:x1848998010320000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763343041.026574:0:27833:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2cf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343041.026578:0:27833:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2cf:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343041.026581:0:27833:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2cf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343041.026583:0:27833:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2cf:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343041.026585:0:27833:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2cf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343041.026616:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010320000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (1343us total) trans 21474839049 rc 0/0 00000100:00100000:3.0:1763343041.026652:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6881 00000100:00100000:3.0:1763343041.026665:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6882 00000100:00100000:3.0:1763343041.026671:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3658:x1848998010320512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343041.026741:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3658:x1848998010320512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1430us total) trans 17179871753 rc 0/0 00000100:00100000:3.0:1763343041.026747:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6882 00000100:00100000:3.0:1763343041.026759:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6883 00000100:00100000:3.0:1763343041.026765:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3658:x1848998010319872:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763343041.026777:0:27833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:718 count 1 00002000:00010000:3.0:1763343041.026797:0:27833:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343041.026803:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6000/0x607405d401ae917f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.026810:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343041.026812:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343041.026828:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6000/0x607405d401ae917f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.026842:0:27833:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6000/0x607405d401ae917f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.026852:0:27833:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6000/0x607405d401ae917f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.026859:0:27833:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6000/0x607405d401ae917f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.026879:0:27833:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343041.027056:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3658:x1848998010319872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 290us (1702us total) trans 21474839050 rc 0/0 00000100:00100000:3.0:1763343041.027062:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6883 00000100:00100000:3.0:1763343041.027075:0:27833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6884 00000100:00100000:3.0:1763343041.027082:0:27833:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e9c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3658:x1848998010320384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343041.027095:0:27833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:720 count 1 00002000:00010000:3.0:1763343041.027110:0:27833:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343041.027115:0:27833:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae9186 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.027122:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343041.027123:0:27833:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343041.027126:0:27833:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae9186 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.027135:0:27833:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae9186 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.027141:0:27833:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae9186 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.027148:0:27833:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae9186 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.027163:0:27833:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343041.027275:0:27833:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e9c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3658:x1848998010320384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 192us (1880us total) trans 17179871754 rc 0/0 00000100:00100000:3.0:1763343041.027281:0:27833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6884 00000100:00080000:3.0:1763343041.027312:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1763343041.027318:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1763343041.027385:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7e680/2, rc 0, transno 17179871752 00000100:00100000:3.0:1763343041.027391:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010320640:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343041.027421:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c2c6d80/2, rc 0, transno 21474839050 00000100:00100000:3.0:1763343041.027427:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010319872:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763343041.027435:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7df80/2, rc 0, transno 17179871754 00000100:00100000:3.0:1763343041.027439:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010320384:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763343041.027448:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c2c4a80/2, rc 0, transno 21474839049 00000100:00100000:3.0:1763343041.027451:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010320000:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763343041.027459:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7ea00/2, rc 0, transno 17179871753 00000100:00100000:3.0:1763343041.027462:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010320512:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763343041.027481:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343041.027488:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6000/0x607405d401ae917f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.027497:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343041.027501:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6000/0x607405d401ae917f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.027510:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6000/0x607405d401ae917f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.027528:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6000/0x607405d401ae917f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.027535:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6000/0x607405d401ae917f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.027553:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343041.027557:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae9186 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.027563:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343041.027566:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae9186 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.027573:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae9186 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.027583:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae9186 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.027589:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6600/0x607405d401ae9186 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27833 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.027600:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343041.027602:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343041.027603:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343041.027610:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343041.028038:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1013 committed 00010000:00010000:1.0:1763343041.028173:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f000/0x607405d401ae916a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x202:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca039 expref: 264 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.028188:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:1.0:1763343041.028191:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343041.028209:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f400/0x607405d401ae9163 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x202:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca039 expref: 264 pid: 10042 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343041.028228:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f000/0x607405d401ae916a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x202:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca039 expref: 263 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.028263:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:1.0:1763343041.028266:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343041.028269:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340683f000, rc 0) 00000100:00100000:1.0:1763343041.028331:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:55941:x1848997993721344:12345-192.168.204.21@tcp:101:bash.0 Request processed in 15945us (16748us total) trans 8589940343 rc 0/0 00000100:00100000:1.0:1763343041.028342:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9726 00000004:00080000:0.0:1763343041.028560:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c2c7100/2, rc 0, transno 21474839048 00000100:00100000:0.0:1763343041.028567:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010320128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763343041.036929:0:28648:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:28648:1848998010320768:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343041.036984:0:28648:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae9171 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343041.038201:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340a65b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15756:1848998010320896:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343041.038226:0:15756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae9178 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343041.038332:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.038332:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.038366:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.038431:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.038487:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993721856 00000100:00100000:2.0:1763343041.038498:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993721856 00010000:00010000:2.0:1763343041.038576:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8ffe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fc9 expref: 14 pid: 28994 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343041.038611:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993721728 00000100:00100000:2.0:1763343041.038614:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993721728 00010000:00010000:2.0:1763343041.038655:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae8fd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fbb expref: 21 pid: 28996 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343041.038684:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3212 00000100:00100000:2.0:1763343041.038695:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2432:x1848997993721856:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343041.038714:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343041.038721:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8ffe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fc9 expref: 14 pid: 28994 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343041.038734:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8ffe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fc9 expref: 14 pid: 28994 timeout: 1334 lvb_type: 0 00000100:00100000:3.0:1763343041.038755:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993721984 00000100:00100000:3.0:1763343041.038759:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993721984 00010000:00010000:2.0:1763343041.038763:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3537b6d200/0x607405d401ae8ffe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fc9 expref: 15 pid: 28994 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343041.038782:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.038784:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1763343041.038789:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6885 00010000:00010000:2.0:1763343041.038791:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae9171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343041.038796:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:55941:x1848997993721984:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343041.038802:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae9171 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.038826:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343041.038843:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca040 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.038846:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343041.038866:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9108 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca016 expref: 15 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343041.038872:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343041.038874:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343041.038877:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 15 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343041.038902:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2432:x1848997993721856:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 210us (570us total) trans 0 rc 0/0 00010000:00010000:3.0:1763343041.038909:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9108 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca016 expref: 15 pid: 28996 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1763343041.038910:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3212 00010000:00010000:3.0:1763343041.038921:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9108 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca016 expref: 15 pid: 28996 timeout: 1334 lvb_type: 1 00000100:00100000:2.0:1763343041.038929:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3213 00000100:00100000:2.0:1763343041.038935:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993721728:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1763343041.038936:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340a659180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010321024:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343041.038944:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343041.038949:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae8fd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fbb expref: 21 pid: 28996 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343041.038958:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae8fd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fbb expref: 21 pid: 28996 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343041.038972:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d400/0x607405d401ae8fd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffac9fbb expref: 21 pid: 28996 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343041.038983:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.038985:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.038988:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae9178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.038995:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae9178 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343041.038998:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1ba80 going to sleep for 11 seconds 00010000:00010000:2.0:1763343041.039010:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343041.039028:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993721728:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 93us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.039036:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3213 00010000:00010000:2.0:1763343041.039072:0:28648:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae9171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.039081:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae9171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.039091:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae9171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.039101:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae9171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.039125:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343041.039151:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343041.039159:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae9171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.039167:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343041.039171:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae9171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.039185:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae9171 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.039197:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae9171 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.039203:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7200/0x607405d401ae9171 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.039221:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343041.039223:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343041.039225:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343041.039378:0:15756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae9178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.039387:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae9178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.039395:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae9178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.039402:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae9178 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.039418:0:15756:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343041.039438:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010319744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13486us (14540us total) trans 21474839051 rc 0/0 00000100:00100000:2.0:1763343041.039446:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6878 00000100:00080000:1.0:1763343041.039547:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1763343041.039552:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1763343041.039745:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993722240 00000100:00100000:1.0:1763343041.039751:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993722240 00000100:00100000:1.0:1763343041.039787:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9727 00000100:00100000:1.0:1763343041.039795:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:56954:x1848997993722240:12345-192.168.204.21@tcp:101:lfs.0 00000004:00080000:3.0:1763343041.039947:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c2c6300/2, rc 0, transno 21474839051 00000100:00100000:3.0:1763343041.039954:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010319744:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343041.040124:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3660:x1848998010320256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13919us (14947us total) trans 17179871755 rc 0/0 00000100:00100000:0.0:1763343041.040132:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6879 00010000:00010000:1.0:1763343041.040221:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.040246:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ea00/0x607405d401ae9194 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca047 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.040335:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343041.040341:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae9178 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.040348:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343041.040352:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae9178 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.040359:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae9178 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.040365:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f600/0x607405d401ae919b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.040374:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae9178 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.040378:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f600/0x607405d401ae919b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.040382:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6800/0x607405d401ae9178 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.040387:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f600/0x607405d401ae919b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.040396:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343041.040398:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343041.040400:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae91a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.040400:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343041.040406:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae91a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.040413:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae91a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.040545:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae91a9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.040555:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae91a9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.040562:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae91a9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343041.040572:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x202:0x0]: returning size 2 00010000:00010000:1.0:1763343041.040698:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f600/0x607405d401ae919b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.040705:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f600/0x607405d401ae919b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.040715:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f600/0x607405d401ae919b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.040721:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f600/0x607405d401ae919b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00000004:00080000:3.0:1763343041.040900:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3405b7c700/2, rc 0, transno 17179871755 00000100:00100000:3.0:1763343041.040907:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010320256:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763343041.041695:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340683f600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343041.041701:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f600/0x607405d401ae919b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.041708:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f600/0x607405d401ae919b lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.041723:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289500) 00010000:00010000:1.0:1763343041.041727:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343041.041732:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f600/0x607405d401ae919b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.041739:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f600/0x607405d401ae919b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.041755:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae91a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.041761:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae91a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.041767:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae91a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.041772:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343041.041775:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae91a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.041784:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae91a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.041791:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289e00) 00010000:00010000:1.0:1763343041.041793:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343041.041795:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae91a2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.041801:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae91a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.041875:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683ea00/0x607405d401ae9194 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca047 expref: 266 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.041894:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae91a9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca047 expref: 265 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.041902:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:1.0:1763343041.041904:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343041.041907:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34068ab800, rc 0) 00000100:00100000:1.0:1763343041.041994:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56954:x1848997993722240:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2199us (3663us total) trans 8589940344 rc 0/0 00000100:00100000:1.0:1763343041.042003:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9727 00000100:00100000:3.0:1763343041.044893:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340a659180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010321024:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343041.044942:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 14 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.044967:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a5fe00, rc 0) 00000100:00100000:0.0:1763343041.046454:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:55941:x1848997993721984:12345-192.168.204.21@tcp:101:bash.0 Request processed in 7645us (8009us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343041.046469:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6885 00000100:00100000:1.0:1763343041.046585:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.047842:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993722368 00000100:00100000:0.0:1763343041.047856:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993722368 00010000:00010000:0.0:1763343041.047912:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9108 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca016 expref: 14 pid: 28996 timeout: 1334 lvb_type: 1 00000100:00100000:0.0:1763343041.047960:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3214 00000100:00100000:0.0:1763343041.047971:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993722368:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343041.047992:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343041.047998:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9108 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca016 expref: 14 pid: 28996 timeout: 1334 lvb_type: 1 00010000:00010000:0.0:1763343041.048012:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9108 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca016 expref: 14 pid: 28996 timeout: 1334 lvb_type: 1 00010000:00010000:0.0:1763343041.048043:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9108 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca016 expref: 14 pid: 28996 timeout: 1334 lvb_type: 1 00010000:00010000:0.0:1763343041.048061:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.048063:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.048073:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 13 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.048085:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 13 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.048143:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 13 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343041.048159:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340683a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1848998010321152:192.168.204.21@tcp:105: 00000100:00100000:0.0:1763343041.048262:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343041.053861:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.053967:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.054103:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993722496 00000100:00100000:0.0:1763343041.054118:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993722496 00000100:00100000:0.0:1763343041.054178:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993722624 00000100:00100000:0.0:1763343041.054181:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993722624 00000100:00100000:0.0:1763343041.054211:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6886 00000100:00100000:0.0:1763343041.054222:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993722496:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343041.054249:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343041.054290:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae91b7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca04e expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343041.054364:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340683b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010321280:192.168.204.21@tcp:106: 00000100:00100000:0.0:1763343041.054469:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31780 going to sleep for 11 seconds 00000100:00100000:0.0:1763343041.054495:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6887 00000100:00100000:0.0:1763343041.054503:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:55941:x1848997993722624:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343041.054513:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343041.054530:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd200/0x607405d401ae91be lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca055 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343041.054556:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343041.054571:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.054574:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.054584:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd200/0x607405d401ae91be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca055 expref: 21 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.054600:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd200/0x607405d401ae91be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca055 expref: 21 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.054613:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd200, rc 0) 00000100:00100000:0.0:1763343041.054665:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:55941:x1848997993722624:12345-192.168.204.21@tcp:101:bash.0 Request processed in 162us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343041.054673:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6887 00000100:00100000:2.0:1763343041.054842:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340683a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1848998010321152:192.168.204.21@tcp:105: 00010000:00010000:2.0:1763343041.054869:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343041.054895:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993722368:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 6927us (8311us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.054904:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3214 00000100:00100000:3.0:1763343041.057388:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.057436:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.057655:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993722752 00000100:00100000:2.0:1763343041.057667:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993722752 00002000:00010000:2.0:1763343041.057716:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/719 (0->18446744073709551615) 00002000:00100000:2.0:1763343041.057722:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340a659180 with x1848997993722752 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343041.057738:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340a659180. 00000100:00100000:2.0:1763343041.057774:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993722880 00000100:00100000:2.0:1763343041.057777:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993722880 00002000:00010000:2.0:1763343041.057791:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/721 (0->18446744073709551615) 00002000:00100000:2.0:1763343041.057793:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340a658e00 with x1848997993722880 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343041.057800:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340a658e00. 00000100:00100000:2.0:1763343041.057835:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1666 00000100:00100000:2.0:1763343041.057847:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993722752:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:1.0:1763343041.058022:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1667 00000100:00100000:1.0:1763343041.058033:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993722880:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343041.058093:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2cf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343041.058097:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2cf:0x0] updating lvb mtime from disk: 0 -> 1763343040 00002000:00010000:2.0:1763343041.058099:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2cf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343041.058102:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2cf:0x0] updating lvb ctime from disk: 0 -> 1763343040 00002000:00010000:2.0:1763343041.058104:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2cf:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1763343041.058157:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2d1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343041.058160:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2d1:0x0] updating lvb mtime from disk: 0 -> 1763343040 00002000:00010000:1.0:1763343041.058162:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2d1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343041.058164:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2d1:0x0] updating lvb ctime from disk: 0 -> 1763343040 00002000:00010000:1.0:1763343041.058166:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2d1:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343041.058175:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993722752:12345-192.168.204.21@tcp:10:bash.0 Request processed in 330us (804us total) trans 21474839052 rc 0/0 00000100:00100000:2.0:1763343041.058184:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1666 00000100:00100000:1.0:1763343041.058187:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993722880:12345-192.168.204.21@tcp:10:bash.0 Request processed in 157us (751us total) trans 17179871756 rc 0/0 00002000:00010000:2.0:1763343041.058188:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/719 (0->18446744073709551615) 00002000:00100000:2.0:1763343041.058191:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340a659180 with x1848997993722752 ext(0->18446744073709551615) 00000100:00100000:1.0:1763343041.058193:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1667 00002000:00010000:1.0:1763343041.058195:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/721 (0->18446744073709551615) 00002000:00010000:2.0:1763343041.058196:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340a659180. 00002000:00100000:1.0:1763343041.058198:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340a658e00 with x1848997993722880 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343041.058201:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340a658e00. 00002000:00010000:0.0:1763343041.058467:0:28994:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x2cf:0x0] updating lvb atime: 0 -> 1763343040 00000100:00100000:0.0:1763343041.058480:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340683b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010321280:192.168.204.21@tcp:106: 00010000:00010000:0.0:1763343041.058522:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae91b7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca04e expref: 15 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343041.058547:0:28994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae91b7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca04e expref: 15 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343041.058562:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd800, rc 0) 00000100:00100000:0.0:1763343041.058604:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993722496:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4383us (4759us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343041.058615:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6886 00000100:00100000:3.0:1763343041.064402:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.064456:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.064598:0:6526:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993723136 00000100:00100000:2.0:1763343041.064612:0:6526:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993723136 00000100:00100000:1.0:1763343041.064731:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993723392 00000100:00100000:1.0:1763343041.064737:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993723392 00000100:00100000:1.0:1763343041.064808:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3324 00000100:00100000:1.0:1763343041.064829:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:55941:x1848997993723392:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:1.0:1763343041.065249:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:55941:x1848997993723392:12345-192.168.204.21@tcp:35:bash.0 Request processed in 421us (790us total) trans 8589940345 rc 0/0 00000100:00100000:1.0:1763343041.065259:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3324 00000100:00100000:2.0:1763343041.065383:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3325 00000100:00100000:2.0:1763343041.065391:0:6526:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56954:x1848997993723136:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343041.065481:0:6526:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56954:x1848997993723136:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 91us (1095us total) trans 8589940346 rc 0/0 00000100:00100000:2.0:1763343041.065489:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3325 00000100:00100000:3.0:1763343041.071594:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.073326:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993723648 00000100:00100000:2.0:1763343041.073348:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993723648 00000100:00100000:2.0:1763343041.073708:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9728 00000100:00100000:2.0:1763343041.073719:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56954:x1848997993723648:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.073754:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.073780:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae91c5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca05c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.073931:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 3/0,1 mode: --/CW res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.073949:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae91a9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca047 expref: 268 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.073960:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 4/0,1 mode: --/CW res: [0x200000405:0x202:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.074004:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae91a9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca047 expref: 268 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.074021:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae91a9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca047 expref: 268 pid: 10042 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343041.074039:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010321408:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343041.074150:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509fc23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343041.079782:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.079831:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.079913:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993723776 00000100:00100000:3.0:1763343041.079926:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993723776 00010000:00010000:3.0:1763343041.079980:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae91a9 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca047 expref: 269 pid: 10042 timeout: 1334 lvb_type: 0 00000100:00100000:3.0:1763343041.080032:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3215 00000100:00100000:3.0:1763343041.080043:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:2429:x1848997993723776:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343041.080061:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343041.080069:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae91a9 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca047 expref: 269 pid: 10042 timeout: 1334 lvb_type: 0 00010000:00010000:3.0:1763343041.080083:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae91a9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca047 expref: 269 pid: 10042 timeout: 1334 lvb_type: 0 00010000:00010000:3.0:1763343041.080113:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:3.0:1763343041.080119:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 3/0,1 mode: --/CW res: [0x200000405:0x202:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343041.080131:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x202:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343041.080139:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x202:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343041.080160:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343041.080228:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:2429:x1848997993723776:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 186us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343041.080236:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3215 00000100:00100000:1.0:1763343041.080881:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993723904 00000100:00100000:1.0:1763343041.080888:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993723904 00000100:00100000:1.0:1763343041.080931:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9729 00000100:00100000:1.0:1763343041.080939:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56955:x1848997993723904:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:1.0:1763343041.080967:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.080994:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae91d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca063 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.081084:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae91da lrc: 3/1,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.081096:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x202:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.081104:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae91da lrc: 4/1,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.081122:0:10042:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x202:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.081131:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae91da lrc: 3/1,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.081794:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae91a9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca047 expref: 270 pid: 10042 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343041.081826:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010321408:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343041.081855:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x202:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.081863:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x202:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.081869:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x202:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343041.081892:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x202:0x0]: returning size 5 00010000:00010000:2.0:1763343041.082060:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae91c5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x202:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca05c expref: 271 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.082082:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x202:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca05c expref: 270 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343041.082091:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x202:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca05c expref: 270 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343041.082097:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352da00, rc 0) 00000100:00100000:2.0:1763343041.082170:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56954:x1848997993723648:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8452us (10593us total) trans 8589940347 rc 0/0 00000100:00100000:2.0:1763343041.082178:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9728 00000100:00100000:3.0:1763343041.087027:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.087076:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.087232:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993724032 00000100:00100000:1.0:1763343041.087247:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993724032 00010000:00010000:1.0:1763343041.087388:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x202:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca05c expref: 270 pid: 6525 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343041.087440:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3216 00000100:00100000:1.0:1763343041.087451:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35084c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:2429:x1848997993724032:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343041.087471:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343041.087478:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x202:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca05c expref: 270 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343041.087492:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x202:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca05c expref: 270 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343041.087519:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae91cc lrc: 0/0,0 mode: --/CW res: [0x200000405:0x202:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca05c expref: 270 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343041.087540:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:1.0:1763343041.087546:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae91da lrc: 3/1,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.087558:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae91da lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.087566:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae91da lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.087594:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343041.087677:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35084c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:2429:x1848997993724032:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 227us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.087684:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3216 00010000:00010000:1.0:1763343041.087755:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae91da lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.087764:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae91da lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343041.087840:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x202:0x0]: returning size 5 00000004:00200000:1.0:1763343041.087845:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343041.087870:0:10042:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae91da lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.087882:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae91da lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.087912:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068aa000/0x607405d401ae91d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca063 expref: 269 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.087941:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae91da lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca063 expref: 268 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.087949:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:1.0:1763343041.087952:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343041.087954:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34068abc00, rc 0) 00000100:00100000:1.0:1763343041.087986:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56955:x1848997993723904:12345-192.168.204.21@tcp:101:rm.0 Request processed in 7048us (8153us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.088003:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9729 00000100:00100000:1.0:1763343041.088021:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993724160 00000100:00100000:1.0:1763343041.088026:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993724160 00000100:00100000:1.0:1763343041.088055:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9730 00000100:00100000:1.0:1763343041.088061:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56954:x1848997993724160:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343041.088082:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.088101:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae91e8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca06a expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.088177:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae91ef lrc: 3/1,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.088189:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae91ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.088198:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae91ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343041.088212:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x202:0x0]: returning size 5 00000004:00200000:1.0:1763343041.088214:0:10041:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343041.088224:0:10041:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae91ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.088239:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae91e8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca06a expref: 270 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.088251:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae91ef lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca06a expref: 269 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.088258:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:1.0:1763343041.088261:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343041.088274:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35379c0600, rc 0) 00000100:00100000:1.0:1763343041.088293:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56954:x1848997993724160:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 233us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.088299:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9730 00000100:00100000:3.0:1763343041.094161:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.095651:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993724416 00000100:00100000:2.0:1763343041.095672:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993724416 00000100:00100000:3.0:1763343041.095808:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9731 00000100:00100000:3.0:1763343041.095831:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56954:x1848997993724416:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343041.095865:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343041.095898:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae91f6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca071 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343041.095908:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.095968:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.096065:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993724672 00000100:00100000:2.0:1763343041.096070:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993724672 00010000:00010000:3.0:1763343041.096092:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae91fd lrc: 3/0,1 mode: --/PW res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00000100:00100000:2.0:1763343041.096099:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9732 00000100:00100000:2.0:1763343041.096105:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56955:x1848997993724672:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:3.0:1763343041.096112:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae91fd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x202:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.096113:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343041.096126:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae91fd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x202:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.096128:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9204 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca078 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1763343041.096141:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x202:0x0]: returning size 5 00010000:00010000:2.0:1763343041.096173:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9212 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096180:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9212 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096188:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9212 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096198:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9219 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096204:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9219 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096208:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9219 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096299:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9220 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096308:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9220 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096315:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9220 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343041.096343:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x202:0x0]: returning size 5 00000004:00200000:2.0:1763343041.096348:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343041.096365:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9220 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096375:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9220 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096386:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9212 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096399:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9212 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096406:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9212 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096412:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9212 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096418:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.096422:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9212 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096430:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9212 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343041.096435:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae91f6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x202:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca071 expref: 274 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.096442:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343041.096445:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.096451:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9212 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343041.096455:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae91fd lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x202:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca071 expref: 273 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.096457:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9212 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343041.096463:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:3.0:1763343041.096466:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763343041.096468:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7200, rc 0) 00010000:00010000:2.0:1763343041.096469:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9219 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096474:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9219 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096479:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9219 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096484:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.096486:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9219 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096492:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9219 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096498:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bcd00) 00010000:00010000:2.0:1763343041.096500:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.096503:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9219 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096507:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9219 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.096534:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9204 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca078 expref: 274 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.096548:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9220 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca078 expref: 273 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.096555:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:2.0:1763343041.096558:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343041.096560:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c800, rc 0) 00000100:00100000:1.0:1763343041.096597:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993724544 00000100:00100000:1.0:1763343041.096601:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993724544 00000100:00100000:1.0:1763343041.096649:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 412 00000100:00100000:1.0:1763343041.096656:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:2431:x1848997993724544:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343041.096666:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343041.096679:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae91da lrc: 0/0,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca063 expref: 274 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.096690:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:1.0:1763343041.096693:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343041.096912:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56954:x1848997993724416:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1084us (2765us total) trans 8589940348 rc 0/0 00000100:00100000:3.0:1763343041.096921:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9731 00000100:00100000:1.0:1763343041.096984:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:2431:x1848997993724544:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 328us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.097320:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 412 00000100:00100000:2.0:1763343041.097432:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56955:x1848997993724672:12345-192.168.204.21@tcp:101:rm.0 Request processed in 1325us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.097439:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9732 00000100:00100000:0.0:1763343041.100342:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.100399:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.100526:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993724928 00000100:00100000:2.0:1763343041.100540:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993724928 00000100:00100000:2.0:1763343041.100616:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6888 00000100:00100000:1.0:1763343041.100654:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993724800 00000100:00100000:2.0:1763343041.100659:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993724928:12345-192.168.204.21@tcp:1:lfs.0 00000100:00100000:1.0:1763343041.100659:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993724800 00000100:00100000:1.0:1763343041.100700:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 413 00000100:00100000:1.0:1763343041.100707:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:2432:x1848997993724800:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343041.100721:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343041.100725:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae9227 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.100749:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 14 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.100754:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9220 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca078 expref: 271 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.100758:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343041.100761:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343041.100765:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae9227 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.100773:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:1.0:1763343041.100779:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343041.100808:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 14 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.100836:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 14 pid: 28994 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343041.100853:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010321536:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343041.100859:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:2432:x1848997993724800:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 152us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.100866:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 413 00000100:00100000:2.0:1763343041.100917:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509fc29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343041.102691:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.103936:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993725184 00000100:00100000:2.0:1763343041.103953:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993725184 00000100:00100000:2.0:1763343041.104030:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9733 00000100:00100000:2.0:1763343041.104041:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56955:x1848997993725184:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:2.0:1763343041.104115:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1763343041.104149:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae91fd lrc: 0/0,0 mode: --/PW res: [0x200000405:0x202:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca071 expref: 270 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.104174:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340683f000/0x607405d401ae916a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x202:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca039 expref: 269 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.104188:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae91ef lrc: 0/0,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca06a expref: 268 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.104200:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9132 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x202:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca02b expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.104212:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34039e4100) 00010000:00010000:2.0:1763343041.104225:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343041.104255:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae922e lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.104270:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae922e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.104282:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae922e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.104293:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9235 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.104301:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9235 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.104307:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9235 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.104416:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae923c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.104796:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae923c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.104808:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae923c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00080000:2.0:1763343041.105190:0:6525:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x202:0x0] is inserted into orphan list, open count = 2 00010000:00010000:2.0:1763343041.105325:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae923c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105335:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae923c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105343:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae923c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105350:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.105355:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae923c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105363:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae923c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105376:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a34037bc800) 00010000:00010000:2.0:1763343041.105379:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343041.105384:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae923c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105391:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae923c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105413:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae922e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105428:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae922e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105435:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae922e lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105440:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae922e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105445:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.105447:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae922e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105453:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae922e lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105461:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343041.105463:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.105467:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae922e lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105473:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae922e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:2.0:1763343041.105485:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008baa64e4 reply state 000000007589e5cd transno 8589940349 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9235 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105496:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9235 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.105503:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bcd00) 00010000:00010000:2.0:1763343041.105505:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343041.105509:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343041.105664:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56955:x1848997993725184:12345-192.168.204.21@tcp:36:rm.0 Request processed in 1619us (2982us total) trans 8589940349 rc 0/0 00000100:00100000:2.0:1763343041.105674:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9733 00000100:00100000:1.0:1763343041.106559:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.106806:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993725312 00000100:00100000:3.0:1763343041.106831:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993725312 00002000:00100000:3.0:1763343041.106893:0:24021:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x2cf:0x0] (0->4) req@ffff9a340478d880 x1848997993725312/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:537/0 lens 496/0 e 0 to 0 dl 1763343052 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343041.106905:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478d880 with x1848997993725312 ext(0->4) 00010000:00010000:3.0:1763343041.106915:0:24021:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 15 pid: 28994 timeout: 1334 lvb_type: 0 00010000:00010000:3.0:1763343041.106931:0:24021:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 15 pid: 28994 timeout: 1334 lvb_type: 0 00002000:00010000:3.0:1763343041.106938:0:24021:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a340478d880 00000100:00100000:3.0:1763343041.106979:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 113 00000100:00100000:3.0:1763343041.107000:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993725312:12345-192.168.204.21@tcp:4:bash.0 00000100:00100000:2.0:1763343041.107801:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010321536:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343041.107846:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae9227 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343041.108542:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993725312:12345-192.168.204.21@tcp:4:bash.0 Request processed in 1550us (1984us total) trans 21474839053 rc 0/0 00000100:00100000:3.0:1763343041.108555:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 113 00002000:00100000:3.0:1763343041.108567:0:24021:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x2cf:0x0] (0->4) req@ffff9a340478d880 x1848997993725312/t21474839053(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:537/0 lens 496/448 e 0 to 0 dl 1763343052 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343041.108576:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478d880 with x1848997993725312 ext(0->4) 00010000:00010000:3.0:1763343041.108583:0:24021:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 17 pid: 28994 timeout: 1334 lvb_type: 0 00010000:00010000:3.0:1763343041.108598:0:24021:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 17 pid: 28994 timeout: 1334 lvb_type: 0 00002000:00010000:3.0:1763343041.108610:0:24021:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a340478d880 00000100:00100000:0.0:1763343041.112470:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.112581:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993725440 00000100:00100000:1.0:1763343041.112596:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993725440 00010000:00010000:1.0:1763343041.112701:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 17 pid: 28994 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343041.112756:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3217 00000100:00100000:1.0:1763343041.112768:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2432:x1848997993725440:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343041.112789:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763343041.112825:0:27834:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2cf:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1763343041.112829:0:27834:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2cf:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1763343041.112840:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 17 pid: 28994 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343041.112855:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 17 pid: 28994 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343041.112884:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3403a5fe00/0x607405d401ae918d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca040 expref: 17 pid: 28994 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343041.112905:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.112907:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.112913:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae9227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.112925:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae9227 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.112965:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343041.113034:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993725440:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 268us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.113042:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3217 00010000:00010000:2.0:1763343041.114136:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae9227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.114155:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae9227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.114186:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae9227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.114194:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae9227 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.114202:0:28994:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae9227 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.114211:0:28994:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343041.114216:0:28994:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae9227 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.114225:0:28994:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae9227 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.114244:0:28994:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae9227 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.114253:0:28994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352d400/0x607405d401ae9227 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343041.114384:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993724928:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 13724us (13980us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.114392:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6888 00000100:00100000:0.0:1763343041.119418:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.119540:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.119860:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993725568 00000100:00100000:3.0:1763343041.119876:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993725568 00000100:00100000:3.0:1763343041.119946:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993725824 00000100:00100000:3.0:1763343041.119950:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993725824 00000100:00100000:3.0:1763343041.119991:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9734 00000100:00100000:3.0:1763343041.120003:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56956:x1848997993725568:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343041.120034:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343041.120066:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9243 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca07f expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.120159:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae924a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120176:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae924a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120189:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae924a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120203:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9251 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120212:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9251 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120218:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9251 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120289:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae924a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120297:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae924a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120304:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae924a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120310:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae924a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120316:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343041.120321:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae924a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120330:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae924a lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120344:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616200) 00010000:00010000:3.0:1763343041.120347:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.120353:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae924a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120359:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae924a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120376:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9251 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120383:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9251 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120388:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9251 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120394:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343041.120397:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9251 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120403:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9251 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120410:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bcd00) 00010000:00010000:3.0:1763343041.120413:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.120416:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9251 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120421:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9251 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.120452:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9243 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca07f expref: 270 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.120463:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616200) 00010000:00010000:3.0:1763343041.120465:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.120468:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9243 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca07f expref: 270 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343041.120475:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9735 00010000:00010000:3.0:1763343041.120482:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6600, rc 0) 00000100:00100000:2.0:1763343041.120486:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56954:x1848997993725824:12345-192.168.204.21@tcp:36:lfs.0 00000100:00100000:2.0:1763343041.120758:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56954:x1848997993725824:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 273us (1215us total) trans 0 rc -116/-116 00000100:00100000:2.0:1763343041.120767:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9735 00000100:00100000:3.0:1763343041.121076:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56956:x1848997993725568:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1074us (1673us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343041.121083:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9734 00000100:00100000:1.0:1763343041.123056:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.123154:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.123201:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993726208 00000100:00100000:3.0:1763343041.123214:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993726208 00000100:00100000:3.0:1763343041.123365:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3326 00000100:00100000:3.0:1763343041.123375:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56954:x1848997993726208:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343041.123522:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993726080 00000100:00100000:2.0:1763343041.123527:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993726080 00000100:00100000:2.0:1763343041.123904:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9736 00000100:00100000:2.0:1763343041.123913:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56956:x1848997993726080:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.123923:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.123950:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9258 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca086 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.124017:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae925f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124033:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae925f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124046:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae925f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124057:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9266 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124068:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9266 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124077:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9266 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124184:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae925f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124192:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae925f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124198:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae925f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124203:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae925f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124208:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.124213:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae925f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124220:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae925f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124233:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343041.124236:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.124241:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae925f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124247:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae925f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124259:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9266 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124264:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9266 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124270:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9266 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124275:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.124277:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9266 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124283:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9266 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124289:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bcd00) 00010000:00010000:2.0:1763343041.124292:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.124295:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9266 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124301:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9266 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.124325:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9258 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca086 expref: 271 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.124337:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343041.124340:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.124344:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9258 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca086 expref: 271 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.124357:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352de00, rc 0) 00000100:00100000:2.0:1763343041.124728:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56956:x1848997993726080:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 814us (1571us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343041.124737:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9736 00000100:00100000:0.0:1763343041.124788:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56954:x1848997993726208:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1413us (1743us total) trans 8589940350 rc 0/0 00000100:00100000:0.0:1763343041.124798:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3326 00000100:00100000:0.0:1763343041.130498:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.130563:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.130672:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993726464 00000100:00100000:1.0:1763343041.130686:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993726464 00000100:00100000:1.0:1763343041.130859:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3327 00000100:00100000:1.0:1763343041.130872:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56954:x1848997993726464:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:1.0:1763343041.131189:0:14879:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x202:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1763343041.131219:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993726592 00000100:00100000:2.0:1763343041.131225:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993726592 00000100:00100000:2.0:1763343041.131278:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9737 00000100:00100000:2.0:1763343041.131287:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56956:x1848997993726592:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.131302:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.131332:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae926d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca08d expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1763343041.131375:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1540, 64 off129480 00000040:00080000:1.0:1763343041.131405:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1541, 64 off129480 00000040:00080000:1.0:1763343041.131414:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1542, 64 off129544 00000040:00080000:1.0:1763343041.131423:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1541, 64 off129544 00010000:00010000:2.0:1763343041.131425:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9274 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.131442:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9274 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.131454:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9274 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.131482:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae927b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x202:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00000004:00200000:2.0:1763343041.131484:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343041.131490:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343041.131491:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae927b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x202:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343041.131498:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae927b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x202:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343041.131505:0:14879:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae927b lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x202:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343041.131511:0:14879:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae927b lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x202:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343041.131516:0:14879:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae927b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x202:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343041.131529:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae926d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca08d expref: 273 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.131551:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9274 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca08d expref: 272 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.131562:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343041.131565:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343041.131570:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352dc00, rc 0) 00000100:00100000:2.0:1763343041.131699:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56956:x1848997993726592:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 414us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.131707:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9737 00010000:00010000:1.0:1763343041.132084:0:14879:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343041.132297:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56954:x1848997993726464:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1427us (1814us total) trans 8589940351 rc 0/0 00000100:00100000:1.0:1763343041.132306:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3327 00010000:00010000:0.0:1763343041.132580:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343041.132589:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae927b lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x202:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343041.132597:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d8600 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343041.132602:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae927b lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x202:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343041.132610:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae927b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x202:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343041.132644:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x202:0x0].0x0 (ffff9a3510289500) 00010000:00010000:0.0:1763343041.132647:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763343041.132652:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae927b lrc: 1/0,0 mode: --/PW res: [0x200000405:0x202:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343041.132658:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae927b lrc: 0/0,0 mode: --/PW res: [0x200000405:0x202:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:0.0:1763343041.132675:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343041.132677:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343041.132679:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343041.140175:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.140243:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993726720 00000100:00100000:3.0:1763343041.140257:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993726720 00000100:00100000:3.0:1763343041.140331:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9738 00000100:00100000:3.0:1763343041.140343:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56956:x1848997993726720:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343041.140375:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343041.140405:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9282 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca094 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.140494:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9289 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140511:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9289 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140523:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9289 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140532:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9290 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140540:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9290 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140546:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9290 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140592:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9289 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140599:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9289 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140606:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9289 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140614:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9289 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140647:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343041.140653:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9289 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140662:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9289 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140677:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:3.0:1763343041.140681:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.140688:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9289 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140694:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9289 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140710:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9290 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140716:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9290 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140722:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9290 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140727:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343041.140729:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9290 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140736:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9290 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140747:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bcd00) 00010000:00010000:3.0:1763343041.140749:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.140752:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9290 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140757:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9290 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.140787:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9282 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca094 expref: 272 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.140798:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:3.0:1763343041.140801:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.140804:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9282 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca094 expref: 272 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.140827:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6600, rc 0) 00000100:00100000:0.0:1763343041.140954:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56956:x1848997993726720:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 611us (791us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343041.140964:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9738 00000100:00100000:1.0:1763343041.144549:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.144742:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993726976 00000100:00100000:2.0:1763343041.144758:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993726976 00000100:00100000:2.0:1763343041.145585:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9739 00000100:00100000:2.0:1763343041.145601:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56956:x1848997993726976:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.145684:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.145688:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343041.145729:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9274 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca08d expref: 271 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.145757:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343041.145771:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343041.145790:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9297 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca09b expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.145943:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae929e lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.145959:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae929e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.145970:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae929e lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.145985:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae92a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.145991:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae92a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.145998:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae92a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.146541:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae92ac lrc: 3/1,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.146555:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae92ac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.146562:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae92ac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343041.146573:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x203:0x0]: returning size 0 00010000:00010000:2.0:1763343041.146605:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae929e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.146612:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae929e lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.146654:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae929e lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.146663:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae929e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.146669:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.146674:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae929e lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.146683:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae929e lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.146693:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc800) 00010000:00010000:2.0:1763343041.146696:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.146701:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae929e lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.146708:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae929e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:2.0:1763343041.146719:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c6a5ce5e reply state 00000000fbff692d transno 8589940352 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae92a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.146731:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae92a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.146737:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bcd00) 00010000:00010000:2.0:1763343041.146739:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343041.146742:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343041.146776:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9297 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca09b expref: 273 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.146795:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae92ac lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca09b expref: 272 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.146802:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a34037bcb00) 00010000:00010000:2.0:1763343041.146804:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343041.146807:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:2.0:1763343041.146917:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56956:x1848997993726976:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1319us (2385us total) trans 8589940352 rc 0/0 00000100:00100000:2.0:1763343041.146931:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9739 00000100:00100000:1.0:1763343041.151452:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.151611:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993727232 00000100:00100000:2.0:1763343041.151649:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993727232 00000100:00100000:2.0:1763343041.151720:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9740 00000100:00100000:2.0:1763343041.151731:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56956:x1848997993727232:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.151766:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.151794:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae92ba lrc: 2/0,0 mode: --/CR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca0a2 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.151974:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae92c1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.151993:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae92ac lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca09b expref: 274 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.152004:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae92c1 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.152050:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae92ac lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca09b expref: 274 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.152066:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae92ac lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca09b expref: 274 pid: 10042 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343041.152088:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010321664:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343041.152202:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509fc2240 going to sleep for 11 seconds 00000100:00100000:1.0:1763343041.152492:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.152786:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993727488 00000100:00100000:0.0:1763343041.152794:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993727488 00000100:00100000:0.0:1763343041.152850:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9741 00000100:00100000:0.0:1763343041.152859:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:56957:x1848997993727488:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343041.152881:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343041.152894:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae92c8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca0a9 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.152973:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92cf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.152986:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.152998:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343041.153011:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x203:0x0]: returning size 0 00010000:00010000:0.0:1763343041.153115:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.153123:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92cf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.153130:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92cf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.153137:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343041.153141:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92cf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.153152:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92cf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.153165:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a34037bcb00) 00010000:00010000:0.0:1763343041.153168:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763343041.153174:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92cf lrc: 2/0,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.153180:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92cf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.153230:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae92c8 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x203:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0a9 expref: 277 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.153240:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a34037bcb00) 00010000:00010000:0.0:1763343041.153242:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343041.153246:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae92c8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x203:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0a9 expref: 277 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.153255:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc000, rc 0) 00000100:00100000:0.0:1763343041.153318:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:56957:x1848997993727488:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 460us (826us total) trans 8589940353 rc 301/301 00000100:00100000:0.0:1763343041.153327:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9741 00000100:00100000:2.0:1763343041.155465:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010321664:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343041.155500:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae92c1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:1.0:1763343041.157312:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.157991:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993727616 00000100:00100000:2.0:1763343041.158006:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993727616 00010000:00010000:2.0:1763343041.158065:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae92ac lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca09b expref: 276 pid: 10042 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343041.158123:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3218 00000100:00100000:2.0:1763343041.158135:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:2430:x1848997993727616:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343041.158156:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343041.158163:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae92ac lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca09b expref: 276 pid: 10042 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343041.158177:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae92ac lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca09b expref: 276 pid: 10042 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343041.158206:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae92ac lrc: 0/0,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca09b expref: 276 pid: 10042 timeout: 1334 lvb_type: 0 00010000:00010000:2.0:1763343041.158226:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a34037bcb00) 00010000:00010000:2.0:1763343041.158233:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae92c1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.158245:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae92c1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.158253:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae92c1 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.158305:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343041.158376:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a65a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:2430:x1848997993727616:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 242us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.158385:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3218 00010000:00010000:2.0:1763343041.158417:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae92c1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.158425:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae92c1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343041.158455:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x203:0x0]: returning size 0 00000004:00080000:2.0:1763343041.158745:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2d3:0x0], index 1: 0 00000004:00080000:2.0:1763343041.158755:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2d1:0x0], index 0: 0 00000004:00080000:2.0:1763343041.158760:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2d2:0x0], index 0: 0 00000004:00080000:2.0:1763343041.158764:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2d4:0x0], index 1: 0 00010000:00010000:2.0:1763343041.158933:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae92c1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.158942:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae92c1 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.158950:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae92c1 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.158956:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.158961:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae92c1 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.158969:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae92c1 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.158980:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a34037bcb00) 00010000:00010000:2.0:1763343041.158983:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343041.158987:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae92c1 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.158994:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae92c1 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.159053:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae92ba lrc: 1/0,0 mode: --/CR res: [0x200000405:0x203:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0a2 expref: 275 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.159064:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a34037bcb00) 00010000:00010000:2.0:1763343041.159066:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343041.159070:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae92ba lrc: 0/0,0 mode: --/CR res: [0x200000405:0x203:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0a2 expref: 275 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.159086:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352ce00, rc 0) 00000100:00100000:2.0:1763343041.159135:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:56956:x1848997993727232:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 7406us (7700us total) trans 8589940354 rc 301/301 00000100:00100000:2.0:1763343041.159144:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9740 00000100:00100000:1.0:1763343041.159546:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.159575:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993727872 00000100:00100000:3.0:1763343041.159583:0:32356:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:32356:1848998010321920:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1763343041.159583:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993727872 00000100:00100000:1.0:1763343041.159618:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3328 00000100:00100000:1.0:1763343041.159645:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:56957:x1848997993727872:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343041.159652:0:32356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343041.159678:0:32356:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1763343041.159697:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343041.159708:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010321792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1763343041.159735:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343041.159762:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010321792 00000100:00100000:3.0:1763343041.159766:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010321792 00000100:00100000:3.0:1763343041.159796:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:3.0:1763343041.159802:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010321792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1763343041.159830:0:8412:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484927680 pending 28672 free 3920240640 avail 3688660992 00000100:00100000:1.0:1763343041.159867:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:56957:x1848997993727872:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 223us (321us total) trans 8589940355 rc 0/0 00000100:00100000:1.0:1763343041.159890:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3328 00000100:00100000:0.0:1763343041.162026:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.162065:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993728128 00000100:00100000:0.0:1763343041.162076:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993728128 00000100:00100000:0.0:1763343041.162141:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3329 00000100:00100000:0.0:1763343041.162152:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:56956:x1848997993728128:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343041.162439:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:56956:x1848997993728128:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 288us (424us total) trans 8589940356 rc 0/0 00000100:00100000:0.0:1763343041.162447:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3329 00000100:00100000:3.0:1763343041.162680:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+17:3659:x1848998010321792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2875us (2941us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343041.162691:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:1.0:1763343041.162730:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.162766:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010321792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1763343041.163001:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010321920 00000100:00100000:2.0:1763343041.163008:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010321920 00000100:00100000:0.0:1763343041.163130:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993728384 00000100:00100000:0.0:1763343041.163136:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993728384 00000100:00100000:0.0:1763343041.163179:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9742 00000100:00100000:0.0:1763343041.163187:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:56957:x1848997993728384:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343041.163205:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343041.163235:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae92e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca0b0 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343041.163326:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6889 00000100:00100000:2.0:1763343041.163335:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:32356:x1848998010321920:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1763343041.163381:0:28994:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 738 00010000:00010000:0.0:1763343041.164440:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92eb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164462:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92eb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164475:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92eb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164486:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae92f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164493:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae92f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164499:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae92f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164611:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae92f9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164637:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae92f9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164644:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae92f9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:0.0:1763343041.164655:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x203:0x0]: returning size 0 00010000:00010000:0.0:1763343041.164729:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92eb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164736:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92eb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164742:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92eb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164748:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92eb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164753:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343041.164758:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92eb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164764:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92eb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164776:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4e00) 00010000:00010000:0.0:1763343041.164779:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343041.164783:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92eb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164789:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae92eb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164806:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae92f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164825:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae92f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164830:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae92f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164835:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343041.164837:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae92f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164842:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae92f2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164847:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bcd00) 00010000:00010000:0.0:1763343041.164849:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343041.164852:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae92f2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164857:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae92f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.164904:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae92e4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0b0 expref: 279 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.164924:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae92f9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0b0 expref: 278 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.164931:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a34039e4300) 00010000:00010000:0.0:1763343041.164934:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343041.164937:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dcc00, rc 0) 00000100:00100000:0.0:1763343041.165018:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+278:56957:x1848997993728384:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1831us (2288us total) trans 8589940357 rc 0/0 00000100:00100000:0.0:1763343041.165028:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9742 00000100:00100000:2.0:1763343041.166732:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:32356:x1848998010321920:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3392us (7072us total) trans 21474839054 rc 0/0 00000100:00100000:2.0:1763343041.166744:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6889 00000100:00100000:3.0:1763343041.166933:0:32356:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:32356:1848998010321920:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1763343041.166952:0:32356:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2d2:0x0]-[0x280000401:0x301:0x0] 00000100:00100000:1.0:1763343041.170164:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.170662:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993728640 00000100:00100000:0.0:1763343041.170677:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993728640 00000100:00100000:0.0:1763343041.170744:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3330 00000100:00100000:0.0:1763343041.170756:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+278:56956:x1848997993728640:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343041.171076:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+279:56956:x1848997993728640:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 321us (925us total) trans 8589940358 rc 0/0 00000100:00100000:0.0:1763343041.171085:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3330 00000100:00100000:0.0:1763343041.175064:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.175245:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993728768 00000100:00100000:2.0:1763343041.175259:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993728768 00000100:00100000:2.0:1763343041.175342:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6890 00000100:00100000:2.0:1763343041.175355:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993728768:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.175379:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.175409:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae9307 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca0b7 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343041.175440:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343041.175466:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.175468:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.175482:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae9307 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0b7 expref: 23 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343041.175502:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae9307 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0b7 expref: 23 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343041.175518:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c800, rc 0) 00000100:00100000:2.0:1763343041.176543:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993728768:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1183us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.176556:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6890 00000100:00100000:2.0:1763343041.177650:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.177960:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993729024 00000100:00100000:1.0:1763343041.177974:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993729024 00000100:00100000:1.0:1763343041.178049:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9743 00000100:00100000:1.0:1763343041.178061:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+279:55941:x1848997993729024:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343041.178094:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.178097:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343041.178139:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae92f9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0b0 expref: 279 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.178162:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a34039e4300) 00010000:00010000:1.0:1763343041.178176:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343041.178197:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae930e lrc: 2/0,0 mode: --/CW res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca0be expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343041.178202:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:1.0:1763343041.178347:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8800/0x607405d401ae9315 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.178364:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8800/0x607405d401ae9315 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x203:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.178379:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8800/0x607405d401ae9315 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x203:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343041.178396:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x203:0x0]: returning size 0 00000100:00100000:0.0:1763343041.178437:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993729152 00000100:00100000:0.0:1763343041.178443:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993729152 00000100:00100000:0.0:1763343041.178494:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9744 00000100:00100000:0.0:1763343041.178502:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+281:56957:x1848997993729152:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343041.178510:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343041.178520:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae9323 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca0c5 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.178539:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae930e lrc: 0/0,0 mode: --/CW res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0be expref: 283 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.178548:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae9323 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0c5 expref: 282 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.179879:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae9323 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0c5 expref: 282 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.179933:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:0.0:1763343041.179937:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343041.179941:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc000, rc 0) 00010000:00010000:1.0:1763343041.180121:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8800/0x607405d401ae9315 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x203:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0be expref: 282 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.180130:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343041.180133:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:1.0:1763343041.180135:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d8800, rc 0) 00000100:00100000:0.0:1763343041.180667:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:56957:x1848997993729152:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2119us (2418us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343041.180679:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9744 00000100:00100000:1.0:1763343041.180866:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+281:55941:x1848997993729024:12345-192.168.204.21@tcp:101:bash.0 Request processed in 2805us (3250us total) trans 8589940359 rc 0/0 00000100:00100000:1.0:1763343041.180875:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9743 00000100:00100000:3.0:1763343041.183974:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.184443:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993729408 00000100:00100000:1.0:1763343041.184457:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993729408 00000100:00100000:1.0:1763343041.184531:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3331 00000100:00100000:1.0:1763343041.184543:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+281:56957:x1848997993729408:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343041.184894:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:56957:x1848997993729408:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 352us (1283us total) trans 8589940360 rc 0/0 00000100:00100000:1.0:1763343041.184902:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3331 00000100:00100000:3.0:1763343041.186617:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.186746:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993729536 00000100:00100000:1.0:1763343041.186758:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993729536 00000100:00100000:1.0:1763343041.186822:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9745 00000100:00100000:1.0:1763343041.186833:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:55941:x1848997993729536:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343041.186863:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.186892:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae932a lrc: 2/0,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca0cc expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.186937:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae9331 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.186954:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae9331 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.186967:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae9331 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.187107:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae932a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0cc expref: 284 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.187128:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae9331 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0cc expref: 283 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.187138:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343041.187142:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763343041.187147:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d8200, rc 0) 00000100:00100000:1.0:1763343041.187225:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:55941:x1848997993729536:12345-192.168.204.21@tcp:101:bash.0 Request processed in 393us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.187231:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9745 00000100:00100000:3.0:1763343041.191115:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.191243:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993729792 00000100:00100000:1.0:1763343041.191257:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993729792 00000100:00100000:1.0:1763343041.191335:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9746 00000100:00100000:1.0:1763343041.191348:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:56957:x1848997993729792:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343041.191382:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.191413:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8a00/0x607405d401ae9338 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca0d3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.191545:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae933f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.191563:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae933f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.191577:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae933f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.191588:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9346 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.191597:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9346 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.191603:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9346 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343041.191680:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.191705:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993730048 00000100:00100000:3.0:1763343041.191710:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993730048 00000100:00100000:3.0:1763343041.191737:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9747 00000100:00100000:3.0:1763343041.191744:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+285:55941:x1848997993730048:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:3.0:1763343041.191771:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343041.191778:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae934d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343041.191793:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8800/0x607405d401ae9315 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x203:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0be expref: 285 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.192589:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae934d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343041.192668:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:3.0:1763343041.192676:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343041.192902:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.192917:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae934d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343041.192924:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 4/0,1 mode: --/PW res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.192945:0:28422:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae934d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343041.192956:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.193040:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae934d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343041.193102:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x203:0x0]: returning size 0 00010000:00010000:1.0:1763343041.193167:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae933f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.193178:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae933f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.193184:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae933f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.193190:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae933f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.193196:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343041.193199:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae933f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.193207:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae933f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.193217:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289d00) 00010000:00010000:1.0:1763343041.193219:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343041.193223:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae933f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.193229:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae933f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.193241:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9346 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.193245:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9346 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.193250:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9346 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.193255:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343041.193258:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9346 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.193274:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9346 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.193281:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bcd00) 00010000:00010000:1.0:1763343041.193284:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343041.193287:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9346 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.193291:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9346 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.193345:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8a00/0x607405d401ae9338 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0d3 expref: 287 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.193368:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae934d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0d3 expref: 286 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343041.193377:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae934d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0d3 expref: 286 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343041.193383:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d8400, rc 0) 00000100:00100000:1.0:1763343041.193464:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+286:56957:x1848997993729792:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2119us (2430us total) trans 8589940362 rc 0/0 00000100:00100000:1.0:1763343041.193473:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9746 00000100:00100000:2.0:1763343041.197507:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.197853:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993730304 00000100:00100000:1.0:1763343041.197867:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993730304 00000100:00100000:1.0:1763343041.197926:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3332 00000100:00100000:1.0:1763343041.197935:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+286:56957:x1848997993730304:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343041.198250:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+287:56957:x1848997993730304:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 314us (759us total) trans 8589940363 rc 0/0 00000100:00100000:1.0:1763343041.198258:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3332 00000100:00100000:0.0:1763343041.205927:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.207926:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993730432 00000100:00100000:1.0:1763343041.207946:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993730432 00000100:00100000:2.0:1763343041.208354:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3333 00000100:00100000:2.0:1763343041.208367:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+287:56957:x1848997993730432:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:2.0:1763343041.208984:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+287:56957:x1848997993730432:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 617us (3074us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.208992:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3333 00000100:00100000:0.0:1763343041.217253:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.217484:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993730560 00000100:00100000:1.0:1763343041.217498:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993730560 00010000:00010000:1.0:1763343041.217555:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae934d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0d3 expref: 287 pid: 6525 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343041.217609:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3219 00000100:00100000:1.0:1763343041.217641:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+287:2429:x1848997993730560:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343041.217661:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343041.217669:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae934d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0d3 expref: 287 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343041.217683:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae934d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0d3 expref: 287 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343041.217711:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae934d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0d3 expref: 287 pid: 6525 timeout: 1334 lvb_type: 0 00010000:00010000:1.0:1763343041.217730:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343041.217737:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.217749:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.217761:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.217801:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343041.217895:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+286:2429:x1848997993730560:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 275us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.217904:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3219 00010000:00010000:3.0:1763343041.218319:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.218330:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000001:00080000:3.0:1763343041.218463:0:28422:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940361 00000004:00010000:3.0:1763343041.218527:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c416acf9 reply state 00000000e5693fdb transno 8589940364 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.218543:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.218551:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:3.0:1763343041.218554:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343041.218558:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343041.218723:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+287:55941:x1848997993730048:12345-192.168.204.21@tcp:36:bash.0 Request processed in 26977us (27041us total) trans 8589940364 rc 0/0 00000100:00100000:3.0:1763343041.218732:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9747 00000020:00080000:3.0:1763343041.218736:0:28422:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763343041.227204:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.228869:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993730816 00000100:00100000:3.0:1763343041.228891:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993730816 00000100:00100000:3.0:1763343041.228986:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9748 00000100:00100000:3.0:1763343041.228999:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+287:56958:x1848997993730816:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343041.229034:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343041.229069:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9362 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca0da expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.229174:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9369 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229191:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9369 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229205:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9369 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229217:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9370 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229224:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9370 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229231:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9370 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229526:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9377 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229538:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9377 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229545:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9377 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343041.229558:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x203:0x0]: returning size 0 00010000:00010000:3.0:1763343041.229891:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9369 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229900:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9369 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229909:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9369 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229916:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343041.229920:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9369 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229928:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9369 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229941:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616200) 00010000:00010000:3.0:1763343041.229944:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.229949:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9369 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229955:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9369 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229968:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9370 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229974:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9370 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229980:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9370 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229985:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343041.229987:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9370 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.229993:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9370 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.230004:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bcd00) 00010000:00010000:3.0:1763343041.230006:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.230009:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9370 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.230015:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9370 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.230055:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9362 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0da expref: 290 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.230074:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9377 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0da expref: 289 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.230080:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:3.0:1763343041.230083:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343041.230086:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6200, rc 0) 00000100:00100000:3.0:1763343041.230186:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+289:56958:x1848997993730816:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1189us (2997us total) trans 8589940365 rc 0/0 00000100:00100000:3.0:1763343041.230195:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9748 00000100:00100000:3.0:1763343041.231244:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.234212:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.234922:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993731072 00000100:00100000:0.0:1763343041.234937:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993731072 00000100:00100000:0.0:1763343041.235011:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9749 00000100:00100000:0.0:1763343041.235022:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+289:55941:x1848997993731072:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343041.235057:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343041.235060:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343041.235097:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae9323 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0c5 expref: 289 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.235120:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:0.0:1763343041.235127:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343041.235144:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae9385 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca0e1 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.235215:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae938c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343041.235230:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9377 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0da expref: 289 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.235241:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae938c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343041.235705:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9377 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0da expref: 289 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.235721:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9377 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0da expref: 289 pid: 28422 timeout: 1334 lvb_type: 0 00000100:00100000:0.0:1763343041.235737:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406838380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010322048:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343041.235872:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993731328 00000100:00100000:2.0:1763343041.235880:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993731328 00000100:00100000:2.0:1763343041.235917:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3334 00000100:00100000:2.0:1763343041.235925:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+290:56958:x1848997993731328:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343041.236462:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31c00 going to sleep for 11 seconds 00000100:00100000:2.0:1763343041.237599:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+291:56958:x1848997993731328:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1665us (3396us total) trans 8589940366 rc 0/0 00000100:00100000:2.0:1763343041.237617:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3334 00000100:00100000:0.0:1763343041.242235:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.242297:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.242339:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993731456 00000100:00100000:0.0:1763343041.242351:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993731456 00010000:00010000:0.0:1763343041.242405:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9377 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0da expref: 291 pid: 28422 timeout: 1334 lvb_type: 0 00000100:00100000:0.0:1763343041.242453:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3220 00000100:00100000:0.0:1763343041.242464:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+291:2430:x1848997993731456:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343041.242484:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343041.242493:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9377 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0da expref: 291 pid: 28422 timeout: 1334 lvb_type: 0 00010000:00010000:0.0:1763343041.242509:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9377 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0da expref: 291 pid: 28422 timeout: 1334 lvb_type: 0 00010000:00010000:0.0:1763343041.242544:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:0.0:1763343041.242550:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae938c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343041.242561:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae938c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343041.242570:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae938c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343041.242592:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343041.242686:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+291:2430:x1848997993731456:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 223us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343041.242694:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3220 00000100:00100000:2.0:1763343041.242803:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993731712 00000100:00100000:2.0:1763343041.242819:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993731712 00000100:00100000:2.0:1763343041.242867:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9750 00000100:00100000:2.0:1763343041.242876:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+291:56958:x1848997993731712:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.242898:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.242922:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9393 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca0e8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.243012:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae939a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243023:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae939a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243033:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae939a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243045:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243052:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243059:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243212:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae93a8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243222:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae93a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243229:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae93a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343041.243240:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x203:0x0]: returning size 0 00010000:00010000:2.0:1763343041.243350:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae93a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243359:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae93a8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243367:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae93a8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243373:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.243377:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae93a8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243384:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae93a8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243394:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:2.0:1763343041.243397:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1763343041.243401:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae93a8 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243407:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae93a8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243432:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae939a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243438:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae939a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243443:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae939a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243448:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae939a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243452:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.243454:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae939a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243459:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae939a lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243464:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343041.243466:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.243468:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae939a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243472:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae939a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243478:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243483:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93a1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243488:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243493:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.243496:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243501:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93a1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243506:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bcd00) 00010000:00010000:2.0:1763343041.243508:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.243510:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93a1 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243515:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.243553:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9393 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0e8 expref: 293 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.243561:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bc900) 00010000:00010000:2.0:1763343041.243563:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343041.243567:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9393 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0e8 expref: 293 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.243579:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352dc00, rc 0) 00000100:00100000:2.0:1763343041.243680:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+292:56958:x1848997993731712:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 803us (1458us total) trans 8589940367 rc 301/301 00000100:00100000:2.0:1763343041.243687:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9750 00010000:00010000:1.0:1763343041.243866:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9377 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0da expref: 291 pid: 28422 timeout: 1334 lvb_type: 0 00000100:00100000:1.0:1763343041.243881:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406838380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010322048:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343041.243904:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae938c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.243913:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae938c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.243918:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae938c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:1.0:1763343041.244160:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1543, 88 off129632 00000004:00080000:1.0:1763343041.244170:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1234911548699ns, next at 1235292288054ns, rc = 0 00000040:00080000:1.0:1763343041.244210:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1542, 88 off129632 00000004:00080000:1.0:1763343041.244215:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1234911594071ns, next at 1235292259329ns, rc = 0 00000040:00080000:1.0:1763343041.244229:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1543, 88 off129720 00000004:00080000:1.0:1763343041.244234:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1234911613074ns, next at 1235292259329ns, rc = 0 00000040:00080000:1.0:1763343041.244243:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1544, 88 off129720 00000004:00080000:1.0:1763343041.244246:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1234911625646ns, next at 1235292288054ns, rc = 0 00000100:00100000:1.0:1763343041.245468:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010322176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1763343041.245553:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343041.245965:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010322176 00000100:00100000:3.0:1763343041.245974:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010322176 00000100:00100000:3.0:1763343041.246027:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1763343041.246036:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+34:3657:x1848998010322176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1763343041.246062:0:8411:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484926784 pending 28672 free 3919175680 avail 3687653376 00000100:00100000:3.0:1763343041.246117:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+34:3657:x1848998010322176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343041.246125:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:1.0:1763343041.248609:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010322176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1763343041.251158:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000001:00080000:1.0:1763343041.251686:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940368 is committed 00000004:00080000:1.0:1763343041.251699:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1015 committed 00000004:00080000:1.0:1763343041.251717:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1016 committed 00000004:00080000:1.0:1763343041.251732:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1015 committed 00000004:00080000:1.0:1763343041.251735:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1014 committed 00000100:00100000:1.0:1763343041.251949:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010322304:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343041.252018:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343041.252069:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763343041.252076:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010322688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343041.252099:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343041.252128:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010322432:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343041.252152:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343041.252172:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343041.252177:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010322560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343041.252196:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343041.252236:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010322304 00000100:00100000:1.0:1763343041.252244:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010322304 00000100:00100000:1.0:1763343041.252317:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010322688 00000100:00100000:1.0:1763343041.252320:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010322688 00000100:00100000:1.0:1763343041.252336:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010322432 00000100:00100000:1.0:1763343041.252338:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010322432 00000100:00100000:1.0:1763343041.252354:0:28648:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010322560 00000100:00100000:1.0:1763343041.252357:0:28648:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010322560 00000100:00100000:1.0:1763343041.252378:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6891 00000100:00100000:1.0:1763343041.252388:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3658:x1848998010322304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343041.252421:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:719 count 1 00002000:00010000:1.0:1763343041.252465:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2cf:0x0] initial LVB size: 5, mtime: 0x691a7ac0, atime: 0x691a7ac0, ctime: 0x691a7ac0, blocks: 0x8 00010000:00010000:1.0:1763343041.252476:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8400/0x607405d401ae93b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.252493:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.252496:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.252502:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8400/0x607405d401ae93b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.252517:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8400/0x607405d401ae93b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.252527:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8400/0x607405d401ae93b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.252535:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8400/0x607405d401ae93b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.252554:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343041.252973:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3658:x1848998010322304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 585us (953us total) trans 21474839055 rc 0/0 00000100:00100000:1.0:1763343041.252982:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6891 00000100:00100000:1.0:1763343041.253006:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6892 00000100:00100000:1.0:1763343041.253013:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3658:x1848998010322688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343041.253127:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3658:x1848998010322688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (1027us total) trans 21474839056 rc 0/0 00000100:00100000:1.0:1763343041.253134:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6892 00000100:00100000:1.0:1763343041.253147:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6893 00000100:00100000:1.0:1763343041.253153:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3659:x1848998010322432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343041.253163:0:28648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:720 count 1 00002000:00010000:1.0:1763343041.253181:0:28648:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343041.253186:0:28648:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8a00/0x607405d401ae93bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253194:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.253195:0:28648:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.253199:0:28648:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8a00/0x607405d401ae93bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253209:0:28648:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8a00/0x607405d401ae93bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253218:0:28648:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8a00/0x607405d401ae93bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253225:0:28648:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8a00/0x607405d401ae93bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253242:0:28648:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763343041.253335:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3659:x1848998010322432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 181us (1182us total) trans 21474839057 rc 0/0 00000100:00100000:1.0:1763343041.253341:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6893 00000100:00100000:1.0:1763343041.253353:0:28648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6894 00000100:00100000:1.0:1763343041.253359:0:28648:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3659:x1848998010322560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343041.253426:0:28648:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3659:x1848998010322560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (1229us total) trans 21474839058 rc 0/0 00000100:00100000:1.0:1763343041.253435:0:28648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6894 00010000:00010000:1.0:1763343041.253483:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763343041.253490:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8400/0x607405d401ae93b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253499:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d8400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343041.253504:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8400/0x607405d401ae93b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253513:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8400/0x607405d401ae93b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253532:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8400/0x607405d401ae93b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253539:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8400/0x607405d401ae93b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253557:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343041.253559:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8a00/0x607405d401ae93bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253565:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d8a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343041.253567:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8a00/0x607405d401ae93bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253575:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8a00/0x607405d401ae93bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253583:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8a00/0x607405d401ae93bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253588:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8a00/0x607405d401ae93bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28648 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253596:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343041.253598:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343041.253599:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343041.253605:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763343041.253675:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537912680/2, rc 0, transno 21474839058 00000100:00100000:1.0:1763343041.253682:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010322560:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343041.253690:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537910000/2, rc 0, transno 21474839057 00000100:00100000:1.0:1763343041.253693:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010322432:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1763343041.253711:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537910700/2, rc 0, transno 21474839056 00000100:00100000:1.0:1763343041.253714:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010322688:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763343041.253720:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34095ba300/2, rc 0, transno 21474839055 00000100:00100000:1.0:1763343041.253723:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010322304:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763343041.253790:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae938c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x203:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0e1 expref: 267 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253801:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343041.253804:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343041.253830:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae9385 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0e1 expref: 267 pid: 28422 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763343041.253852:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae938c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x203:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0e1 expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.253884:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343041.253887:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343041.253890:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc600, rc 0) 00000100:00100000:1.0:1763343041.253940:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:55941:x1848997993731072:12345-192.168.204.21@tcp:101:bash.0 Request processed in 18920us (22704us total) trans 8589940368 rc 0/0 00000100:00100000:1.0:1763343041.253948:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9749 00000100:00100000:1.0:1763343041.253967:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993731840 00000100:00100000:1.0:1763343041.253973:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993731840 00000100:00100000:1.0:1763343041.253997:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9751 00000100:00100000:1.0:1763343041.254003:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56958:x1848997993731840:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343041.254016:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.254031:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae93c4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca0ef expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.254109:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae93cb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.254121:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae93cb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.254129:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae93cb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343041.254158:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x203:0x0]: returning size 2 00000004:00200000:1.0:1763343041.254163:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343041.254187:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae93cb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.254209:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae93c4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0ef expref: 268 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.254221:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae93cb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0ef expref: 267 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.254228:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:1.0:1763343041.254231:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343041.254234:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9c00, rc 0) 00000100:00100000:1.0:1763343041.254262:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56958:x1848997993731840:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 258us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.254269:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9751 00010000:00010000:2.0:1763343041.254824:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9235 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.254839:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9235 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.254845:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9235 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.254850:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.254855:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9235 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.254861:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9235 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.254872:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bcd00) 00010000:00010000:2.0:1763343041.254875:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.254879:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9235 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.254885:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9235 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.254901:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae92a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.254907:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae92a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.254913:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae92a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.254917:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.254920:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae92a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.254926:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae92a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.254933:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bcd00) 00010000:00010000:2.0:1763343041.254935:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.254938:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae92a5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.254943:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae92a5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.254959:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.254965:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.254970:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.254975:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.254978:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.254983:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.254990:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:2.0:1763343041.254993:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.254995:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.255001:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9354 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x203:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000100:00100000:3.0:1763343041.255335:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010323072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343041.255396:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343041.255431:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763343041.255436:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010322944:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343041.255457:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343041.255487:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010323072 00000100:00100000:3.0:1763343041.255495:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010323072 00000100:00100000:3.0:1763343041.255530:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010322944 00000100:00100000:3.0:1763343041.255533:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010322944 00000100:00100000:3.0:1763343041.255550:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6895 00000100:00100000:3.0:1763343041.255570:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3660:x1848998010323072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763343041.255768:0:28996:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2d3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343041.255772:0:28996:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2d3:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763343041.255774:0:28996:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2d3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343041.255775:0:28996:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2d3:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763343041.255777:0:28996:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2d3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343041.255826:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3660:x1848998010323072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 267us (428us total) trans 17179871757 rc 0/0 00000100:00100000:3.0:1763343041.255833:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6895 00000100:00100000:3.0:1763343041.255849:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6896 00000100:00100000:3.0:1763343041.255855:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3660:x1848998010322944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343041.255870:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:722 count 1 00002000:00010000:3.0:1763343041.255897:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343041.255904:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae93d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.255916:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343041.255918:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343041.255924:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae93d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.255936:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae93d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.255944:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae93d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.255952:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae93d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.255967:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343041.256117:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3660:x1848998010322944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 262us (659us total) trans 17179871758 rc 0/0 00000100:00100000:3.0:1763343041.256124:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6896 00000004:00080000:3.0:1763343041.256172:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d5f80/2, rc 0, transno 17179871758 00000100:00100000:3.0:1763343041.256178:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010322944:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763343041.256188:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a4c000/2, rc 0, transno 17179871757 00000100:00100000:3.0:1763343041.256191:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010323072:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763343041.256408:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343041.256416:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae93d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.256424:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35379c0c00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343041.256428:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae93d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.256436:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae93d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.256451:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae93d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.256463:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a35379c0c00/0x607405d401ae93d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.256479:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343041.256482:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343041.256484:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343041.256497:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3409a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010323200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343041.256535:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343041.256568:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343041.256573:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34059d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010322816:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343041.256593:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343041.257034:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010323200 00000100:00100000:2.0:1763343041.257043:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010323200 00000100:00100000:2.0:1763343041.257082:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010322816 00000100:00100000:2.0:1763343041.257085:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010322816 00000100:00100000:2.0:1763343041.257109:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6897 00000100:00100000:2.0:1763343041.257117:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3657:x1848998010323200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343041.257288:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3657:x1848998010323200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (751us total) trans 17179871759 rc 0/0 00000100:00100000:2.0:1763343041.257295:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6897 00000100:00100000:2.0:1763343041.257313:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6898 00000100:00100000:2.0:1763343041.257318:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3657:x1848998010322816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343041.257331:0:28995:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:721 count 1 00010000:00010000:2.0:1763343041.257348:0:28995:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae93d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.257366:0:28995:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd200/0x607405d401ae91be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca055 expref: 22 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.257375:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343041.257377:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343041.257381:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae93d9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.257419:0:28995:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd200/0x607405d401ae91be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca055 expref: 22 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.257434:0:28995:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd200/0x607405d401ae91be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca055 expref: 22 pid: 27835 timeout: 1334 lvb_type: 0 00000100:00100000:2.0:1763343041.257449:0:28995:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c2c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010323328:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343041.257526:0:28995:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509fc2300 going to sleep for 11 seconds 00000004:00080000:0.0:1763343041.258667:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3409a4d180/2, rc 0, transno 17179871759 00000100:00100000:0.0:1763343041.258683:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3409a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010323200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343041.263551:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.263681:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993732096 00000100:00100000:2.0:1763343041.263697:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993732096 00000100:00100000:2.0:1763343041.263772:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3335 00000100:00100000:2.0:1763343041.263785:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56958:x1848997993732096:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343041.264218:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56958:x1848997993732096:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 434us (681us total) trans 8589940369 rc 0/0 00000100:00100000:2.0:1763343041.264227:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3335 00000100:00100000:3.0:1763343041.269084:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.269177:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993732224 00000100:00100000:1.0:1763343041.269191:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993732224 00000100:00100000:1.0:1763343041.269277:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6899 00000100:00100000:1.0:1763343041.269289:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:55941:x1848997993732224:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343041.269315:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.269344:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9e00/0x607405d401ae93e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca0f6 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343041.269359:0:28995:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c2c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:28995:1848998010323328:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343041.269385:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae9307 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0b7 expref: 24 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343041.269394:0:28995:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae93d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.269397:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.269401:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.269411:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9e00/0x607405d401ae93e0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0f6 expref: 24 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.269460:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae9307 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0b7 expref: 24 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343041.269474:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae9307 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0b7 expref: 24 pid: 28994 timeout: 1334 lvb_type: 1 00000100:00100000:1.0:1763343041.269490:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537912d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010323456:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343041.269595:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343041.271378:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.272002:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993732480 00000100:00100000:0.0:1763343041.272016:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993732480 00010000:00010000:0.0:1763343041.272066:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd200/0x607405d401ae91be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca055 expref: 25 pid: 27835 timeout: 1334 lvb_type: 0 00000100:00100000:0.0:1763343041.272125:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3221 00000100:00100000:0.0:1763343041.272136:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35084c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2429:x1848997993732480:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343041.272157:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343041.272163:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd200/0x607405d401ae91be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca055 expref: 25 pid: 27835 timeout: 1334 lvb_type: 0 00010000:00010000:0.0:1763343041.272182:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd200/0x607405d401ae91be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca055 expref: 25 pid: 27835 timeout: 1334 lvb_type: 0 00010000:00010000:0.0:1763343041.272211:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dd200/0x607405d401ae91be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca055 expref: 25 pid: 27835 timeout: 1334 lvb_type: 0 00010000:00010000:0.0:1763343041.272232:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.272234:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.272240:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae93d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.272250:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae93d9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.272302:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343041.272370:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35084c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2429:x1848997993732480:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 235us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343041.272378:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3221 00010000:00010000:3.0:1763343041.273684:0:28995:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae93d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.273707:0:28995:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae93d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.273719:0:28995:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae93d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.273728:0:28995:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae93d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343041.273747:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:3.0:1763343041.273751:0:28995:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343041.273844:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537912d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010323456:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343041.273879:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9e00/0x607405d401ae93e0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0f6 expref: 23 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.273900:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9e00, rc 0) 00000100:00100000:1.0:1763343041.273950:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:55941:x1848997993732224:12345-192.168.204.21@tcp:101:bash.0 Request processed in 4663us (4880us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.273960:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6899 00000100:00100000:3.0:1763343041.274069:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3657:x1848998010322816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16749us (17472us total) trans 17179871760 rc 0/0 00000100:00100000:3.0:1763343041.274078:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6898 00000100:00100000:2.0:1763343041.274174:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993732608 00000100:00100000:2.0:1763343041.274183:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993732608 00000100:00100000:2.0:1763343041.274244:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9752 00000100:00100000:2.0:1763343041.274255:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56958:x1848997993732608:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.274295:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.274324:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae93e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca0fd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.274445:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae93ee lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274459:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae93ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274471:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae93ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274483:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274489:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274495:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274612:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae93fc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274675:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae93fc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274684:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae93fc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343041.274695:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x203:0x0]: returning size 2 00010000:00010000:2.0:1763343041.274779:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae93ee lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274786:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae93ee lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274792:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae93ee lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274798:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae93ee lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274804:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.274822:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae93ee lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274831:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae93ee lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274845:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:2.0:1763343041.274849:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.274854:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae93ee lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274860:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae93ee lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274872:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274879:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274884:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274889:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.274891:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274896:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274902:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc900) 00010000:00010000:2.0:1763343041.274905:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.274907:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93f5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274916:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae93f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.274963:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae93e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0fd expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.274978:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae93fc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0fd expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.274986:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:2.0:1763343041.274988:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343041.274991:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352da00, rc 0) 00000100:00100000:2.0:1763343041.275043:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56958:x1848997993732608:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 789us (1300us total) trans 8589940370 rc 0/0 00000100:00100000:2.0:1763343041.275052:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9752 00010000:00010000:0.0:1763343041.276010:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343041.276025:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae93d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.276036:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343041.276041:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae93d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.276050:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae93d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.276073:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae93d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.276081:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae93d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343041.276101:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:0.0:1763343041.276104:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343041.276108:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343041.276110:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343041.276174:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34059d6680/2, rc 0, transno 17179871760 00000100:00100000:0.0:1763343041.276183:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34059d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010322816:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343041.277918:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.278041:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.278100:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993732736 00000100:00100000:0.0:1763343041.278114:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993732736 00010000:00010000:0.0:1763343041.278170:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae9307 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0b7 expref: 23 pid: 28994 timeout: 1334 lvb_type: 1 00000100:00100000:0.0:1763343041.278218:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993733120 00000100:00100000:0.0:1763343041.278222:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993733120 00000100:00100000:3.0:1763343041.278256:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993732992 00000100:00100000:3.0:1763343041.278263:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993732992 00000100:00100000:0.0:1763343041.278283:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3222 00000100:00100000:0.0:1763343041.278296:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537912d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993732736:12345-192.168.204.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1763343041.278313:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3336 00010000:00010000:0.0:1763343041.278317:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1763343041.278326:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56958:x1848997993732992:12345-192.168.204.21@tcp:35:lfs.0 00010000:00010000:0.0:1763343041.278326:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae9307 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0b7 expref: 23 pid: 28994 timeout: 1334 lvb_type: 1 00010000:00010000:0.0:1763343041.278346:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae9307 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0b7 expref: 23 pid: 28994 timeout: 1334 lvb_type: 1 00010000:00010000:0.0:1763343041.278379:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352c800/0x607405d401ae9307 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0b7 expref: 23 pid: 28994 timeout: 1334 lvb_type: 1 00010000:00010000:0.0:1763343041.278400:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.278402:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.278412:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9e00/0x607405d401ae93e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0f6 expref: 22 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.278424:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9e00/0x607405d401ae93e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0f6 expref: 22 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.278473:0:6510:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9e00/0x607405d401ae93e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0f6 expref: 22 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343041.278490:0:6510:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340478d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6510:1848998010323584:192.168.204.21@tcp:105: 00000100:00100000:3.0:1763343041.278582:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56958:x1848997993732992:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 259us (674us total) trans 8589940371 rc 0/0 00000100:00100000:3.0:1763343041.278591:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3336 00000100:00100000:0.0:1763343041.278597:0:6510:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31c00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343041.278645:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 414 00000100:00100000:0.0:1763343041.278654:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538756680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:2429:x1848997993733120:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343041.278665:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343041.278682:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae93fc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0fd expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.278699:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:0.0:1763343041.278706:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343041.278728:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538756680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:2429:x1848997993733120:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 75us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343041.278736:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 414 00000100:00100000:0.0:1763343041.282882:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.283386:0:6510:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340478d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6510:1848998010323584:192.168.204.21@tcp:105: 00010000:00010000:2.0:1763343041.283418:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343041.284091:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537912d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993732736:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 5792us (7988us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.284106:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3222 00000100:00100000:3.0:1763343041.284388:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993733376 00000100:00100000:3.0:1763343041.284399:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993733376 00000100:00100000:3.0:1763343041.284456:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6900 00000100:00100000:3.0:1763343041.284465:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340a65a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:55941:x1848997993733376:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343041.284488:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343041.284516:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a35379c1800/0x607405d401ae940a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca104 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343041.284547:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343041.284575:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343041.284578:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343041.284589:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a35379c1800/0x607405d401ae940a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca104 expref: 16 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.284608:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a35379c1800/0x607405d401ae940a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca104 expref: 16 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.284643:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35379c1800, rc 0) 00000100:00100000:3.0:1763343041.284688:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340a65a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:55941:x1848997993733376:12345-192.168.204.21@tcp:101:bash.0 Request processed in 224us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343041.284694:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6900 00000100:00100000:0.0:1763343041.284829:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.286188:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993733248 00000100:00100000:3.0:1763343041.286202:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993733248 00000100:00100000:3.0:1763343041.286457:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3337 00000100:00100000:3.0:1763343041.286471:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56958:x1848997993733248:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:3.0:1763343041.286717:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56958:x1848997993733248:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 248us (1888us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343041.286724:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3337 00000100:00100000:1.0:1763343041.291916:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.291961:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.292050:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993733504 00000100:00100000:0.0:1763343041.292065:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993733504 00002000:00010000:0.0:1763343041.292122:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/723 (0->18446744073709551615) 00002000:00100000:0.0:1763343041.292128:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538757480 with x1848997993733504 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343041.292145:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3538757480. 00000100:00100000:0.0:1763343041.292183:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993733632 00000100:00100000:0.0:1763343041.292187:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993733632 00002000:00010000:0.0:1763343041.292202:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/721 (0->18446744073709551615) 00002000:00100000:0.0:1763343041.292205:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538756300 with x1848997993733632 ext(0->18446744073709551615) 00000100:00100000:2.0:1763343041.292213:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1668 00002000:00010000:0.0:1763343041.292214:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3538756300. 00000100:00100000:2.0:1763343041.292232:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993733504:12345-192.168.204.21@tcp:10:bash.0 00000100:00100000:0.0:1763343041.292247:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1669 00000100:00100000:0.0:1763343041.292257:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993733632:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343041.292492:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2d3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343041.292492:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343041.292500:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2d3:0x0] updating lvb mtime from disk: 0 -> 1763343041 00002000:00010000:0.0:1763343041.292500:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d1:0x0] updating lvb mtime from disk: 0 -> 1763343041 00002000:00010000:2.0:1763343041.292505:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2d3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343041.292507:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343041.292510:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2d3:0x0] updating lvb ctime from disk: 0 -> 1763343041 00002000:00010000:0.0:1763343041.292511:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d1:0x0] updating lvb ctime from disk: 0 -> 1763343041 00002000:00010000:0.0:1763343041.292516:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d1:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1763343041.292517:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2d3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343041.292611:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993733504:12345-192.168.204.21@tcp:10:bash.0 Request processed in 381us (708us total) trans 17179871761 rc 0/0 00000100:00100000:0.0:1763343041.292611:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993733632:12345-192.168.204.21@tcp:10:bash.0 Request processed in 352us (646us total) trans 21474839059 rc 0/0 00000100:00100000:0.0:1763343041.292653:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1669 00002000:00010000:0.0:1763343041.292658:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/721 (0->18446744073709551615) 00000100:00100000:2.0:1763343041.292661:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1668 00002000:00100000:0.0:1763343041.292664:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538756300 with x1848997993733632 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343041.292667:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/723 (0->18446744073709551615) 00002000:00010000:0.0:1763343041.292671:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3538756300. 00002000:00100000:2.0:1763343041.292672:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538757480 with x1848997993733504 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343041.292681:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3538757480. 00000100:00100000:2.0:1763343041.305545:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.305685:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993734144 00000100:00100000:0.0:1763343041.305700:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993734144 00000100:00100000:0.0:1763343041.305791:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9753 00000100:00100000:0.0:1763343041.305804:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56959:x1848997993734144:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:0.0:1763343041.305887:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763343041.305925:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae938c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x203:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0e1 expref: 267 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.306190:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae93cb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0ef expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.306204:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae9331 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x203:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0cc expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.306215:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3510289e00) 00010000:00010000:0.0:1763343041.306229:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343041.306262:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9411 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.306279:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9411 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.306289:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9411 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.306305:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9418 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.306312:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9418 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.306318:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9418 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.306425:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae941f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.306434:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae941f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.306441:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae941f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00080000:2.0:1763343041.309309:0:6525:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000405:0x203:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1763343041.309479:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae941f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.309492:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae941f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.309501:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae941f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.309507:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dcc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.309512:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae941f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.309522:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae941f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.309541:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a34039e4e00) 00010000:00010000:2.0:1763343041.309545:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343041.309550:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae941f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.309556:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae941f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.309587:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9411 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.309594:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9411 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.309600:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9411 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.309605:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9411 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.309610:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058ddc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.309613:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9411 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00000100:00100000:1.0:1763343041.311098:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:2.0:1763343041.311274:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9411 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.311295:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4c00) 00010000:00010000:2.0:1763343041.311298:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.311304:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9411 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.311317:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae9411 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000100:00100000:0.0:1763343041.311349:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993733888 00000004:00010000:2.0:1763343041.311362:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000caf14f61 reply state 00000000d45f2abe transno 8589940372 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9418 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:0.0:1763343041.311363:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993733888 00010000:00010000:2.0:1763343041.311379:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9418 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.311389:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4a00) 00010000:00010000:2.0:1763343041.311392:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343041.311396:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343041.311442:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9754 00000100:00100000:0.0:1763343041.311455:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56958:x1848997993733888:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343041.311477:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763343041.311506:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56959:x1848997993734144:12345-192.168.204.21@tcp:36:rm.0 Request processed in 5703us (5974us total) trans 8589940372 rc 0/0 00000100:00100000:2.0:1763343041.311516:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9753 00010000:00010000:1.0:1763343041.311612:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9426 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca10b expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.311788:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae942d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.311801:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae942d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343041.311819:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae942d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343041.311833:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x203:0x0]: returning size 2 00010000:00010000:1.0:1763343041.311961:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9426 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x203:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca10b expref: 269 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.311978:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae942d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca10b expref: 268 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.311986:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a34039e4200) 00010000:00010000:1.0:1763343041.311988:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343041.311990:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9200, rc 0) 00000100:00100000:1.0:1763343041.312029:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56958:x1848997993733888:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 577us (944us total) trans 8589940373 rc 0/0 00000100:00100000:1.0:1763343041.312035:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9754 00000100:00100000:1.0:1763343041.324420:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.324578:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993734400 00000100:00100000:3.0:1763343041.324592:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993734400 00000100:00100000:2.0:1763343041.324728:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3338 00000100:00100000:2.0:1763343041.324743:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56958:x1848997993734400:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:2.0:1763343041.324867:0:6527:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x203:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae942d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca10b expref: 268 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.324920:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae943b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343041.324936:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae943b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343041.324947:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae943b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00000004:00020000:2.0:1763343041.325134:0:6527:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0000-mdtlov: can not set all stale mirrors for [0x200000405:0x203:0x0]: rc = -1 00010000:00010000:2.0:1763343041.325169:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae943b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343041.325176:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae943b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343041.325183:0:6527:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae943b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343041.325190:0:6527:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.325195:0:6527:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae943b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343041.325204:0:6527:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae943b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x203:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343041.325215:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a34039e4200) 00010000:00010000:2.0:1763343041.325219:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763343041.325225:0:6527:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae943b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343041.325231:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae943b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x203:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343041.325242:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a34039e4200) 00010000:00010000:2.0:1763343041.325245:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343041.325249:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae942d lrc: 0/0,0 mode: --/PW res: [0x200000405:0x203:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca10b expref: 268 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343041.325510:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:56958:x1848997993734400:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 769us (1105us total) trans 8589940374 rc -1/-1 00000100:00100000:2.0:1763343041.325518:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3338 00000100:00100000:1.0:1763343041.331408:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.331825:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.331921:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993734528 00000100:00100000:3.0:1763343041.331936:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993734528 00000100:00100000:3.0:1763343041.332025:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993734656 00000100:00100000:3.0:1763343041.332029:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993734656 00000100:00100000:3.0:1763343041.332067:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9755 00000100:00100000:3.0:1763343041.332079:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56958:x1848997993734528:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343041.332115:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343041.332150:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae9442 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca112 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343041.332181:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9756 00000100:00100000:1.0:1763343041.332193:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56960:x1848997993734656:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343041.332203:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.332219:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9600/0x607405d401ae9449 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca119 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.332231:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae9442 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca112 expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.332250:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0600/0x607405d401ae9442 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x203:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca112 expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.332286:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3404616500) 00010000:00010000:3.0:1763343041.332291:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343041.332291:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae9450 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.332296:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35379c0600, rc 0) 00010000:00010000:1.0:1763343041.332306:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae9450 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332318:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae9450 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332332:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9457 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332341:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9457 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332347:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9457 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:3.0:1763343041.332380:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56958:x1848997993734528:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 301us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343041.332388:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9755 00010000:00010000:1.0:1763343041.332405:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae9450 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332414:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae9450 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332421:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae9450 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332428:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae9450 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332434:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d8c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343041.332439:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae9450 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332447:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae9450 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332458:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:1.0:1763343041.332461:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343041.332466:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae9450 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332472:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae9450 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332486:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9457 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332491:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9457 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332497:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9457 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332502:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343041.332505:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9457 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332510:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9457 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332518:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4a00) 00010000:00010000:1.0:1763343041.332520:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343041.332523:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9457 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332529:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9457 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.332558:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9600/0x607405d401ae9449 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca119 expref: 270 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.332569:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:1.0:1763343041.332572:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343041.332576:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9600/0x607405d401ae9449 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca119 expref: 270 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.332592:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9600, rc 0) 00000100:00100000:1.0:1763343041.332667:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56960:x1848997993734656:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 476us (842us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343041.332675:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9756 00000100:00100000:1.0:1763343041.338077:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.338153:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.338281:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993734912 00000100:00100000:2.0:1763343041.338299:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993734912 00000100:00100000:3.0:1763343041.338322:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993735040 00000100:00100000:3.0:1763343041.338328:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993735040 00000100:00100000:3.0:1763343041.338383:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9757 00000100:00100000:3.0:1763343041.338396:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56960:x1848997993735040:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343041.338423:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343041.338461:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae945e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca120 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.338582:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9465 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.338600:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9465 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.338615:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9465 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.338652:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae946c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.338660:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae946c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.338667:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae946c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.338720:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9465 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.338727:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9465 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.338733:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9465 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.338739:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9465 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.338746:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343041.338751:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9465 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.338760:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9465 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00000100:00100000:2.0:1763343041.338915:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3339 00000100:00100000:2.0:1763343041.338925:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56958:x1848997993734912:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:2.0:1763343041.340451:0:14879:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x203:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763343041.340556:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1545, 64 off129784 00000040:00080000:2.0:1763343041.340585:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1544, 64 off129784 00000040:00080000:2.0:1763343041.340595:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1545, 64 off129848 00000040:00080000:2.0:1763343041.340604:0:14879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1546, 64 off129848 00010000:00010000:2.0:1763343041.340713:0:14879:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae9473 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x203:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343041.340733:0:14879:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae9473 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343041.340746:0:14879:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae9473 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343041.340754:0:14879:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae9473 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343041.340761:0:14879:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae9473 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343041.340766:0:14879:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae9473 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14879 initiator: MDT0 00010000:00010000:2.0:1763343041.340792:0:14879:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343041.341176:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616b00) 00010000:00010000:3.0:1763343041.341180:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.341189:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9465 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.341196:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9465 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.341212:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae946c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.341217:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae946c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.341223:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae946c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.341228:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343041.341235:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae946c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.341241:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae946c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.341249:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4a00) 00010000:00010000:3.0:1763343041.341251:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.341254:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae946c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.341259:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae946c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.341296:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae945e lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca120 expref: 272 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.341308:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616b00) 00010000:00010000:3.0:1763343041.341311:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.341315:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae945e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca120 expref: 272 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.341330:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35379c0c00, rc 0) 00010000:00010000:1.0:1763343041.342483:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343041.342502:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae9473 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343041.342516:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343041.342521:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae9473 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343041.342530:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae9473 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343041.342547:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x203:0x0].0x0 (ffff9a3404616500) 00010000:00010000:1.0:1763343041.342551:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763343041.342556:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae9473 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00010000:00010000:1.0:1763343041.342566:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae9473 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14879 initiator: MDT0 00000100:00100000:3.0:1763343041.342573:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56960:x1848997993735040:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 4172us (4412us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343041.342587:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9757 00010000:00010000:1.0:1763343041.342588:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343041.342592:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343041.342594:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343041.342861:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56958:x1848997993734912:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 3935us (4799us total) trans 8589940375 rc 0/0 00000100:00100000:2.0:1763343041.342950:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3339 00000100:00100000:2.0:1763343041.350337:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.351323:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993735168 00000100:00100000:3.0:1763343041.351340:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993735168 00000100:00100000:0.0:1763343041.352586:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9758 00000100:00100000:0.0:1763343041.352612:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56960:x1848997993735168:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343041.352670:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343041.352706:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae947a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca127 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.352786:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9481 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.352803:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9481 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.352829:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9481 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343041.352894:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1763343041.352901:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343041.352945:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae947a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca127 expref: 272 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.352967:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9481 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca127 expref: 271 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.352977:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4200) 00010000:00010000:0.0:1763343041.352981:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343041.352985:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd800, rc 0) 00000100:00100000:0.0:1763343041.353094:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c2c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56960:x1848997993735168:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 494us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343041.353103:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9758 00000100:00100000:0.0:1763343041.362531:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.362666:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993735424 00000100:00100000:1.0:1763343041.362680:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993735424 00000100:00100000:1.0:1763343041.362770:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9759 00000100:00100000:1.0:1763343041.362783:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56961:x1848997993735424:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343041.362821:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.362848:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9488 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca12e expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.363211:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae948f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.363230:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae948f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.363244:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae948f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.363256:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9496 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364065:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9496 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364084:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9496 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364146:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae948f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364154:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae948f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364161:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae948f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364168:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae948f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364174:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d8c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343041.364179:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae948f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364188:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae948f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364203:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4200) 00010000:00010000:1.0:1763343041.364207:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343041.364213:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae948f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364221:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae948f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364240:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9496 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364728:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9496 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364739:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9496 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364745:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343041.364748:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9496 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364754:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9496 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364763:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4a00) 00010000:00010000:1.0:1763343041.364766:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343041.364769:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9496 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364775:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9496 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.364836:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9488 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca12e expref: 272 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.364848:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4200) 00010000:00010000:1.0:1763343041.364850:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343041.364854:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9488 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca12e expref: 272 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.364864:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9a00, rc 0) 00000100:00100000:1.0:1763343041.364973:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56961:x1848997993735424:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2191us (2457us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343041.364984:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9759 00000100:00100000:1.0:1763343041.369472:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.370006:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993735680 00000100:00100000:0.0:1763343041.370021:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993735680 00000100:00100000:0.0:1763343041.370093:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9760 00000100:00100000:0.0:1763343041.370104:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:56960:x1848997993735680:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343041.370132:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343041.370135:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343041.370171:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9481 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca127 expref: 271 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.370194:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4200) 00010000:00010000:0.0:1763343041.370206:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343041.370227:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae949d lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca135 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.370535:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae94a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.370550:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae94a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.370562:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae94a4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.370573:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae94ab lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.370580:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae94ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.370585:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae94ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.371198:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae94b2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.371211:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae94b2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.371219:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae94b2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343041.371230:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x204:0x0]: returning size 0 00010000:00010000:0.0:1763343041.371261:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae94a4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.371428:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae94a4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.371434:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae94a4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.371440:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae94a4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.371447:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dda00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343041.371452:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae94a4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.371460:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae94a4 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.371471:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4c00) 00010000:00010000:0.0:1763343041.371474:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343041.371478:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae94a4 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.371485:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae94a4 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00010000:0.0:1763343041.371498:0:10041:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000036c3606d reply state 0000000030c0f8de transno 8589940376 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae94ab lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.371510:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae94ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.371516:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4a00) 00010000:00010000:0.0:1763343041.371518:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343041.371521:0:10041:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343041.371560:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae949d lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca135 expref: 273 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.371579:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae94b2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca135 expref: 272 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.371586:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a34039e4e00) 00010000:00010000:0.0:1763343041.371589:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343041.371592:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058ddc00, rc 0) 00000100:00100000:0.0:1763343041.371864:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56960:x1848997993735680:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1760us (2406us total) trans 8589940376 rc 0/0 00000100:00100000:0.0:1763343041.371874:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9760 00000100:00100000:2.0:1763343041.376515:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.380609:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993735936 00000100:00100000:0.0:1763343041.380651:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993735936 00000100:00100000:0.0:1763343041.380765:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9761 00000100:00100000:0.0:1763343041.380778:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34059d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56960:x1848997993735936:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343041.380826:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343041.380866:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae94c0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca13c expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.381024:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae94c7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.381043:0:10041:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae94b2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca135 expref: 274 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.381052:0:10041:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae94c7 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.381093:0:10041:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae94b2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca135 expref: 274 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.381114:0:10041:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae94b2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca135 expref: 274 pid: 10041 timeout: 1335 lvb_type: 0 00000100:00100000:0.0:1763343041.381130:0:10041:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340683bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010323712:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343041.381242:0:10041:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31c00 going to sleep for 11 seconds 00000100:00100000:2.0:1763343041.387559:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.387764:0:10041:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340683bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10041:1848998010323712:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343041.387803:0:10041:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae94c7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000100:00100000:1.0:1763343041.387904:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993736064 00000100:00100000:1.0:1763343041.387913:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993736064 00010000:00010000:1.0:1763343041.387959:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae94b2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca135 expref: 275 pid: 10041 timeout: 1335 lvb_type: 0 00000100:00100000:1.0:1763343041.388005:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3223 00000100:00100000:1.0:1763343041.388017:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:2430:x1848997993736064:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343041.388037:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343041.388044:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae94b2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca135 expref: 275 pid: 10041 timeout: 1335 lvb_type: 0 00010000:00010000:1.0:1763343041.388056:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae94b2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca135 expref: 275 pid: 10041 timeout: 1335 lvb_type: 0 00010000:00010000:1.0:1763343041.388082:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae94b2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca135 expref: 275 pid: 10041 timeout: 1335 lvb_type: 0 00010000:00010000:1.0:1763343041.388102:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a34039e4e00) 00010000:00010000:1.0:1763343041.388107:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae94c7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.388118:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae94c7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.388127:0:6510:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae94c7 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.388161:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343041.388233:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406552a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:2430:x1848997993736064:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 216us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.388241:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3223 00010000:00010000:0.0:1763343041.388588:0:10041:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae94c7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.388596:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae94c7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:0.0:1763343041.388648:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x204:0x0]: returning size 0 00000004:00080000:0.0:1763343041.388906:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2d3:0x0], index 0: 0 00000004:00080000:0.0:1763343041.388914:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2d5:0x0], index 1: 0 00000004:00080000:0.0:1763343041.388919:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2d6:0x0], index 1: 0 00000004:00080000:0.0:1763343041.388924:0:10041:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2d4:0x0], index 0: 0 00010000:00010000:0.0:1763343041.389074:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae94c7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.389083:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae94c7 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.389090:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae94c7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.389096:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343041.389101:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae94c7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.389109:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae94c7 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.389127:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a34039e4e00) 00010000:00010000:0.0:1763343041.389130:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343041.389135:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae94c7 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.389141:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae94c7 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.389203:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae94c0 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x204:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca13c expref: 274 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.389214:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a34039e4e00) 00010000:00010000:0.0:1763343041.389216:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343041.389220:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae94c0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x204:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca13c expref: 274 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.389237:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dcc00, rc 0) 00000100:00100000:0.0:1763343041.389315:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34059d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56960:x1848997993735936:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 8540us (12815us total) trans 8589940377 rc 301/301 00000100:00100000:0.0:1763343041.389324:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9761 00000100:00100000:2.0:1763343041.394201:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.394591:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993736320 00000100:00100000:3.0:1763343041.394605:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993736320 00000100:00100000:3.0:1763343041.394716:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3340 00000100:00100000:3.0:1763343041.394727:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56960:x1848997993736320:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343041.395144:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:56960:x1848997993736320:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 417us (957us total) trans 8589940378 rc 0/0 00000100:00100000:3.0:1763343041.395154:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3340 00000100:00100000:2.0:1763343041.399178:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.399355:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993736576 00000100:00100000:1.0:1763343041.399369:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993736576 00000100:00100000:1.0:1763343041.399440:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3341 00000100:00100000:1.0:1763343041.399451:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:56960:x1848997993736576:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343041.400395:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:56960:x1848997993736576:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 940us (1227us total) trans 8589940379 rc 0/0 00000100:00100000:1.0:1763343041.400408:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3341 00000100:00100000:0.0:1763343041.400514:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.401071:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993736832 00000100:00100000:1.0:1763343041.401082:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993736832 00000100:00100000:1.0:1763343041.401136:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9762 00000100:00100000:1.0:1763343041.401145:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340683bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:56961:x1848997993736832:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343041.401165:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.401195:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae94d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca143 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.401290:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae94dc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401306:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae94dc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401318:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae94dc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401328:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae94e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401335:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae94e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401341:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae94e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401484:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae94ea lrc: 3/1,0 mode: --/PR res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401492:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae94ea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401499:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae94ea lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343041.401511:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x204:0x0]: returning size 0 00010000:00010000:1.0:1763343041.401604:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae94dc lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401612:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae94dc lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401649:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae94dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401656:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae94dc lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401663:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343041.401667:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae94dc lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401676:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae94dc lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401689:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3403bdc500) 00010000:00010000:1.0:1763343041.401692:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343041.401697:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae94dc lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401708:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae94dc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401722:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae94e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401727:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae94e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401732:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae94e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401737:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d8000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343041.401739:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae94e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401744:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae94e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401749:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4a00) 00010000:00010000:1.0:1763343041.401751:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343041.401754:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae94e3 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401759:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae94e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.401797:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae94d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca143 expref: 278 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.401829:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae94ea lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca143 expref: 277 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.401841:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:1.0:1763343041.401843:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343041.401846:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d8c00, rc 0) 00000100:00100000:1.0:1763343041.401924:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340683bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:56961:x1848997993736832:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 779us (1410us total) trans 8589940380 rc 0/0 00000100:00100000:1.0:1763343041.401932:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9762 00000100:00100000:2.0:1763343041.408226:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.408277:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.408385:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993736960 00000100:00100000:0.0:1763343041.408403:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993736960 00000100:00100000:0.0:1763343041.408477:0:28995:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993737088 00000100:00100000:0.0:1763343041.408480:0:28995:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993737088 00000100:00100000:0.0:1763343041.408517:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6901 00000100:00100000:0.0:1763343041.408527:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2429:x1848997993736960:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343041.408550:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343041.408579:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae94f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca14a expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343041.408609:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343041.408666:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.408669:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.408681:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae94f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca14a expref: 24 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343041.408702:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae94f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca14a expref: 24 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343041.408718:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dcc00, rc 0) 00000100:00100000:0.0:1763343041.408787:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2429:x1848997993736960:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 261us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343041.408795:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6901 00000100:00100000:0.0:1763343041.408827:0:28995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6902 00000100:00100000:0.0:1763343041.408834:0:28995:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993737088:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343041.408842:0:28995:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343041.408854:0:28995:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae94ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca151 expref: -99 pid: 28995 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343041.408869:0:28995:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343041.408878:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.408880:0:28995:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.408884:0:28995:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae94ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca151 expref: 18 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343041.408901:0:28995:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae94ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca151 expref: 18 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343041.408909:0:28995:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dce00, rc 0) 00000100:00100000:0.0:1763343041.408925:0:28995:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993737088:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 92us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343041.408931:0:28995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6902 00000100:00100000:0.0:1763343041.410888:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.411323:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993737216 00000100:00100000:2.0:1763343041.411336:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993737216 00000100:00100000:2.0:1763343041.412548:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9763 00000100:00100000:2.0:1763343041.412566:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:55941:x1848997993737216:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343041.412601:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.412650:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9506 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca158 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.412702:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae950d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.412721:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae950d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.412735:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae950d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.412906:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9506 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x204:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca158 expref: 279 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.412927:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae950d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca158 expref: 278 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.412936:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:2.0:1763343041.412940:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343041.412943:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d800, rc 0) 00000100:00100000:2.0:1763343041.413024:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+278:55941:x1848997993737216:12345-192.168.204.21@tcp:101:bash.0 Request processed in 466us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.413032:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9763 00000100:00100000:3.0:1763343041.418839:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.418894:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.419227:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993737728 00000100:00100000:2.0:1763343041.419244:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993737728 00000100:00100000:1.0:1763343041.419544:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993737472 00000100:00100000:1.0:1763343041.419550:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993737472 00000100:00100000:1.0:1763343041.419612:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9764 00000100:00100000:1.0:1763343041.419653:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+279:56961:x1848997993737472:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343041.419682:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.419713:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9514 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca15f expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343041.419919:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9765 00000100:00100000:2.0:1763343041.419927:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3409a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+280:55941:x1848997993737728:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:2.0:1763343041.419963:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343041.419995:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8c00/0x607405d401ae94ea lrc: 0/0,0 mode: --/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca143 expref: 280 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.420017:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:2.0:1763343041.420023:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343041.420288:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae951b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.420305:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae951b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x204:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.420317:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae951b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x204:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:2.0:1763343041.420376:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940381 00000004:00010000:2.0:1763343041.420401:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008060e7ec reply state 0000000037156287 transno 8589940382 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae951b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x204:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.420415:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae951b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x204:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.420422:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:2.0:1763343041.420425:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343041.420429:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343041.420552:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3409a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:55941:x1848997993737728:12345-192.168.204.21@tcp:36:bash.0 Request processed in 624us (1730us total) trans 8589940382 rc 0/0 00000100:00100000:2.0:1763343041.420560:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9765 00000020:00080000:2.0:1763343041.420567:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763343041.421787:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9522 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.421822:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9522 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x204:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:1.0:1763343041.421835:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9522 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x204:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:1.0:1763343041.421852:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x204:0x0]: returning size 0 00010000:00010000:1.0:1763343041.421999:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9514 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x204:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca15f expref: 283 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.422018:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9522 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x204:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca15f expref: 282 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.422027:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:1.0:1763343041.422030:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763343041.422034:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d8000, rc 0) 00000100:00100000:1.0:1763343041.422109:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:56961:x1848997993737472:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2486us (3212us total) trans 8589940383 rc 0/0 00000100:00100000:1.0:1763343041.422119:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9764 00000100:00100000:0.0:1763343041.427211:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.427553:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993737856 00000100:00100000:2.0:1763343041.427569:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993737856 00000100:00100000:2.0:1763343041.427668:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9766 00000100:00100000:2.0:1763343041.427680:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:55941:x1848997993737856:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343041.427708:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.427739:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9530 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca166 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.427828:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9530 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca166 expref: 283 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.427845:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9530 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca166 expref: 283 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.427867:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:2.0:1763343041.427871:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343041.427875:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352de00, rc 0) 00000100:00100000:2.0:1763343041.427945:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:55941:x1848997993737856:12345-192.168.204.21@tcp:101:bash.0 Request processed in 266us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.427953:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9766 00000100:00100000:3.0:1763343041.429173:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.430191:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993737984 00000100:00100000:1.0:1763343041.430209:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993737984 00000100:00100000:1.0:1763343041.432466:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9767 00000100:00100000:1.0:1763343041.432500:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354134c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:56961:x1848997993737984:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343041.432537:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.432569:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9537 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca16d expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.432724:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9600/0x607405d401ae953e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.432743:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9600/0x607405d401ae953e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.432758:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9600/0x607405d401ae953e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343041.432793:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x204:0x0]: returning size 0 00000004:00200000:1.0:1763343041.432798:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343041.432835:0:28422:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9600/0x607405d401ae953e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.432868:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9537 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x204:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca16d expref: 285 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.432891:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9600/0x607405d401ae953e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca16d expref: 284 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.432901:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:1.0:1763343041.432905:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343041.432909:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9600, rc 0) 00000100:00100000:1.0:1763343041.433019:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354134c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+284:56961:x1848997993737984:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 535us (3856us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.433027:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9767 00000100:00100000:0.0:1763343041.434938:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.438086:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993738240 00000100:00100000:1.0:1763343041.438115:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993738240 00000100:00100000:1.0:1763343041.438221:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9768 00000100:00100000:1.0:1763343041.438235:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+284:55941:x1848997993738240:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343041.438282:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.438287:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1763343041.438330:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9530 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca166 expref: 284 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.438362:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9522 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x204:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca15f expref: 283 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.438376:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:1.0:1763343041.438382:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343041.438401:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9545 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca174 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.438473:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae954c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.438489:0:28422:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9600/0x607405d401ae953e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca16d expref: 283 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.438498:0:28422:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae954c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x204:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.438546:0:28422:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9600/0x607405d401ae953e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca16d expref: 283 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.438560:0:28422:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9600/0x607405d401ae953e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca16d expref: 283 pid: 28422 timeout: 1335 lvb_type: 0 00000100:00100000:1.0:1763343041.438576:0:28422:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010323840:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343041.438721:0:28422:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c780 going to sleep for 11 seconds 00000100:00100000:0.0:1763343041.441893:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.443153:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993738496 00000100:00100000:2.0:1763343041.443173:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993738496 00000100:00100000:2.0:1763343041.443259:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3342 00000100:00100000:2.0:1763343041.443280:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+284:56961:x1848997993738496:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343041.443824:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+285:56961:x1848997993738496:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 544us (1944us total) trans 8589940384 rc 0/0 00000100:00100000:2.0:1763343041.443833:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3342 00000100:00100000:1.0:1763343041.445661:0:28422:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:28422:1848998010323840:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343041.445707:0:28422:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae954c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x204:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000100:00100000:2.0:1763343041.445802:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.445891:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993738624 00000100:00100000:0.0:1763343041.445901:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993738624 00010000:00010000:0.0:1763343041.445946:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9600/0x607405d401ae953e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca16d expref: 285 pid: 28422 timeout: 1335 lvb_type: 0 00000100:00100000:0.0:1763343041.445990:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3224 00000100:00100000:0.0:1763343041.446000:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+285:2429:x1848997993738624:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343041.446021:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343041.446029:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9600/0x607405d401ae953e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca16d expref: 285 pid: 28422 timeout: 1335 lvb_type: 0 00010000:00010000:0.0:1763343041.446042:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9600/0x607405d401ae953e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca16d expref: 285 pid: 28422 timeout: 1335 lvb_type: 0 00010000:00010000:0.0:1763343041.446070:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9600/0x607405d401ae953e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca16d expref: 285 pid: 28422 timeout: 1335 lvb_type: 0 00010000:00010000:0.0:1763343041.446091:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:0.0:1763343041.446097:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae954c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x204:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343041.446108:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae954c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343041.446116:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae954c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 28422 initiator: MDT0 00010000:00010000:0.0:1763343041.446192:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343041.446261:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+284:2429:x1848997993738624:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 261us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343041.446279:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3224 00010000:00010000:3.0:1763343041.446558:0:28422:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae954c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.446566:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae954c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:3.0:1763343041.446960:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1546, 88 off129936 00000004:00080000:3.0:1763343041.446970:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1235114348778ns, next at 1235292259329ns, rc = 0 00000040:00080000:3.0:1763343041.447007:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1547, 88 off129936 00000004:00080000:3.0:1763343041.447012:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1235114391606ns, next at 1235292288054ns, rc = 0 00000040:00080000:3.0:1763343041.447034:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1548, 88 off130024 00000004:00080000:3.0:1763343041.447038:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1235114417727ns, next at 1235292288054ns, rc = 0 00000040:00080000:3.0:1763343041.447048:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1547, 88 off130024 00000004:00080000:3.0:1763343041.447051:0:28422:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1235114430638ns, next at 1235292259329ns, rc = 0 00000100:00100000:0.0:1763343041.450862:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.451194:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993738880 00000100:00100000:2.0:1763343041.451208:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993738880 00000100:00100000:2.0:1763343041.451558:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9769 00000100:00100000:2.0:1763343041.451570:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+285:56961:x1848997993738880:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.451601:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.451666:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9553 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca17b expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.451772:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae955a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.451789:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae955a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.451802:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae955a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.451826:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9561 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.451834:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9561 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.451840:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9561 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.451991:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9568 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452001:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9568 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452008:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9568 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:2.0:1763343041.452024:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x204:0x0]: returning size 2 00010000:00010000:2.0:1763343041.452143:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9568 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452152:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9568 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452159:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9568 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452165:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.452171:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9568 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452179:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9568 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452192:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:2.0:1763343041.452196:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1763343041.452202:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9568 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x204:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452209:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9568 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x204:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452230:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae955a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452236:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae955a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452241:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae955a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452251:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae955a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452255:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.452258:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae955a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452280:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae955a lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452287:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:2.0:1763343041.452290:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.452292:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae955a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452298:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae955a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452306:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9561 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452312:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9561 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452318:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9561 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452323:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.452325:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9561 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452330:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9561 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452341:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4a00) 00010000:00010000:2.0:1763343041.452343:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.452346:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9561 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452350:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae9561 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.452393:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9553 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca17b expref: 287 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.452403:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:2.0:1763343041.452406:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343041.452409:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9553 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca17b expref: 287 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.452422:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d600, rc 0) 00000100:00100000:2.0:1763343041.452516:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+286:56961:x1848997993738880:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 948us (1669us total) trans 8589940386 rc 301/301 00000100:00100000:2.0:1763343041.452526:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9769 00000001:00080000:1.0:1763343041.456310:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940385 is committed 00000004:00080000:1.0:1763343041.456328:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1018 committed 00000004:00080000:1.0:1763343041.456342:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1017 committed 00000004:00080000:1.0:1763343041.456358:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1016 committed 00000004:00080000:1.0:1763343041.456361:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1017 committed 00010000:00010000:0.0:1763343041.456822:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9418 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.456837:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9418 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.456846:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9418 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.456852:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343041.456857:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9418 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.456866:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9418 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.456892:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4a00) 00010000:00010000:0.0:1763343041.456895:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343041.456901:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9418 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.456908:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae9418 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.456933:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae94ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.456940:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae94ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.456945:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae94ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.456949:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343041.456952:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae94ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.456958:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae94ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.456964:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34039e4a00) 00010000:00010000:0.0:1763343041.456967:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343041.456969:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae94ab lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.456974:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae94ab lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:0.0:1763343041.456993:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae951b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x204:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.456999:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae951b lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x204:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.457004:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae951b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x204:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.457009:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343041.457011:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae951b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x204:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.457016:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae951b lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x204:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.457023:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:0.0:1763343041.457026:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343041.457028:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae951b lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x204:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343041.457033:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae951b lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x204:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343041.457286:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a354134d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010324096:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343041.457375:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343041.457420:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763343041.457426:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a354134c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010324224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343041.457449:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343041.457492:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010324096 00000100:00100000:3.0:1763343041.457501:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010324096 00000100:00100000:3.0:1763343041.457556:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010324224 00000100:00100000:3.0:1763343041.457559:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010324224 00000100:00100000:3.0:1763343041.457582:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6903 00000100:00100000:3.0:1763343041.457591:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3659:x1848998010324096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763343041.457648:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:724 count 1 00002000:00010000:3.0:1763343041.457691:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343041.457699:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae9576 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.457714:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343041.457716:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343041.457723:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae9576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.457738:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae9576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.457747:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae9576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.457754:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae9576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.457775:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343041.458075:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3659:x1848998010324096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 483us (697us total) trans 17179871762 rc 0/0 00000100:00100000:3.0:1763343041.458083:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6903 00000100:00100000:3.0:1763343041.458103:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6904 00000100:00100000:3.0:1763343041.458110:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3659:x1848998010324224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763343041.458223:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3659:x1848998010324224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (772us total) trans 17179871763 rc 0/0 00000100:00100000:3.0:1763343041.458230:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6904 00010000:00010000:3.0:1763343041.458256:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343041.458264:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae9576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.458272:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343041.458276:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae9576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.458289:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae9576 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.458306:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae9576 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.458313:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a3405de6200/0x607405d401ae9576 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.458328:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343041.458330:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343041.458332:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763343041.458372:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a354134c700/2, rc 0, transno 17179871763 00000100:00100000:3.0:1763343041.458379:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a354134c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010324224:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763343041.458390:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a354134d180/2, rc 0, transno 17179871762 00000100:00100000:3.0:1763343041.458393:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a354134d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010324096:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763343041.458464:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae954c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x204:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca174 expref: 266 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.458476:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:3.0:1763343041.458479:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343041.458496:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9545 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x204:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca174 expref: 266 pid: 28422 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763343041.458514:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae954c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x204:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca174 expref: 265 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.458552:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:3.0:1763343041.458555:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763343041.458558:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9200, rc 0) 00000100:00100000:3.0:1763343041.458616:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34035ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:55941:x1848997993738240:12345-192.168.204.21@tcp:101:bash.0 Request processed in 20384us (23693us total) trans 8589940385 rc 0/0 00000100:00100000:3.0:1763343041.458664:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9768 00000100:00100000:2.0:1763343041.459129:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010324736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343041.459181:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343041.459215:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763343041.459220:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010324608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343041.459242:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343041.459282:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010324736 00000100:00100000:2.0:1763343041.459290:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010324736 00000100:00100000:2.0:1763343041.459328:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010324608 00000100:00100000:2.0:1763343041.459332:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010324608 00000100:00100000:2.0:1763343041.459352:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6905 00000100:00100000:2.0:1763343041.459359:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3660:x1848998010324736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343041.459525:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3660:x1848998010324736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (342us total) trans 21474839060 rc 0/0 00000100:00100000:2.0:1763343041.459531:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6905 00000100:00100000:2.0:1763343041.459546:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6906 00000100:00100000:2.0:1763343041.459552:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3660:x1848998010324608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343041.459567:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:722 count 1 00002000:00010000:2.0:1763343041.459596:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343041.459603:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae957d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.459617:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.459655:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.459661:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae957d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.459675:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae957d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.459683:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae957d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.459690:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae957d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.459709:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343041.459880:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3660:x1848998010324608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 327us (636us total) trans 21474839061 rc 0/0 00000100:00100000:2.0:1763343041.459887:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6906 00000004:00080000:2.0:1763343041.459934:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537968700/2, rc 0, transno 21474839061 00000100:00100000:2.0:1763343041.459939:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537968700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010324608:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763343041.459950:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537969880/2, rc 0, transno 21474839060 00000100:00100000:2.0:1763343041.459953:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010324736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343041.460406:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010324352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343041.460451:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343041.460479:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010324864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343041.460501:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343041.460520:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1763343041.460528:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a354134dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010323968:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343041.460547:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343041.460563:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010324480:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763343041.460581:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1763343041.460603:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343041.460610:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae957d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.460637:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343041.460642:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae957d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.460651:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae957d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.460669:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae957d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.460677:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352dc00/0x607405d401ae957d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.460696:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343041.460698:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343041.460700:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343041.460711:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010324352 00000100:00100000:0.0:1763343041.460717:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010324352 00000100:00100000:0.0:1763343041.460746:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010324864 00000100:00100000:0.0:1763343041.460748:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010324864 00000100:00100000:0.0:1763343041.460762:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010323968 00000100:00100000:0.0:1763343041.460764:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010323968 00000100:00100000:0.0:1763343041.460776:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010324480 00000100:00100000:0.0:1763343041.460777:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010324480 00000100:00100000:0.0:1763343041.460792:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6907 00000100:00100000:0.0:1763343041.460797:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3657:x1848998010324352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763343041.460939:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2d6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343041.460943:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2d6:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343041.460945:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2d6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343041.460947:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2d6:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343041.460949:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2d6:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343041.460979:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3657:x1848998010324352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (527us total) trans 17179871764 rc 0/0 00000100:00100000:0.0:1763343041.460984:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6907 00000100:00100000:0.0:1763343041.461000:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6908 00000100:00100000:0.0:1763343041.461005:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3657:x1848998010324864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763343041.461064:0:27835:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343041.461067:0:27835:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d4:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343041.461069:0:27835:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343041.461071:0:27835:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d4:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343041.461073:0:27835:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d4:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343041.461095:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3657:x1848998010324864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (594us total) trans 21474839062 rc 0/0 00000100:00100000:0.0:1763343041.461101:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6908 00000100:00100000:0.0:1763343041.461112:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6909 00000100:00100000:0.0:1763343041.461117:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3657:x1848998010323968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343041.461128:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:723 count 1 00010000:00010000:0.0:1763343041.461143:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae9584 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.461159:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9e00/0x607405d401ae93e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0f6 expref: 23 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.461167:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343041.461169:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343041.461173:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae9584 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.461206:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9e00/0x607405d401ae93e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0f6 expref: 23 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.461222:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9e00/0x607405d401ae93e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0f6 expref: 23 pid: 28994 timeout: 1335 lvb_type: 0 00000100:00100000:0.0:1763343041.461235:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010324992:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343041.461309:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31c00 going to sleep for 11 seconds 00000100:00100000:0.0:1763343041.461333:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6910 00000100:00100000:0.0:1763343041.461341:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3657:x1848998010324480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763343041.461354:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:721 count 1 00010000:00010000:0.0:1763343041.461367:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae958b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.461381:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a35379c1800/0x607405d401ae940a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca104 expref: 17 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.461388:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343041.461390:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343041.461393:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae958b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.461420:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a35379c1800/0x607405d401ae940a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca104 expref: 17 pid: 28995 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.461429:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a35379c1800/0x607405d401ae940a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca104 expref: 17 pid: 28995 timeout: 1335 lvb_type: 0 00000100:00100000:0.0:1763343041.461441:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010325120:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343041.461467:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31780 going to sleep for 11 seconds 00000004:00080000:0.0:1763343041.461532:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a340c251f80/2, rc 0, transno 17179871764 00000100:00100000:0.0:1763343041.461539:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010324352:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343041.461554:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537968a80/2, rc 0, transno 21474839062 00000100:00100000:0.0:1763343041.461558:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010324864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343041.469260:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.469309:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.469842:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993739136 00000100:00100000:2.0:1763343041.469857:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993739136 00000100:00100000:2.0:1763343041.469933:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3343 00000100:00100000:2.0:1763343041.469945:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:56961:x1848997993739136:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343041.470245:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56961:x1848997993739136:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 301us (999us total) trans 8589940387 rc 0/0 00000100:00100000:2.0:1763343041.470253:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3343 00000100:00100000:1.0:1763343041.470721:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993739264 00000100:00100000:1.0:1763343041.470729:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993739264 00000100:00100000:1.0:1763343041.470782:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6911 00000100:00100000:1.0:1763343041.470790:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:55941:x1848997993739264:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343041.470814:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.470844:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9592 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca182 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343041.470876:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343041.470900:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.470903:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.470915:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9592 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca182 expref: 19 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.470931:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9592 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca182 expref: 19 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.470943:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d8000, rc 0) 00000100:00100000:1.0:1763343041.470976:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:55941:x1848997993739264:12345-192.168.204.21@tcp:101:bash.0 Request processed in 188us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.470982:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6911 00000100:00100000:0.0:1763343041.473095:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.473198:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:27835:1848998010324992:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343041.473240:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae9584 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343041.473319:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010325120:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343041.473336:0:15756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae958b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343041.474079:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.474182:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993739392 00000100:00100000:2.0:1763343041.474193:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993739392 00000100:00100000:3.0:1763343041.474224:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993739520 00000100:00100000:3.0:1763343041.474228:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993739520 00010000:00010000:2.0:1763343041.474250:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9e00/0x607405d401ae93e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0f6 expref: 24 pid: 28994 timeout: 1335 lvb_type: 0 00000100:00100000:2.0:1763343041.474294:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3225 00000100:00100000:2.0:1763343041.474304:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2429:x1848997993739392:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343041.474328:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343041.474334:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9e00/0x607405d401ae93e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0f6 expref: 24 pid: 28994 timeout: 1335 lvb_type: 0 00010000:00010000:2.0:1763343041.474347:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9e00/0x607405d401ae93e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0f6 expref: 24 pid: 28994 timeout: 1335 lvb_type: 0 00010000:00010000:2.0:1763343041.474377:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9e00/0x607405d401ae93e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca0f6 expref: 24 pid: 28994 timeout: 1335 lvb_type: 0 00010000:00010000:2.0:1763343041.474397:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.474400:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.474405:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae9584 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.474418:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae9584 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.474458:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343041.474521:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2429:x1848997993739392:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 217us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.474530:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3225 00010000:00010000:2.0:1763343041.474566:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a35379c1800/0x607405d401ae940a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca104 expref: 19 pid: 28995 timeout: 1335 lvb_type: 0 00000100:00100000:2.0:1763343041.474599:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3226 00000100:00100000:2.0:1763343041.474607:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993739520:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343041.474643:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343041.474649:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a35379c1800/0x607405d401ae940a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca104 expref: 19 pid: 28995 timeout: 1335 lvb_type: 0 00010000:00010000:2.0:1763343041.474659:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a35379c1800/0x607405d401ae940a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca104 expref: 19 pid: 28995 timeout: 1335 lvb_type: 0 00010000:00010000:3.0:1763343041.474675:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae9584 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.474675:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a35379c1800/0x607405d401ae940a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca104 expref: 19 pid: 28995 timeout: 1335 lvb_type: 0 00010000:00010000:3.0:1763343041.474685:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae9584 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.474687:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.474689:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.474692:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae958b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.474697:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae9584 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.474700:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae958b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.474706:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae9584 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.474720:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343041.474725:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343041.474739:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993739520:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 133us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.474746:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3226 00010000:00010000:2.0:1763343041.474764:0:15756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae958b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.474772:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae958b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.474784:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae958b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.474790:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae958b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.474801:0:15756:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343041.475009:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3657:x1848998010323968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13890us (14459us total) trans 17179871765 rc 0/0 00000100:00100000:3.0:1763343041.475017:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6909 00010000:00010000:3.0:1763343041.475042:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763343041.475049:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae9584 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.475058:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dda00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343041.475064:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae9584 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.475074:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae9584 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.475087:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae9584 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.475095:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae9584 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.475114:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343041.475118:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae958b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.475123:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343041.475126:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae958b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.475133:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae958b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.475141:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae958b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.475153:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dd800/0x607405d401ae958b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.475166:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343041.475168:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343041.475170:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343041.475229:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343041.476216:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3657:x1848998010324480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14869us (15626us total) trans 21474839063 rc 0/0 00000100:00100000:2.0:1763343041.476229:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6910 00000004:00080000:3.0:1763343041.476711:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a354134dc00/2, rc 0, transno 17179871765 00000100:00100000:3.0:1763343041.476720:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a354134dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010323968:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763343041.476744:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3537969180/2, rc 0, transno 21474839063 00000100:00100000:3.0:1763343041.476748:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537969180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010324480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343041.476768:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.476799:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993739648 00000100:00100000:3.0:1763343041.476897:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993739648 00000100:00100000:2.0:1763343041.476971:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.476998:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3344 00000100:00100000:3.0:1763343041.477008:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56961:x1848997993739648:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:0.0:1763343041.477188:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993739776 00000100:00100000:0.0:1763343041.477193:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993739776 00000100:00100000:3.0:1763343041.477216:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56961:x1848997993739648:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 209us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343041.477224:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3344 00000100:00100000:0.0:1763343041.477279:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6912 00000100:00100000:0.0:1763343041.477287:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:55941:x1848997993739776:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343041.477300:0:15756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343041.477327:0:15756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae9599 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca189 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343041.477357:0:15756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1763343041.477379:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.477381:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.477392:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae9599 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca189 expref: 24 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.477409:0:15756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae9599 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca189 expref: 24 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.477423:0:15756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058ddc00, rc 0) 00000100:00100000:0.0:1763343041.477446:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:55941:x1848997993739776:12345-192.168.204.21@tcp:101:bash.0 Request processed in 160us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343041.477452:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6912 00000100:00100000:0.0:1763343041.482216:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.482274:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.482574:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993739904 00000100:00100000:1.0:1763343041.482588:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993739904 00000100:00100000:3.0:1763343041.482702:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993740032 00000100:00100000:3.0:1763343041.482706:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993740032 00002000:00010000:1.0:1763343041.482802:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/723 (0->18446744073709551615) 00002000:00100000:1.0:1763343041.482816:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34050f5180 with x1848997993739904 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343041.482832:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34050f5180. 00000100:00100000:1.0:1763343041.482869:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1670 00000100:00100000:1.0:1763343041.482880:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2432:x1848997993739904:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:1.0:1763343041.483107:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343041.483111:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d3:0x0] updating lvb mtime from disk: 0 -> 1763343041 00002000:00010000:1.0:1763343041.483114:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343041.483117:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d3:0x0] updating lvb ctime from disk: 0 -> 1763343041 00002000:00010000:1.0:1763343041.483119:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d3:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343041.483195:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2432:x1848997993739904:12345-192.168.204.21@tcp:10:bash.0 Request processed in 317us (1240us total) trans 21474839064 rc 0/0 00000100:00100000:1.0:1763343041.483204:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1670 00002000:00010000:1.0:1763343041.483208:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/723 (0->18446744073709551615) 00002000:00100000:1.0:1763343041.483211:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34050f5180 with x1848997993739904 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343041.483215:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34050f5180. 00002000:00010000:3.0:1763343041.483742:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/725 (0->18446744073709551615) 00002000:00100000:3.0:1763343041.483748:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34050f6d80 with x1848997993740032 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343041.483757:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34050f6d80. 00000100:00100000:3.0:1763343041.483784:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1671 00000100:00100000:3.0:1763343041.483795:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2432:x1848997993740032:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:3.0:1763343041.483966:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2d5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343041.483970:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2d5:0x0] updating lvb mtime from disk: 0 -> 1763343041 00002000:00010000:3.0:1763343041.483973:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2d5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343041.483975:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2d5:0x0] updating lvb ctime from disk: 0 -> 1763343041 00002000:00010000:3.0:1763343041.483978:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2d5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343041.484017:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2432:x1848997993740032:12345-192.168.204.21@tcp:10:bash.0 Request processed in 225us (1742us total) trans 17179871766 rc 0/0 00000100:00100000:3.0:1763343041.484025:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1671 00002000:00010000:3.0:1763343041.484028:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/725 (0->18446744073709551615) 00002000:00100000:3.0:1763343041.484031:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34050f6d80 with x1848997993740032 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343041.484036:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34050f6d80. 00000100:00100000:0.0:1763343041.489290:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.489440:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993740288 00000100:00100000:3.0:1763343041.489458:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993740288 00000100:00100000:3.0:1763343041.489749:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3345 00000100:00100000:3.0:1763343041.489763:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:55941:x1848997993740288:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:3.0:1763343041.490253:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:55941:x1848997993740288:12345-192.168.204.21@tcp:35:bash.0 Request processed in 488us (990us total) trans 8589940388 rc 0/0 00000100:00100000:3.0:1763343041.490277:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3345 00000100:00100000:0.0:1763343041.492941:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.493717:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993740544 00000100:00100000:3.0:1763343041.493736:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993740544 00000100:00100000:3.0:1763343041.493838:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9770 00000100:00100000:3.0:1763343041.493851:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56962:x1848997993740544:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343041.493886:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343041.493925:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae95a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca190 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.494059:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae95a7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494080:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae95a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494095:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae95a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494111:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95ae lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494117:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494123:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494315:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae95b5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494327:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae95b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494334:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae95b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:3.0:1763343041.494347:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x204:0x0]: returning size 5 00010000:00010000:3.0:1763343041.494490:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae95a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494499:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae95a7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494511:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae95a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494517:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343041.494522:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae95a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494531:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae95a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494547:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616900) 00010000:00010000:3.0:1763343041.494551:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.494557:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae95a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494564:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae95a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494581:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494587:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494593:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494597:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343041.494599:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494605:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494616:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3404616b00) 00010000:00010000:3.0:1763343041.494670:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.494674:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95ae lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494681:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95ae lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.494742:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae95a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca190 expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.494761:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae95b5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca190 expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.494768:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:3.0:1763343041.494770:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343041.494773:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6800, rc 0) 00000100:00100000:3.0:1763343041.495376:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56962:x1848997993740544:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1522us (2444us total) trans 8589940389 rc 0/0 00000100:00100000:3.0:1763343041.495388:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9770 00000100:00100000:0.0:1763343041.498572:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.498674:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993740800 00000100:00100000:3.0:1763343041.498690:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993740800 00000100:00100000:3.0:1763343041.498778:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3346 00000100:00100000:3.0:1763343041.498791:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56962:x1848997993740800:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343041.499311:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56962:x1848997993740800:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 520us (751us total) trans 8589940390 rc 0/0 00000100:00100000:3.0:1763343041.499321:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3346 00000100:00100000:0.0:1763343041.500536:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.500690:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993741056 00000100:00100000:3.0:1763343041.500702:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993741056 00000100:00100000:2.0:1763343041.500849:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9771 00000100:00100000:2.0:1763343041.500860:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56963:x1848997993741056:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:2.0:1763343041.500925:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763343041.500962:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9200/0x607405d401ae954c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x204:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca174 expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.500988:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae95b5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca190 expref: 269 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.501004:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae950d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x204:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca158 expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.501016:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a3403bdc700) 00010000:00010000:2.0:1763343041.501030:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343041.501066:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae95c3 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501080:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae95c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501090:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae95c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501101:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae95ca lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501107:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae95ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501113:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae95ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501218:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae95d1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501228:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae95d1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501235:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae95d1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000040:00080000:2.0:1763343041.501558:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1548, 64 off130088 00000040:00080000:2.0:1763343041.501586:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1549, 64 off130088 00000040:00080000:2.0:1763343041.501596:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1550, 64 off130152 00000040:00080000:2.0:1763343041.501605:0:28422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1549, 64 off130152 00010000:00010000:2.0:1763343041.501703:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae95d8 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x204:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501714:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae95d8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501723:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae95d8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501731:0:28422:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae95d8 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501737:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae95d8 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501742:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae95d8 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x204:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501764:0:28422:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763343041.501786:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae95d1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501791:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae95d1 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501797:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae95d1 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501803:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.501818:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae95d1 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501827:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae95d1 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x204:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501837:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a34037bc100) 00010000:00010000:2.0:1763343041.501840:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763343041.501844:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae95d1 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x204:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501856:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae95d1 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x204:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.501995:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae95c3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.502001:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae95c3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.502007:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae95c3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.502012:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.502015:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae95c3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.502020:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae95c3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.502028:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:2.0:1763343041.502030:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.502034:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae95c3 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.502040:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae95c3 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:2.0:1763343041.502053:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a4329d77 reply state 000000009a08499a transno 8589940391 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae95ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.502065:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae95ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.502071:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc700) 00010000:00010000:2.0:1763343041.502074:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343041.502076:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763343041.502311:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343041.502319:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae95d8 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.502326:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343041.502330:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae95d8 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.502336:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae95d8 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.502345:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x204:0x0].0x0 (ffff9a34037bc100) 00010000:00010000:3.0:1763343041.502348:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343041.502351:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae95d8 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.502356:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae95d8 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.502370:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343041.502372:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343041.502373:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343041.502933:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56963:x1848997993741056:12345-192.168.204.21@tcp:36:rm.0 Request processed in 2066us (2397us total) trans 8589940391 rc 0/0 00000100:00100000:2.0:1763343041.502944:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9771 00000100:00100000:0.0:1763343041.506923:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.507029:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993741184 00000100:00100000:2.0:1763343041.507042:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993741184 00000100:00100000:2.0:1763343041.507119:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9772 00000100:00100000:2.0:1763343041.507131:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3507843050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56962:x1848997993741184:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.507166:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.507197:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae95df lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca197 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.507300:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae95e6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507316:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae95e6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507330:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae95e6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507341:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae95ed lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507348:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae95ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507355:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae95ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507410:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae95e6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507419:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae95e6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507425:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae95e6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507432:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.507437:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae95e6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507446:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae95e6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507460:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343041.507463:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.507468:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae95e6 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507475:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae95e6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507490:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae95ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507497:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae95ed lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507502:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae95ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507507:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.507510:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae95ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507520:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae95ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507528:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc700) 00010000:00010000:2.0:1763343041.507530:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.507533:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae95ed lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507538:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae95ed lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.507570:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae95df lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca197 expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.507582:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343041.507584:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.507588:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae95df lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca197 expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.507605:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:2.0:1763343041.507724:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3507843050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56962:x1848997993741184:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 594us (815us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343041.507733:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9772 00000100:00100000:1.0:1763343041.525658:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.525794:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993741440 00000100:00100000:3.0:1763343041.525817:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993741440 00000100:00100000:3.0:1763343041.525900:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9773 00000100:00100000:3.0:1763343041.525913:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56965:x1848997993741440:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343041.525943:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343041.525974:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae95f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca19e expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.526081:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95fb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526097:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526111:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95fb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526123:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9602 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526131:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9602 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526138:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9602 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526187:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95fb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526194:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95fb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526199:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95fb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526205:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95fb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526211:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343041.526215:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95fb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526227:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95fb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526240:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616900) 00010000:00010000:3.0:1763343041.526243:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.526248:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95fb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526255:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae95fb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526271:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9602 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526277:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9602 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526283:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9602 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526287:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343041.526290:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9602 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526296:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9602 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526304:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc700) 00010000:00010000:3.0:1763343041.526306:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.526309:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9602 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526314:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9602 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.526348:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae95f4 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca19e expref: 270 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.526360:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616900) 00010000:00010000:3.0:1763343041.526362:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343041.526366:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae95f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca19e expref: 270 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.526380:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6200, rc 0) 00000100:00100000:3.0:1763343041.526458:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56965:x1848997993741440:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 548us (849us total) trans 0 rc 301/301 00000100:00100000:3.0:1763343041.526466:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9773 00000100:00100000:0.0:1763343041.534079:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.534375:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993741568 00000100:00100000:3.0:1763343041.534388:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993741568 00000100:00100000:3.0:1763343041.534463:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9774 00000100:00100000:3.0:1763343041.534473:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56964:x1848997993741568:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343041.534499:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343041.534530:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9609 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca1a5 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.535525:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9610 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.535550:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9610 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.535564:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9610 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.535584:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9617 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.535591:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9617 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:3.0:1763343041.535597:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9617 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.536380:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9610 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.536393:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9610 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.536401:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9610 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.536409:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.536415:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9610 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.536424:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9610 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.536442:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616b00) 00010000:00010000:2.0:1763343041.536446:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.536452:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9610 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.536458:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9610 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.536472:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9617 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.536478:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9617 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.536482:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9617 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.536487:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.536490:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9617 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.536495:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9617 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.536502:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc700) 00010000:00010000:2.0:1763343041.536504:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.536508:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9617 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.536514:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9617 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.536557:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9609 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1a5 expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.536569:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616b00) 00010000:00010000:2.0:1763343041.536571:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.536575:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae9609 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1a5 expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.536590:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7c00, rc 0) 00000100:00100000:2.0:1763343041.536735:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56964:x1848997993741568:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 2259us (2666us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343041.536745:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9774 00000100:00100000:0.0:1763343041.542155:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.542290:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993741696 00000100:00100000:2.0:1763343041.542305:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993741696 00000100:00100000:2.0:1763343041.542390:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9775 00000100:00100000:2.0:1763343041.542403:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56965:x1848997993741696:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.542432:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.542462:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae961e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca1ac expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.542562:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9625 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542580:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9625 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542596:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9625 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542609:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae962c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542617:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae962c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542668:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae962c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542721:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9625 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542729:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9625 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542736:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9625 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542743:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.542748:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9625 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542757:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9625 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542771:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343041.542775:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.542781:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9625 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542789:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9625 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542818:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae962c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542824:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae962c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542830:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae962c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542835:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.542837:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae962c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542843:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae962c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542850:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc700) 00010000:00010000:2.0:1763343041.542853:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.542856:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae962c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542861:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae962c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.542897:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae961e lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1ac expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.542908:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343041.542910:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.542914:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae961e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1ac expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.542934:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:2.0:1763343041.543029:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56965:x1848997993741696:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 628us (889us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343041.543038:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9775 00000100:00100000:3.0:1763343041.548505:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.549071:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993741824 00000100:00100000:0.0:1763343041.549086:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993741824 00000100:00100000:0.0:1763343041.549171:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9776 00000100:00100000:0.0:1763343041.549183:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56964:x1848997993741824:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343041.549210:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343041.549244:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae9633 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca1b3 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.549334:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae963a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549352:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae963a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549367:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae963a lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549382:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9641 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549390:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9641 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549397:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9641 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549448:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae963a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549456:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae963a lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549463:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae963a lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549470:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae963a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549476:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dda00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343041.549482:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae963a lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549491:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae963a lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549504:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4a00) 00010000:00010000:0.0:1763343041.549508:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343041.549513:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae963a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549520:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae963a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549537:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9641 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549542:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9641 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549548:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9641 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549554:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343041.549556:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9641 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549562:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9641 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549569:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc700) 00010000:00010000:0.0:1763343041.549572:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343041.549575:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9641 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549585:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9641 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343041.549617:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae9633 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1b3 expref: 270 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.549677:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34039e4a00) 00010000:00010000:0.0:1763343041.549680:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343041.549684:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae9633 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1b3 expref: 270 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.549698:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc000, rc 0) 00000100:00100000:0.0:1763343041.549774:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56964:x1848997993741824:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 594us (1283us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343041.549783:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9776 00000100:00100000:1.0:1763343041.558261:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.558359:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993741952 00000100:00100000:2.0:1763343041.558373:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993741952 00000100:00100000:2.0:1763343041.558450:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9777 00000100:00100000:2.0:1763343041.558462:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:56964:x1848997993741952:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.558490:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.558521:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae9648 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca1ba expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.558606:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae964f lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.558670:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae964f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.558685:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae964f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343041.558753:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1763343041.558760:0:28422:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1763343041.558814:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae9648 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1ba expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.558836:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae964f lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1ba expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.558850:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343041.558854:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1763343041.558858:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d600, rc 0) 00000100:00100000:2.0:1763343041.558940:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56964:x1848997993741952:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 479us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.558948:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9777 00000100:00100000:1.0:1763343041.564295:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.565348:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993742208 00000100:00100000:0.0:1763343041.565365:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993742208 00000100:00100000:2.0:1763343041.565592:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9778 00000100:00100000:2.0:1763343041.565607:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56966:x1848997993742208:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.565660:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.565690:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9656 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca1c1 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.565790:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae965d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.565819:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae965d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.565834:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae965d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.565845:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9664 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.565853:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9664 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.565859:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9664 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.565918:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae965d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.565925:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae965d lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.565932:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae965d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.565938:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.565943:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae965d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.565951:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae965d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.565964:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343041.565968:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.565973:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae965d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.565979:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae965d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.565994:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9664 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.566000:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9664 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.566005:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9664 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.566009:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.566012:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9664 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.566017:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9664 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.566022:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc700) 00010000:00010000:2.0:1763343041.566025:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.566027:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9664 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.566032:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae9664 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.566065:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9656 lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1c1 expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.566076:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343041.566078:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343041.566081:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9656 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1c1 expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.566090:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352ce00, rc 0) 00000100:00100000:2.0:1763343041.566243:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56966:x1848997993742208:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 637us (1959us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343041.566252:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9778 00000100:00100000:3.0:1763343041.572364:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.572659:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993742336 00000100:00100000:2.0:1763343041.572672:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993742336 00000100:00100000:2.0:1763343041.572738:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9779 00000100:00100000:2.0:1763343041.572749:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56964:x1848997993742336:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.572778:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.572817:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae966b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca1c8 expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.572907:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9672 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.572925:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9672 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.572938:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9672 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.572950:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9679 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.572958:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9679 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.572965:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9679 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.573014:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9672 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.573022:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9672 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.573029:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9672 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.573037:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.573041:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9672 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.573053:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9672 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.573067:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343041.573072:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.573077:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9672 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.573084:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9672 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.573101:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9679 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.573107:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9679 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.573113:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9679 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.573118:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.573120:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9679 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.573126:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9679 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.573134:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc700) 00010000:00010000:2.0:1763343041.573136:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.573139:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9679 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.573145:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9679 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.573178:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae966b lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1c8 expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.573189:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343041.573192:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.573195:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae966b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1c8 expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.573205:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d800, rc 0) 00000100:00100000:2.0:1763343041.573294:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56964:x1848997993742336:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 546us (944us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343041.573301:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9779 00000100:00100000:1.0:1763343041.582305:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.582578:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993742592 00000100:00100000:0.0:1763343041.582595:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993742592 00000100:00100000:2.0:1763343041.582830:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9780 00000100:00100000:2.0:1763343041.582845:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:56964:x1848997993742592:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.582876:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.582880:0:28422:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343041.582915:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae964f lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1ba expref: 270 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.582940:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343041.582953:0:28422:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343041.582972:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9680 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca1cf expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.583112:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9687 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583131:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9687 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583141:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9687 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583152:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae968e lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583158:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae968e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583164:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae968e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583732:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9695 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583744:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9695 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583753:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9695 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:2.0:1763343041.583763:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x205:0x0]: returning size 0 00010000:00010000:2.0:1763343041.583795:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9687 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583835:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9687 lrc: 2/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583843:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9687 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583849:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.583854:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9687 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583863:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9687 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583874:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:2.0:1763343041.583877:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.583882:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9687 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583888:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9687 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00000004:00010000:2.0:1763343041.583900:0:28422:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000735343b3 reply state 000000000686a8df transno 8589940392 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae968e lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583911:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae968e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.583917:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc700) 00010000:00010000:2.0:1763343041.583920:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343041.583923:0:28422:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343041.583958:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae9680 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1cf expref: 272 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.583977:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9695 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1cf expref: 271 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.583984:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bc300) 00010000:00010000:2.0:1763343041.583986:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343041.583989:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352ce00, rc 0) 00000100:00100000:2.0:1763343041.584086:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56964:x1848997993742592:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1244us (1798us total) trans 8589940392 rc 0/0 00000100:00100000:2.0:1763343041.584097:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9780 00000100:00100000:1.0:1763343041.590986:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.591067:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993743104 00000100:00100000:2.0:1763343041.591083:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993743104 00000100:00100000:2.0:1763343041.591181:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9781 00000100:00100000:2.0:1763343041.591194:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:56967:x1848997993743104:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.591232:0:28422:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.591262:0:28422:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae96a3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca1dd expref: -99 pid: 28422 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343041.593036:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.593113:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993742976 00000100:00100000:3.0:1763343041.593125:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993742976 00000100:00100000:3.0:1763343041.593186:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9782 00000100:00100000:3.0:1763343041.593195:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:56964:x1848997993742976:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343041.593220:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343041.593242:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae96aa lrc: 2/0,0 mode: --/CR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca1d6 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.593390:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae96b1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.593408:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9695 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1cf expref: 274 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.593420:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae96b1 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.593467:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9695 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1cf expref: 274 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.593488:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9695 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1cf expref: 274 pid: 28422 timeout: 1335 lvb_type: 0 00000100:00100000:3.0:1763343041.593504:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340c253480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010325248:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343041.593647:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340108c180 going to sleep for 11 seconds 00010000:00010000:1.0:1763343041.593977:0:28422:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae96b8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.593988:0:28422:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae96b8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.594000:0:28422:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae96b8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 28422 initiator: MDT0 00000004:00200000:1.0:1763343041.594669:0:28422:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x205:0x0]: returning size 0 00010000:00010000:1.0:1763343041.594783:0:28422:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae96b8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.594791:0:28422:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae96b8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.594797:0:28422:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae96b8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.594814:0:28422:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343041.594819:0:28422:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae96b8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.594827:0:28422:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae96b8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.594842:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bc300) 00010000:00010000:1.0:1763343041.594845:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763343041.594850:0:28422:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae96b8 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.594856:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae96b8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:1.0:1763343041.594909:0:28422:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae96a3 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x205:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1dd expref: 276 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.594917:0:28422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bc300) 00010000:00010000:1.0:1763343041.594919:0:28422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763343041.594923:0:28422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae96a3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x205:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1dd expref: 276 pid: 28422 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.594939:0:28422:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d600, rc 0) 00000100:00100000:1.0:1763343041.595012:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:56967:x1848997993743104:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3821us (4042us total) trans 8589940393 rc 301/301 00000100:00100000:1.0:1763343041.595022:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9781 00000100:00100000:1.0:1763343041.599799:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.599852:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.600028:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993743488 00000100:00100000:0.0:1763343041.600042:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993743488 00000100:00100000:0.0:1763343041.600162:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3347 00000100:00100000:0.0:1763343041.600174:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:56967:x1848997993743488:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343041.600451:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:56967:x1848997993743488:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 279us (597us total) trans 8589940394 rc 0/0 00000100:00100000:0.0:1763343041.600459:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3347 00000100:00100000:3.0:1763343041.600727:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340c253480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010325248:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343041.600758:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae96b1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:2.0:1763343041.602661:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993743232 00000100:00100000:2.0:1763343041.602679:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993743232 00010000:00010000:2.0:1763343041.602734:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9695 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1cf expref: 276 pid: 28422 timeout: 1335 lvb_type: 0 00000100:00100000:2.0:1763343041.602777:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3227 00000100:00100000:2.0:1763343041.602785:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35084c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:2429:x1848997993743232:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343041.602811:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343041.602819:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9695 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1cf expref: 276 pid: 28422 timeout: 1335 lvb_type: 0 00010000:00010000:2.0:1763343041.602833:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9695 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1cf expref: 276 pid: 28422 timeout: 1335 lvb_type: 0 00010000:00010000:2.0:1763343041.602861:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9695 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1cf expref: 276 pid: 28422 timeout: 1335 lvb_type: 0 00010000:00010000:2.0:1763343041.602879:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bc300) 00010000:00010000:2.0:1763343041.602885:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae96b1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.602896:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae96b1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.602903:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae96b1 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.602936:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343041.603006:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35084c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:2429:x1848997993743232:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 221us (3221us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.603020:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3227 00010000:00010000:3.0:1763343041.603216:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae96b1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343041.603225:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae96b1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:3.0:1763343041.603256:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x205:0x0]: returning size 0 00000100:00100000:2.0:1763343041.603693:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000004:00080000:3.0:1763343041.603745:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2d7:0x0], index 1: 0 00000004:00080000:2.0:1763343041.603917:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2d5:0x0], index 0: 0 00000004:00080000:2.0:1763343041.603933:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2d6:0x0], index 0: 0 00000004:00080000:2.0:1763343041.603938:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2d8:0x0], index 1: 0 00010000:00010000:2.0:1763343041.604083:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae96b1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.604093:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae96b1 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.604100:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae96b1 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.604107:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.604111:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae96b1 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.604119:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae96b1 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.604138:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bc300) 00010000:00010000:2.0:1763343041.604141:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343041.604146:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae96b1 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.604151:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae96b1 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343041.604209:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae96aa lrc: 1/0,0 mode: --/CR res: [0x200000405:0x205:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1d6 expref: 275 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.604220:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bc300) 00010000:00010000:2.0:1763343041.604222:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343041.604226:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae96aa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x205:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1d6 expref: 275 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.604243:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6600, rc 0) 00000100:00100000:2.0:1763343041.604303:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:56964:x1848997993742976:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 11108us (11279us total) trans 8589940395 rc 301/301 00000100:00100000:2.0:1763343041.604312:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9782 00000100:00100000:2.0:1763343041.604336:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993743744 00000100:00100000:2.0:1763343041.604342:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993743744 00000100:00100000:2.0:1763343041.604381:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9783 00000100:00100000:2.0:1763343041.604388:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:56967:x1848997993743744:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.604407:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.604425:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae96cd lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca1e4 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.604501:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae96d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604512:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae96d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604520:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae96d4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604529:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae96db lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604536:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae96db lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604541:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae96db lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604675:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae96e2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604682:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae96e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604688:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae96e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604748:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae96d4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604755:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae96d4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604761:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae96d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604768:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae96d4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604772:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.604775:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae96d4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604781:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae96d4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604790:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:2.0:1763343041.604793:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.604796:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae96d4 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604815:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae96d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604826:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae96db lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604831:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae96db lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604837:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae96db lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604842:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.604845:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae96db lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604851:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae96db lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604862:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc700) 00010000:00010000:2.0:1763343041.604865:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.604868:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae96db lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604872:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae96db lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.604899:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae96cd lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1e4 expref: 277 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.604915:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae96e2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1e4 expref: 276 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.604922:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343041.604925:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343041.604927:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352c800, rc 0) 00000100:00100000:2.0:1763343041.604970:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:56967:x1848997993743744:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 581us (1279us total) trans 8589940396 rc 0/0 00000100:00100000:2.0:1763343041.604977:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9783 00000100:00100000:3.0:1763343041.608322:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.610097:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993744000 00000100:00100000:1.0:1763343041.610120:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993744000 00000100:00100000:1.0:1763343041.610227:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3348 00000100:00100000:1.0:1763343041.610240:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:56964:x1848997993744000:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343041.610709:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:56964:x1848997993744000:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 470us (2401us total) trans 8589940397 rc 0/0 00000100:00100000:1.0:1763343041.610716:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3348 00000100:00100000:0.0:1763343041.615383:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.615442:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.615728:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993744128 00000100:00100000:2.0:1763343041.615742:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993744128 00000100:00100000:2.0:1763343041.615826:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6913 00000100:00100000:2.0:1763343041.615837:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2432:x1848997993744128:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343041.615862:0:15756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.615894:0:15756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae96f0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca1eb expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343041.615932:0:15756:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343041.615958:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.615961:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.615975:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae96f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1eb expref: 26 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343041.615997:0:15756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae96f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1eb expref: 26 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343041.616014:0:15756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352ce00, rc 0) 00000100:00100000:2.0:1763343041.616082:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2432:x1848997993744128:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 247us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.616090:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6913 00000100:00100000:3.0:1763343041.616488:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993744384 00000100:00100000:3.0:1763343041.616495:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993744384 00000100:00100000:3.0:1763343041.616544:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3349 00000100:00100000:3.0:1763343041.616552:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:56964:x1848997993744384:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343041.618032:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+278:56964:x1848997993744384:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1469us (2577us total) trans 8589940398 rc 0/0 00000100:00100000:3.0:1763343041.618047:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3349 00000100:00100000:0.0:1763343041.621135:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.624255:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993744640 00000100:00100000:1.0:1763343041.624278:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993744640 00000100:00100000:1.0:1763343041.624374:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3350 00000100:00100000:1.0:1763343041.624395:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+278:56967:x1848997993744640:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343041.624741:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+279:56967:x1848997993744640:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 348us (3620us total) trans 8589940399 rc 0/0 00000100:00100000:1.0:1763343041.624749:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3350 00000100:00100000:0.0:1763343041.626655:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.627537:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993744896 00000100:00100000:1.0:1763343041.627551:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993744896 00000100:00100000:2.0:1763343041.628393:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9784 00000100:00100000:2.0:1763343041.628414:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+279:55941:x1848997993744896:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343041.628447:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.628451:0:10041:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343041.628486:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae96e2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1e4 expref: 279 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.628510:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bcf00) 00010000:00010000:2.0:1763343041.628526:0:10041:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343041.628546:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae96f7 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca1f2 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.628868:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae96fe lrc: 3/0,1 mode: --/CW res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.628886:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae96fe lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x205:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:2.0:1763343041.628899:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae96fe lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x205:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00000004:00200000:2.0:1763343041.628916:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x205:0x0]: returning size 0 00010000:00010000:2.0:1763343041.629072:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae96f7 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x205:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1f2 expref: 281 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.629091:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae96fe lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x205:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1f2 expref: 280 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.629100:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:2.0:1763343041.629104:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:2.0:1763343041.629106:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d400, rc 0) 00000100:00100000:2.0:1763343041.629211:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+280:55941:x1848997993744896:12345-192.168.204.21@tcp:101:bash.0 Request processed in 803us (2596us total) trans 8589940400 rc 0/0 00000100:00100000:2.0:1763343041.629222:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9784 00000100:00100000:0.0:1763343041.633364:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.633414:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.633597:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993745024 00000100:00100000:3.0:1763343041.633611:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993745024 00000100:00100000:3.0:1763343041.633744:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993745280 00000100:00100000:3.0:1763343041.633748:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993745280 00000100:00100000:3.0:1763343041.633781:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9785 00000100:00100000:3.0:1763343041.633792:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+281:55941:x1848997993745024:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:3.0:1763343041.633837:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343041.633866:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae970c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca1f9 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.633914:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9713 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.633932:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9713 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.633947:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9713 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634099:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7c00/0x607405d401ae970c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1f9 expref: 283 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.634122:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9713 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1f9 expref: 282 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.634132:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:3.0:1763343041.634135:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763343041.634142:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6200, rc 0) 00000100:00100000:3.0:1763343041.634213:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:55941:x1848997993745024:12345-192.168.204.21@tcp:101:bash.0 Request processed in 423us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343041.634221:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9785 00000100:00100000:3.0:1763343041.634245:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9786 00000100:00100000:3.0:1763343041.634253:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+281:56967:x1848997993745280:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343041.634261:0:10041:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343041.634286:0:10041:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae971a lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca200 expref: -99 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.634344:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9721 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634353:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9721 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634361:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9721 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634373:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9728 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634380:0:10041:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9728 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634387:0:10041:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9728 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634498:0:10041:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae972f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634510:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae972f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634517:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae972f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634523:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae972f lrc: 3/0,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634530:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343041.634535:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae972f lrc: 3/0,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634543:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae972f lrc: 4/0,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634552:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:3.0:1763343041.634558:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae972f lrc: 2/0,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634564:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae972f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00000004:00200000:3.0:1763343041.634578:0:10041:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x205:0x0]: returning size 0 00010000:00010000:3.0:1763343041.634722:0:10041:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9721 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634729:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9721 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634734:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9721 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634740:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9721 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634745:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343041.634748:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9721 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634754:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9721 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634766:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616900) 00010000:00010000:3.0:1763343041.634769:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.634772:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9721 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634778:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9721 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634787:0:10041:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9728 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634793:0:10041:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9728 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634798:0:10041:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9728 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634815:0:10041:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343041.634818:0:10041:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9728 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634824:0:10041:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9728 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634831:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc700) 00010000:00010000:3.0:1763343041.634833:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343041.634836:0:10041:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9728 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634842:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae9728 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10041 initiator: MDT0 00010000:00010000:3.0:1763343041.634877:0:10041:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae971a lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca200 expref: 283 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.634889:0:10041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3404616900) 00010000:00010000:3.0:1763343041.634891:0:10041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763343041.634894:0:10041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae971a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca200 expref: 283 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.634907:0:10041:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6800, rc 0) 00000100:00100000:3.0:1763343041.634941:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:56967:x1848997993745280:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 689us (1527us total) trans 8589940401 rc 301/301 00000100:00100000:3.0:1763343041.634949:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9786 00000100:00100000:0.0:1763343041.645002:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.645099:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993745536 00000100:00100000:3.0:1763343041.645113:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993745536 00000100:00100000:0.0:1763343041.648684:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3351 00000100:00100000:0.0:1763343041.648723:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:56967:x1848997993745536:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343041.649095:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:56967:x1848997993745536:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 391us (4106us total) trans 8589940402 rc 0/0 00000100:00100000:0.0:1763343041.649105:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3351 00000100:00100000:0.0:1763343041.653477:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.654637:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343041.656000:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993745664 00000100:00100000:2.0:1763343041.656019:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993745664 00000100:00100000:2.0:1763343041.656123:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3352 00000100:00100000:2.0:1763343041.656141:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:56967:x1848997993745664:12345-192.168.204.21@tcp:33:lfs.0 00000100:00100000:1.0:1763343041.656755:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993745920 00000100:00100000:1.0:1763343041.656763:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993745920 00000100:00100000:1.0:1763343041.656843:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9787 00000100:00100000:1.0:1763343041.656853:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+284:55941:x1848997993745920:12345-192.168.204.21@tcp:36:bash.0 00010000:00010000:1.0:1763343041.656896:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343041.656938:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae96fe lrc: 0/0,0 mode: --/CW res: [0x200000405:0x205:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1f2 expref: 284 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.656966:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:1.0:1763343041.656973:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343041.657197:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae973d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.657215:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae973d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x205:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.657226:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae973d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x205:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:1.0:1763343041.657296:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940403 00000004:00010000:1.0:1763343041.657322:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001e7e1346 reply state 000000008b210954 transno 8589940404 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae973d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x205:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.657335:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae973d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x205:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.657340:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:1.0:1763343041.657343:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343041.657346:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343041.657474:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+286:55941:x1848997993745920:12345-192.168.204.21@tcp:36:bash.0 Request processed in 620us (2858us total) trans 8589940404 rc 0/0 00000100:00100000:1.0:1763343041.657482:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9787 00000020:00080000:1.0:1763343041.657488:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343041.657612:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+285:56967:x1848997993745664:12345-192.168.204.21@tcp:33:lfs.0 Request processed in 1479us (4152us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.657644:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3352 00000100:00100000:3.0:1763343041.660564:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.660736:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993746048 00000100:00100000:1.0:1763343041.660751:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993746048 00000100:00100000:1.0:1763343041.660826:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9788 00000100:00100000:1.0:1763343041.660837:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+285:55941:x1848997993746048:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343041.660863:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.660894:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9744 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca207 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.660967:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9744 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca207 expref: 286 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.660983:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9744 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca207 expref: 286 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.661001:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:1.0:1763343041.661004:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343041.661008:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9400, rc 0) 00000100:00100000:1.0:1763343041.661080:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+286:55941:x1848997993746048:12345-192.168.204.21@tcp:101:bash.0 Request processed in 246us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.661088:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9788 00000100:00100000:0.0:1763343041.669592:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.669798:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993746304 00000100:00100000:1.0:1763343041.669821:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993746304 00000100:00100000:1.0:1763343041.669901:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9789 00000100:00100000:1.0:1763343041.669913:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+286:55941:x1848997993746304:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:1.0:1763343041.669947:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.669951:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343041.669988:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9744 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca207 expref: 286 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.670015:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:1.0:1763343041.670023:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343041.670039:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8e00/0x607405d401ae974b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca20e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.670100:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae9752 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.670116:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae9752 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.670127:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae9752 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000040:00080000:1.0:1763343041.670439:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1551, 88 off130240 00000004:00080000:1.0:1763343041.670449:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1235337827856ns, next at 1235292288054ns, rc = 0 00000040:00080000:1.0:1763343041.671994:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1550, 88 off130240 00000004:00080000:1.0:1763343041.672014:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1235339392875ns, next at 1235292259329ns, rc = 0 00000040:00080000:1.0:1763343041.672470:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1551, 88 off130328 00000004:00080000:1.0:1763343041.672477:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1235339855868ns, next at 1235292259329ns, rc = 0 00000040:00080000:1.0:1763343041.673533:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1552, 88 off130328 00000004:00080000:1.0:1763343041.673546:0:6525:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1235340925006ns, next at 1235292288054ns, rc = 0 00000001:00080000:3.0:1763343041.683311:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940405 is committed 00000004:00080000:3.0:1763343041.683332:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1019 committed 00000004:00080000:3.0:1763343041.683351:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1020 committed 00000004:00080000:3.0:1763343041.683369:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1019 committed 00000004:00080000:3.0:1763343041.683371:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1018 committed 00010000:00010000:2.0:1763343041.683398:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae95ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.683413:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae95ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.683422:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae95ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.683428:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.683434:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae95ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.683443:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae95ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.683464:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc700) 00010000:00010000:2.0:1763343041.683467:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.683473:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae95ca lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.683480:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae95ca lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.683514:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae968e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.683521:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae968e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.683527:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae968e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.683531:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.683534:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae968e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.683540:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae968e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.683546:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a34037bc700) 00010000:00010000:2.0:1763343041.683549:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.683552:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae968e lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.683557:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae968e lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28422 initiator: MDT0 00010000:00010000:2.0:1763343041.683575:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae973d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x205:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.683581:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae973d lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x205:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.683586:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae973d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x205:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.683591:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343041.683593:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae973d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x205:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.683597:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae973d lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x205:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.683604:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:2.0:1763343041.683607:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343041.683609:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae973d lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x205:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343041.683615:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae973d lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x205:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000100:00100000:2.0:1763343041.683951:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010325376:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343041.684040:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343041.684096:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763343041.684104:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010325760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343041.684127:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343041.684157:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010325504:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343041.684179:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343041.684194:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763343041.684198:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010325632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343041.684213:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343041.684246:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010325376 00000100:00100000:2.0:1763343041.684255:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010325376 00000100:00100000:1.0:1763343041.684391:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010325760 00000100:00100000:1.0:1763343041.684397:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010325760 00000100:00100000:1.0:1763343041.684444:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010325504 00000100:00100000:1.0:1763343041.684447:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010325504 00000100:00100000:1.0:1763343041.684462:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010325632 00000100:00100000:1.0:1763343041.684465:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010325632 00000100:00100000:1.0:1763343041.684484:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6914 00000100:00100000:1.0:1763343041.684495:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3658:x1848998010325760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343041.684754:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3658:x1848998010325760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 259us (625us total) trans 21474839065 rc 0/0 00000100:00100000:1.0:1763343041.684762:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6914 00000100:00100000:1.0:1763343041.684780:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6915 00000100:00100000:1.0:1763343041.684785:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3659:x1848998010325504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343041.684812:0:27835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:724 count 1 00010000:00010000:1.0:1763343041.684838:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9400/0x607405d401ae9759 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.684861:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae94ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca151 expref: 18 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343041.684870:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.684872:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.684877:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9400/0x607405d401ae9759 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.684912:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae94ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca151 expref: 18 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343041.684928:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae94ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca151 expref: 18 pid: 28995 timeout: 1335 lvb_type: 1 00000100:00100000:1.0:1763343041.684942:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010325888:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343041.685020:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a354133c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343041.685040:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6916 00000100:00100000:1.0:1763343041.685048:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3659:x1848998010325632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763343041.685139:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3659:x1848998010325632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (923us total) trans 21474839066 rc 0/0 00000100:00100000:1.0:1763343041.685146:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6916 00010000:00010000:1.0:1763343041.685218:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae9752 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x205:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca20e expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.685229:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:1.0:1763343041.685232:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343041.685250:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8e00/0x607405d401ae974b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x205:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca20e expref: 265 pid: 6525 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1763343041.685429:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6917 00000100:00100000:2.0:1763343041.685437:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3658:x1848998010325376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763343041.685453:0:15756:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:723 count 1 00010000:00010000:2.0:1763343041.685468:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae9760 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.685480:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca182 expref: 18 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.685486:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343041.685488:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763343041.685490:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae9760 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.685510:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9592 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca182 expref: 18 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.685520:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9592 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca182 expref: 18 pid: 28996 timeout: 1335 lvb_type: 0 00000100:00100000:2.0:1763343041.685531:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010326016:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343041.685569:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509fc29c0 going to sleep for 11 seconds 00000004:00080000:3.0:1763343041.685603:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052ac380/2, rc 0, transno 21474839065 00000100:00100000:3.0:1763343041.685611:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010325760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763343041.685773:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010326528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343041.685816:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343041.685838:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763343041.685843:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a350121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010326144:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343041.685867:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343041.685888:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010326400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343041.685913:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343041.685928:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763343041.685933:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010326272:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763343041.685956:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343041.685983:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010326528 00000100:00100000:0.0:1763343041.685990:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010326528 00000100:00100000:0.0:1763343041.686014:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010326144 00000100:00100000:0.0:1763343041.686016:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010326144 00000100:00100000:0.0:1763343041.686027:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010326400 00000100:00100000:0.0:1763343041.686029:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010326400 00000100:00100000:0.0:1763343041.686040:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010326272 00000100:00100000:0.0:1763343041.686041:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010326272 00000100:00100000:0.0:1763343041.686053:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6918 00000100:00100000:0.0:1763343041.686059:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3657:x1848998010326528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763343041.686171:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3657:x1848998010326528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (353us total) trans 17179871767 rc 0/0 00000100:00100000:0.0:1763343041.686177:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6918 00000100:00100000:0.0:1763343041.686191:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6919 00000100:00100000:0.0:1763343041.686196:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3657:x1848998010326144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343041.686205:0:28994:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:725 count 1 00010000:00010000:0.0:1763343041.686218:0:28994:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae9767 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.686230:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae9599 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca189 expref: 25 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.686236:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343041.686238:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343041.686241:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae9767 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763343041.686388:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052af100/2, rc 0, transno 21474839066 00000100:00100000:2.0:1763343041.686394:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010325632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763343041.686417:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6920 00000100:00100000:2.0:1763343041.686426:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e9c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3660:x1848998010326400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763343041.686502:0:28996:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2d7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343041.686506:0:28996:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2d7:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763343041.686508:0:28996:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343041.686510:0:28996:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2d7:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763343041.686512:0:28996:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2d7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343041.686546:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e9c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3660:x1848998010326400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (632us total) trans 17179871768 rc 0/0 00000100:00100000:2.0:1763343041.686552:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6920 00000100:00100000:2.0:1763343041.686564:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6921 00000100:00100000:2.0:1763343041.686569:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3660:x1848998010326272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763343041.686580:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:726 count 1 00010000:00010000:2.0:1763343041.686591:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae976e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.686602:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae94f8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca14a expref: 25 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343041.686608:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.686610:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.686612:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae976e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.686652:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae94f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca14a expref: 25 pid: 28995 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343041.686663:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae94f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca14a expref: 25 pid: 28995 timeout: 1335 lvb_type: 1 00000100:00100000:2.0:1763343041.686674:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010326784:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343041.686721:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509fc2300 going to sleep for 11 seconds 00010000:00010000:1.0:1763343041.687050:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae9752 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x205:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca20e expref: 264 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.687088:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:1.0:1763343041.687091:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763343041.687095:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d8400, rc 0) 00000100:00100000:1.0:1763343041.687125:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:55941:x1848997993746304:12345-192.168.204.21@tcp:101:bash.0 Request processed in 17214us (17549us total) trans 8589940405 rc 0/0 00000100:00100000:1.0:1763343041.687132:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9789 00010000:00010000:0.0:1763343041.687355:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae9599 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca189 expref: 25 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.687372:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae9599 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca189 expref: 25 pid: 15756 timeout: 1335 lvb_type: 0 00000100:00100000:0.0:1763343041.687383:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010326656:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343041.687414:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31780 going to sleep for 11 seconds 00000004:00080000:0.0:1763343041.687490:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34034f1180/2, rc 0, transno 17179871768 00000100:00100000:0.0:1763343041.687495:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010326400:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763343041.687516:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34034f2d80/2, rc 0, transno 17179871767 00000100:00100000:0.0:1763343041.687521:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010326528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763343041.700038:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.700175:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993746560 00000100:00100000:1.0:1763343041.700188:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993746560 00000100:00100000:1.0:1763343041.700270:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9790 00000100:00100000:1.0:1763343041.700281:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:56968:x1848997993746560:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343041.700311:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.700342:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae9775 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca215 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.700448:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae977c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700466:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae977c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700481:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae977c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700494:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9783 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700501:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9783 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700506:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9783 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700683:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae978a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700693:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae978a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700700:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae978a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343041.700712:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x205:0x0]: returning size 2 00010000:00010000:1.0:1763343041.700848:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae977c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700856:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae977c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700866:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae977c lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700871:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae977c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700877:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d8200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343041.700881:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae977c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700888:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae977c lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700902:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3510289500) 00010000:00010000:1.0:1763343041.700905:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343041.700910:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae977c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700915:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae977c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700929:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9783 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700934:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9783 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700939:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9783 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700944:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343041.700946:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9783 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700955:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9783 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700961:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3510289000) 00010000:00010000:1.0:1763343041.700964:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343041.700966:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9783 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.700970:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9783 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343041.701012:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9c00/0x607405d401ae9775 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca215 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.701025:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae978a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca215 expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.701030:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:1.0:1763343041.701032:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343041.701034:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9000, rc 0) 00000100:00100000:1.0:1763343041.701113:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56968:x1848997993746560:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 833us (1089us total) trans 8589940406 rc 0/0 00000100:00100000:1.0:1763343041.701121:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9790 00000100:00100000:1.0:1763343041.713600:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.713671:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993746688 00000100:00100000:1.0:1763343041.713682:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993746688 00010000:00010000:1.0:1763343041.713731:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae94ff lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca151 expref: 19 pid: 28995 timeout: 1335 lvb_type: 1 00000100:00100000:1.0:1763343041.713784:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3228 00000100:00100000:1.0:1763343041.713795:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2431:x1848997993746688:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343041.713825:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343041.713832:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae94ff lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca151 expref: 19 pid: 28995 timeout: 1335 lvb_type: 1 00010000:00010000:1.0:1763343041.713846:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae94ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca151 expref: 19 pid: 28995 timeout: 1335 lvb_type: 1 00010000:00010000:1.0:1763343041.713880:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.713882:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.713888:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9400/0x607405d401ae9759 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.713900:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9400/0x607405d401ae9759 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.713926:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343041.713987:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2431:x1848997993746688:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 192us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.713995:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3228 00000100:00100000:1.0:1763343041.714044:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.714066:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993746944 00000100:00100000:1.0:1763343041.714070:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993746944 00010000:00010000:1.0:1763343041.714088:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae94f8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca14a expref: 26 pid: 28995 timeout: 1335 lvb_type: 1 00000100:00100000:1.0:1763343041.714114:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3229 00000100:00100000:1.0:1763343041.714121:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2431:x1848997993746944:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343041.714132:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343041.714136:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae94f8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca14a expref: 26 pid: 28995 timeout: 1335 lvb_type: 1 00010000:00010000:1.0:1763343041.714145:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae94f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca14a expref: 26 pid: 28995 timeout: 1335 lvb_type: 1 00010000:00010000:1.0:1763343041.714160:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.714162:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.714166:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae976e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.714174:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae976e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.714186:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343041.714205:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2431:x1848997993746944:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 84us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.714212:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3229 00000100:00100000:1.0:1763343041.714277:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.714291:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993746816 00000100:00100000:1.0:1763343041.714295:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993746816 00010000:00010000:1.0:1763343041.714309:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9592 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca182 expref: 19 pid: 28996 timeout: 1335 lvb_type: 0 00000100:00100000:1.0:1763343041.714332:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3230 00000100:00100000:1.0:1763343041.714339:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2431:x1848997993746816:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343041.714348:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343041.714351:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9592 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca182 expref: 19 pid: 28996 timeout: 1335 lvb_type: 0 00010000:00010000:1.0:1763343041.714360:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9592 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca182 expref: 19 pid: 28996 timeout: 1335 lvb_type: 0 00010000:00010000:1.0:1763343041.714373:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.714374:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.714378:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae9760 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.714385:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae9760 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.714396:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343041.714415:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2431:x1848997993746816:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 76us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.714422:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3230 00000100:00100000:1.0:1763343041.714470:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.714485:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993747072 00000100:00100000:1.0:1763343041.714488:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993747072 00010000:00010000:1.0:1763343041.714502:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae9599 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca189 expref: 26 pid: 15756 timeout: 1335 lvb_type: 0 00000100:00100000:1.0:1763343041.714526:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3231 00000100:00100000:1.0:1763343041.714532:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2431:x1848997993747072:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343041.714541:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343041.714545:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae9599 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca189 expref: 26 pid: 15756 timeout: 1335 lvb_type: 0 00010000:00010000:1.0:1763343041.714555:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae9599 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca189 expref: 26 pid: 15756 timeout: 1335 lvb_type: 0 00010000:00010000:1.0:1763343041.714566:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.714568:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343041.714571:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae9767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.714579:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae9767 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343041.714591:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343041.714609:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2431:x1848997993747072:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 77us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.714616:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3231 00000100:00100000:1.0:1763343041.714694:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.714775:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.714891:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993747456 00000100:00100000:0.0:1763343041.714897:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993747456 00000100:00100000:0.0:1763343041.714943:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6922 00000100:00100000:0.0:1763343041.714951:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:55941:x1848997993747456:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1763343041.714971:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343041.714989:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae9798 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca21c expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715013:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae96f0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1eb expref: 27 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343041.715021:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.715023:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343041.715027:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae9798 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca21c expref: 27 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715064:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae96f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1eb expref: 27 pid: 15756 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343041.715083:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae96f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1eb expref: 27 pid: 15756 timeout: 1335 lvb_type: 1 00000100:00100000:0.0:1763343041.715099:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1848998010326912:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343041.715174:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3511f31c00 going to sleep for 11 seconds 00010000:00010000:0.0:1763343041.715226:0:27835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34058dce00/0x607405d401ae94ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca151 expref: 18 pid: 28995 timeout: 1335 lvb_type: 1 00000100:00100000:0.0:1763343041.715242:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010325888:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343041.715265:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9400/0x607405d401ae9759 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715276:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9400/0x607405d401ae9759 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715283:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9400/0x607405d401ae9759 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715293:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9400/0x607405d401ae9759 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715301:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9400/0x607405d401ae9759 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715322:0:27835:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343041.715678:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3659:x1848998010325504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30834us (31439us total) trans 21474839067 rc 0/0 00000100:00100000:0.0:1763343041.715687:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6915 00010000:00010000:0.0:1763343041.715715:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343041.715723:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9400/0x607405d401ae9759 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715730:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343041.715734:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9400/0x607405d401ae9759 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715743:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9400/0x607405d401ae9759 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715759:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9400/0x607405d401ae9759 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715767:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9400/0x607405d401ae9759 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715783:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343041.715784:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343041.715786:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343041.715833:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052ae300/2, rc 0, transno 21474839067 00000100:00100000:0.0:1763343041.715839:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010325504:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1763343041.715875:0:28994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058ddc00/0x607405d401ae9599 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca189 expref: 27 pid: 15756 timeout: 1335 lvb_type: 0 00000100:00100000:0.0:1763343041.715891:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:28994:1848998010326656:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343041.715905:0:28994:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae9767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715914:0:28994:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae9767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715921:0:28994:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae9767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715930:0:28994:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae9767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715938:0:28994:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae9767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.715956:0:28994:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763343041.716116:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3657:x1848998010326144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29918us (30245us total) trans 17179871769 rc 0/0 00000100:00100000:0.0:1763343041.716123:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6919 00010000:00010000:0.0:1763343041.716142:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343041.716147:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae9767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.716154:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343041.716158:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae9767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.716166:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae9767 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.716178:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae9767 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.716185:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc000/0x607405d401ae9767 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.716199:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343041.716201:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343041.716203:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343041.716225:0:3657:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a350121ad80/2, rc 0, transno 17179871769 00000100:00100000:0.0:1763343041.716231:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a350121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010326144:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1763343041.716356:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9592 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca182 expref: 17 pid: 28996 timeout: 1335 lvb_type: 0 00000100:00100000:2.0:1763343041.716368:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010326016:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343041.716383:0:15756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae9760 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.716390:0:15756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae9760 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.716397:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae9760 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.716407:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae9760 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.716415:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae9760 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.716446:0:15756:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763343041.716592:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3658:x1848998010325376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31155us (32552us total) trans 21474839068 rc 0/0 00000100:00100000:2.0:1763343041.716600:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6917 00000004:00080000:2.0:1763343041.716785:0:3658:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34052af480/2, rc 0, transno 21474839068 00000100:00100000:2.0:1763343041.716790:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010325376:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763343041.716827:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993747328 00000100:00100000:2.0:1763343041.716835:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993747328 00000100:00100000:2.0:1763343041.716875:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3353 00000100:00100000:2.0:1763343041.716884:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:56968:x1848997993747328:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:2.0:1763343041.717098:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:56968:x1848997993747328:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 215us (2402us total) trans 8589940407 rc 0/0 00000100:00100000:2.0:1763343041.717106:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3353 00010000:00010000:3.0:1763343041.717819:0:28996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dcc00/0x607405d401ae94f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca14a expref: 26 pid: 28995 timeout: 1335 lvb_type: 1 00000100:00100000:3.0:1763343041.717839:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010326784:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343041.717860:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae976e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.717875:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae976e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.717882:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae976e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.717891:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae976e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.717898:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae976e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343041.717924:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763343041.718122:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3660:x1848998010326272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31551us (32167us total) trans 17179871770 rc 0/0 00000100:00100000:3.0:1763343041.718131:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6921 00010000:00010000:2.0:1763343041.721133:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763343041.721156:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae9760 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.721174:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343041.721179:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae9760 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.721194:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae9760 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.721223:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae9760 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.721231:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352c800/0x607405d401ae9760 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.721265:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763343041.721270:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae976e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.721277:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343041.721280:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae976e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.721287:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae976e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.721298:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae976e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.721306:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352dc00/0x607405d401ae976e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.721328:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343041.721330:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343041.721332:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343041.721657:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343041.721733:0:3660:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a34034f3800/2, rc 0, transno 17179871770 00000100:00100000:0.0:1763343041.721743:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1848998010326272:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763343041.725524:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.725699:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8407:1848998010326912:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343041.725747:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae9798 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca21c expref: 25 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343041.725774:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc600, rc 0) 00000100:00100000:0.0:1763343041.725861:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:55941:x1848997993747456:12345-192.168.204.21@tcp:101:bash.0 Request processed in 10909us (11083us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343041.725876:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6922 00000100:00100000:2.0:1763343041.725989:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993747584 00000100:00100000:2.0:1763343041.725998:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993747584 00010000:00010000:2.0:1763343041.726044:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae96f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1eb expref: 25 pid: 15756 timeout: 1335 lvb_type: 1 00000100:00100000:2.0:1763343041.726086:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3232 00000100:00100000:2.0:1763343041.726097:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2432:x1848997993747584:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343041.726115:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343041.726121:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae96f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1eb expref: 25 pid: 15756 timeout: 1335 lvb_type: 1 00010000:00010000:2.0:1763343041.726134:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae96f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1eb expref: 25 pid: 15756 timeout: 1335 lvb_type: 1 00010000:00010000:2.0:1763343041.726164:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352ce00/0x607405d401ae96f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1eb expref: 25 pid: 15756 timeout: 1335 lvb_type: 1 00010000:00010000:2.0:1763343041.726179:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.726182:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.726191:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae9798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca21c expref: 24 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.726203:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae9798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca21c expref: 24 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.726245:0:6510:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae9798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca21c expref: 24 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343041.726262:0:6510:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6510:1848998010327040:192.168.204.21@tcp:105: 00000100:00100000:2.0:1763343041.726333:0:6510:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3509fc29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343041.732406:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.732573:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993747712 00000100:00100000:1.0:1763343041.732588:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993747712 00000100:00100000:1.0:1763343041.733489:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6923 00000100:00100000:1.0:1763343041.733507:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2432:x1848997993747712:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343041.733533:0:8408:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343041.733558:0:8408:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9a00/0x607405d401ae979f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca223 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343041.742725:0:8408:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010327168:192.168.204.21@tcp:106: 00000100:00100000:0.0:1763343041.742897:0:8408:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3504eac600 going to sleep for 11 seconds 00000100:00100000:1.0:1763343041.744898:0:6510:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6510:1848998010327040:192.168.204.21@tcp:105: 00010000:00010000:1.0:1763343041.744931:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343041.744998:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2432:x1848997993747584:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 18901us (19490us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343041.745011:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3232 00000100:00100000:3.0:1763343041.745133:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.745576:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993747840 00000100:00100000:1.0:1763343041.745586:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993747840 00000100:00100000:1.0:1763343041.745666:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6924 00000100:00100000:1.0:1763343041.745677:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:55941:x1848997993747840:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:2.0:1763343041.745751:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343041.745783:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae97a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca22a expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343041.745821:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343041.745845:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.745847:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343041.745858:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae97a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca22a expref: 18 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.746191:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae97a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca22a expref: 18 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343041.746208:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352ce00, rc 0) 00000100:00100000:2.0:1763343041.748106:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:55941:x1848997993747840:12345-192.168.204.21@tcp:101:bash.0 Request processed in 2414us (2957us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343041.748125:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6924 00002000:00010000:1.0:1763343041.753291:0:8408:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x2d7:0x0] updating lvb mtime: 0 -> 1763343041 00002000:00010000:1.0:1763343041.753307:0:8408:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x2d7:0x0] updating lvb atime: 0 -> 1763343041 00002000:00010000:1.0:1763343041.753310:0:8408:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x2d7:0x0] updating lvb ctime: 0 -> 1763343041 00000100:00100000:1.0:1763343041.753343:0:8408:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1848998010327168:192.168.204.21@tcp:106: 00010000:00010000:1.0:1763343041.753527:0:8408:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9a00/0x607405d401ae979f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca223 expref: 25 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343041.753560:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9a00/0x607405d401ae979f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca223 expref: 25 pid: 8408 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343041.753576:0:8408:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9a00, rc 0) 00000100:00100000:1.0:1763343041.753963:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2432:x1848997993747712:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 20460us (21571us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343041.753977:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6923 00000100:00100000:3.0:1763343041.762928:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343041.762997:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343041.763178:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993748096 00000100:00100000:2.0:1763343041.763191:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993747968 00000100:00100000:1.0:1763343041.763193:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993748096 00000100:00100000:2.0:1763343041.763199:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993747968 00002000:00010000:2.0:1763343041.763248:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/727 (0->18446744073709551615) 00002000:00010000:1.0:1763343041.763248:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/725 (0->18446744073709551615) 00002000:00100000:2.0:1763343041.763257:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340c252a00 with x1848997993747968 ext(0->18446744073709551615) 00002000:00100000:1.0:1763343041.763258:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340c251500 with x1848997993748096 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343041.763277:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340c252a00. 00000100:00100000:2.0:1763343041.763319:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1672 00000100:00100000:2.0:1763343041.763330:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2432:x1848997993747968:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:1.0:1763343041.763377:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340c251500. 00000100:00100000:1.0:1763343041.763403:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1673 00000100:00100000:1.0:1763343041.763412:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2432:x1848997993748096:12345-192.168.204.21@tcp:10:bash.0 00002000:00010000:2.0:1763343041.763579:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2d7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343041.763579:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343041.763586:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2d7:0x0] updating lvb mtime from disk: 1763343041 -> 1763343041 00002000:00010000:1.0:1763343041.763587:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d5:0x0] updating lvb mtime from disk: 0 -> 1763343041 00002000:00010000:2.0:1763343041.763592:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2d7:0x0] updating lvb atime from disk: 1763343041 -> 0 00002000:00010000:1.0:1763343041.763593:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343041.763598:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2d7:0x0] updating lvb ctime from disk: 1763343041 -> 1763343041 00002000:00010000:1.0:1763343041.763599:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d5:0x0] updating lvb ctime from disk: 0 -> 1763343041 00002000:00010000:2.0:1763343041.763604:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2d7:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1763343041.763605:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343041.763751:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2432:x1848997993747968:12345-192.168.204.21@tcp:10:bash.0 Request processed in 421us (752us total) trans 17179871771 rc 0/0 00000100:00100000:2.0:1763343041.763761:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1672 00002000:00010000:2.0:1763343041.763766:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/727 (0->18446744073709551615) 00002000:00100000:2.0:1763343041.763769:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340c252a00 with x1848997993747968 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343041.763774:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340c252a00. 00000100:00100000:0.0:1763343041.767401:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2432:x1848997993748096:12345-192.168.204.21@tcp:10:bash.0 Request processed in 3968us (4467us total) trans 21474839069 rc 0/0 00000100:00100000:0.0:1763343041.767423:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1673 00002000:00010000:0.0:1763343041.767434:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/725 (0->18446744073709551615) 00002000:00100000:0.0:1763343041.767438:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340c251500 with x1848997993748096 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343041.767454:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340c251500. 00000100:00100000:3.0:1763343041.781762:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343041.781908:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993748352 00000100:00100000:0.0:1763343041.781922:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993748352 00000100:00100000:0.0:1763343041.782004:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3354 00000100:00100000:0.0:1763343041.782015:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:55941:x1848997993748352:12345-192.168.204.21@tcp:35:bash.0 00000100:00100000:0.0:1763343041.782327:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:55941:x1848997993748352:12345-192.168.204.21@tcp:35:bash.0 Request processed in 313us (581us total) trans 8589940408 rc 0/0 00000100:00100000:0.0:1763343041.782336:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3354 00010000:00010000:0.0:1763343041.947864:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763343042.740966:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343042.741010:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343042.741036:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343042.741051:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343042.741069:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343042.741091:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993748864 00000100:00100000:0.0:1763343042.741099:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993748864 00000100:00100000:0.0:1763343042.741139:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993748992 00000100:00100000:0.0:1763343042.741141:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993748992 00000100:00100000:0.0:1763343042.741160:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 935 00000100:00100000:0.0:1763343042.741168:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993748864:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:0.0:1763343042.741232:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993748864:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 65us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343042.741239:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 935 00000100:00100000:0.0:1763343042.741254:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 936 00000100:00100000:0.0:1763343042.741259:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2430:x1848997993748992:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:0.0:1763343042.741279:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2430:x1848997993748992:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 20us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343042.741285:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 936 00000100:00100000:0.0:1763343042.741311:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993748608 00000100:00100000:0.0:1763343042.741314:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993748608 00000100:00100000:0.0:1763343042.741343:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993748736 00000100:00100000:0.0:1763343042.741345:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993748736 00000100:00100000:0.0:1763343042.741372:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1480 00000100:00100000:0.0:1763343042.741378:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:2429:x1848997993748608:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:0.0:1763343042.741412:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:2429:x1848997993748608:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 34us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343042.741418:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1480 00000100:00100000:0.0:1763343042.741429:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1481 00000100:00100000:0.0:1763343042.741435:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993748736:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:0.0:1763343042.741456:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993748736:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 21us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343042.741465:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1481 00000100:00080000:0.0:1763343042.741493:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1763343042.741544:0:32345:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993748480 00000100:00100000:3.0:1763343042.741549:0:32345:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993748480 00000100:00100000:3.0:1763343042.741588:0:32345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 155 00000100:00100000:3.0:1763343042.741596:0:32345:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b3ae62-6386-4093-b1cf-f8b7be7393a5+9:2430:x1848997993748480:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1763343042.741838:0:32345:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91b3ae62-6386-4093-b1cf-f8b7be7393a5+9:2430:x1848997993748480:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 243us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343042.741845:0:32345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 155 00010000:00010000:0.0:1763343043.016965:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763343044.059941:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343044.828337:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763343044.828371:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1848998010327296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1763343044.828467:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343044.828569:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010327296 00000100:00100000:2.0:1763343044.828581:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010327296 00000100:00100000:2.0:1763343044.828678:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:2.0:1763343044.828689:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1848998010327296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1763343044.828727:0:8412:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484926784 pending 28672 free 3920240640 avail 3688718336 00000100:00100000:2.0:1763343044.828789:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1848998010327296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343044.828797:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00080000:2.0:1763343044.828823:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1763343044.828869:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1848998010327296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1763343044.829181:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1848998010327424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1763343044.829218:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343044.830173:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010327424 00000100:00100000:3.0:1763343044.830187:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010327424 00000100:00100000:3.0:1763343044.830248:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1763343044.830257:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1848998010327424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1763343044.830292:0:8411:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484926784 pending 28672 free 3919175680 avail 3687653376 00000100:00100000:3.0:1763343044.830361:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1848998010327424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343044.830368:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00080000:3.0:1763343044.830390:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763343044.830430:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1848998010327424:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1763343045.084011:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1763343045.355932:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871771 is committed 00000001:00080000:1.0:1763343045.355953:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871770 is committed 00000100:00100000:0.0:1763343045.852890:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763343045.852920:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010327680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1763343045.853009:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343045.853106:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010327680 00000100:00100000:0.0:1763343045.853115:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010327680 00000100:00100000:0.0:1763343045.853168:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:0.0:1763343045.853177:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1848998010327680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1763343045.853223:0:6528:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446187008 avail 1299947520 00000100:00100000:0.0:1763343045.853275:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1848998010327680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343045.853283:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:0.0:1763343045.853336:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010327680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1763343045.853454:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1848998010327552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1763343045.853486:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343045.853609:0:6529:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010327552 00000100:00100000:2.0:1763343045.853613:0:6529:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010327552 00000100:00100000:2.0:1763343045.853678:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1763343045.853686:0:6529:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3660:x1848998010327552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1763343045.853708:0:6529:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445650432 avail 1299410944 00000100:00100000:2.0:1763343045.853763:0:6529:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3660:x1848998010327552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343045.853768:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:3.0:1763343045.853922:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1848998010327552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1763343045.854103:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763343045.855208:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07eb4ce3-eb55-46ce-8a00-00f8f23465ad:3657:1848998010327808:0@lo:400:kworker.0 00000100:00100000:1.0:1763343045.855286:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343045.859766:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1848998010328192:0@lo:400:kworker.0 00000100:00100000:1.0:1763343045.859856:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343045.859902:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1848998010328704:0@lo:400:kworker.0 00000100:00100000:1.0:1763343045.859928:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343045.859947:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1763343045.859969:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1848998010328320:0@lo:400:kworker.0 00000100:00100000:1.0:1763343045.859990:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343045.860025:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010328832:0@lo:400:kworker.0 00000100:00100000:1.0:1763343045.860046:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343045.860114:0:8408:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010328832 00000100:00100000:0.0:1763343045.860115:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010328192 00000100:00100000:1.0:1763343045.860125:0:8408:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010328832 00000100:00100000:0.0:1763343045.860125:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010328192 00000100:00100000:2.0:1763343045.860445:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010328704 00000100:00100000:2.0:1763343045.860451:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010328704 00000100:00100000:2.0:1763343045.860488:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010328320 00000100:00100000:2.0:1763343045.860491:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010328320 00000100:00100000:2.0:1763343045.860515:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:2.0:1763343045.860528:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1848998010328704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343045.860605:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1848998010328704:12345-0@lo:400:kworker.0 Request processed in 82us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343045.860613:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:2.0:1763343045.860657:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:2.0:1763343045.860665:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1848998010328320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343045.860692:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1848998010328320:12345-0@lo:400:kworker.0 Request processed in 30us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343045.860698:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:2.0:1763343045.860742:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1848998010327936:0@lo:400:kworker.0 00000100:00100000:2.0:1763343045.860772:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343045.860792:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1848998010328448:0@lo:400:kworker.0 00000100:00100000:2.0:1763343045.860812:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343045.860826:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010328960:0@lo:400:kworker.0 00000100:00100000:2.0:1763343045.860846:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343045.860867:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1763343045.860874:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34034f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1848998010328064:0@lo:400:kworker.0 00000100:00100000:2.0:1763343045.860894:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343045.860914:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1848998010328576:0@lo:400:kworker.0 00000100:00100000:2.0:1763343045.860934:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343045.860949:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1848998010329088:0@lo:400:kworker.0 00000100:00100000:2.0:1763343045.860977:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343045.861006:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010328960 00000100:00100000:2.0:1763343045.861010:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010328960 00000100:00100000:3.0:1763343045.861276:0:32346:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010327808 00000100:00100000:3.0:1763343045.861282:0:32346:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010327808 00000100:00100000:3.0:1763343045.861295:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010327936 00000100:00100000:3.0:1763343045.861298:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010327936 00000100:00100000:3.0:1763343045.861327:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010328448 00000100:00100000:3.0:1763343045.861330:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010328448 00000100:00100000:3.0:1763343045.861346:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010328576 00000100:00100000:3.0:1763343045.861348:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010328576 00000100:00100000:3.0:1763343045.861361:0:10041:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010329088 00000100:00100000:3.0:1763343045.861363:0:10041:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010329088 00000100:00100000:3.0:1763343045.861377:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:3.0:1763343045.861384:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1848998010327936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763343045.861430:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1848998010327936:12345-0@lo:400:kworker.0 Request processed in 46us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343045.861436:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:3.0:1763343045.861449:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:3.0:1763343045.861455:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1848998010328448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763343045.861480:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1848998010328448:12345-0@lo:400:kworker.0 Request processed in 26us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343045.861486:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:3.0:1763343045.861497:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:3.0:1763343045.861502:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1848998010328576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763343045.861526:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1848998010328576:12345-0@lo:400:kworker.0 Request processed in 24us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343045.861532:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:3.0:1763343045.861543:0:10041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:3.0:1763343045.861548:0:10041:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1848998010329088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763343045.861572:0:10041:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1848998010329088:12345-0@lo:400:kworker.0 Request processed in 24us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343045.861577:0:10041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:3.0:1763343045.861638:0:32345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1763343045.861645:0:32345:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34050b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb4ce3-eb55-46ce-8a00-00f8f23465ad+23:3657:x1848998010327808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763343045.861683:0:32345:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34050b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb4ce3-eb55-46ce-8a00-00f8f23465ad+23:3657:x1848998010327808:12345-0@lo:400:kworker.0 Request processed in 39us (6398us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343045.861688:0:32345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1763343045.861761:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010328064 00000100:00100000:3.0:1763343045.861766:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010328064 00000100:00100000:1.0:1763343045.863492:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:1.0:1763343045.863514:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1848998010328192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343045.863613:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1848998010328192:12345-0@lo:400:kworker.0 Request processed in 109us (3756us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343045.863636:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:1.0:1763343045.863657:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:1.0:1763343045.863665:0:8408:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3657:x1848998010328832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343045.863698:0:8408:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3657:x1848998010328832:12345-0@lo:400:kworker.0 Request processed in 35us (3651us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343045.863704:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00080000:1.0:1763343045.863743:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1763343045.863751:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1763343045.863754:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1763343045.863757:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1763343045.863811:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1848998010328320:0@lo:400:kworker.0 00000100:00100000:1.0:1763343045.863828:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010328832:0@lo:400:kworker.0 00000100:00100000:1.0:1763343045.863840:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1848998010328192:0@lo:400:kworker.0 00000100:00100000:1.0:1763343045.863853:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1848998010328704:0@lo:400:kworker.0 00000100:00100000:1.0:1763343045.863864:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07eb4ce3-eb55-46ce-8a00-00f8f23465ad:3657:1848998010327808:0@lo:400:kworker.0 00000100:00100000:1.0:1763343045.864276:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1848998010328576:0@lo:400:kworker.0 00000100:00100000:1.0:1763343045.864293:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1848998010329088:0@lo:400:kworker.0 00000100:00100000:1.0:1763343045.864305:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1848998010327936:0@lo:400:kworker.0 00000100:00100000:1.0:1763343045.864318:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1848998010328448:0@lo:400:kworker.0 00000100:00100000:2.0:1763343045.865090:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:2.0:1763343045.865113:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1848998010328960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343045.865184:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1848998010328960:12345-0@lo:400:kworker.0 Request processed in 81us (4335us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343045.865191:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:1.0:1763343045.866341:0:3659:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871770 gen 2 00000004:00080000:1.0:1763343045.866353:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c3b100, transno 17179871720 00000004:00080000:1.0:1763343045.866374:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c38000, transno 17179871721 00000004:00080000:1.0:1763343045.866377:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c3a680, transno 17179871722 00000004:00080000:1.0:1763343045.866380:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537c39c00, transno 17179871723 00000004:00080000:1.0:1763343045.866384:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad2300, transno 17179871724 00000004:00080000:1.0:1763343045.866387:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad3b80, transno 17179871725 00000004:00080000:1.0:1763343045.866390:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad3100, transno 17179871726 00000004:00080000:1.0:1763343045.866393:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad0380, transno 17179871727 00000004:00080000:1.0:1763343045.866397:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34060ace00, transno 17179871729 00000004:00080000:1.0:1763343045.866400:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34060ad880, transno 17179871730 00000004:00080000:1.0:1763343045.866404:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3535ad1c00, transno 17179871731 00000004:00080000:1.0:1763343045.866408:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3511f38700, transno 17179871732 00000004:00080000:1.0:1763343045.866412:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062c8000, transno 17179871735 00000004:00080000:1.0:1763343045.866417:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062cb800, transno 17179871736 00000004:00080000:1.0:1763343045.866421:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c3bdf80, transno 17179871737 00000004:00080000:1.0:1763343045.866424:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340664a300, transno 17179871738 00000004:00080000:1.0:1763343045.866426:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad6300, transno 17179871742 00000004:00080000:1.0:1763343045.866430:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad4000, transno 17179871743 00000004:00080000:1.0:1763343045.866433:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad4380, transno 17179871744 00000004:00080000:1.0:1763343045.866436:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3403ad5180, transno 17179871745 00000004:00080000:1.0:1763343045.866505:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3404ba7100, transno 17179871746 00000004:00080000:1.0:1763343045.866509:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3404ba5880, transno 17179871747 00000004:00080000:1.0:1763343045.866512:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3404ba6a00, transno 17179871748 00000004:00080000:1.0:1763343045.866516:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3404ba4380, transno 17179871749 00000004:00080000:1.0:1763343045.866531:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7e680, transno 17179871752 00000004:00080000:1.0:1763343045.866533:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7ea00, transno 17179871753 00000004:00080000:1.0:1763343045.866536:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7df80, transno 17179871754 00000004:00080000:1.0:1763343045.866540:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3405b7c700, transno 17179871755 00000004:00080000:1.0:1763343045.866543:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3409a4c000, transno 17179871757 00000004:00080000:1.0:1763343045.866546:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d5f80, transno 17179871758 00000004:00080000:1.0:1763343045.866549:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3409a4d180, transno 17179871759 00000004:00080000:1.0:1763343045.866552:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34059d6680, transno 17179871760 00000004:00080000:1.0:1763343045.866555:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a354134d180, transno 17179871762 00000004:00080000:1.0:1763343045.866559:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a354134c700, transno 17179871763 00000004:00080000:1.0:1763343045.866561:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c251f80, transno 17179871764 00000004:00080000:1.0:1763343045.866564:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a354134dc00, transno 17179871765 00000004:00080000:1.0:1763343045.866567:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34034f2d80, transno 17179871767 00000004:00080000:1.0:1763343045.866569:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34034f1180, transno 17179871768 00000004:00080000:1.0:1763343045.866572:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a350121ad80, transno 17179871769 00000004:00080000:1.0:1763343045.866575:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34034f3800, transno 17179871770 00000100:00100000:1.0:1763343045.866584:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010328960:0@lo:400:kworker.0 00000004:00080000:0.0:1763343045.866931:0:32357:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 27 in progress, 0 in flight, 13 done 00000004:00080000:0.0:1763343045.867083:0:32357:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 27 done 00000100:00100000:3.0:1763343045.867358:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:3.0:1763343045.867374:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1848998010328064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763343045.867483:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1848998010328064:12345-0@lo:400:kworker.0 Request processed in 115us (6587us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343045.867491:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00100000:1.0:1763343045.867814:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34034f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1848998010328064:0@lo:400:kworker.0 00010000:00010000:0.0:1763343046.108027:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343046.365086:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010329216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1763343046.365192:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343046.365256:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010329216 00000100:00100000:0.0:1763343046.365266:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010329216 00000100:00100000:0.0:1763343046.365324:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:0.0:1763343046.365334:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1848998010329216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1763343046.365374:0:8412:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484898112 pending 0 free 3919175680 avail 3687653376 00000100:00100000:0.0:1763343046.365436:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1848998010329216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343046.365444:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:2.0:1763343046.365462:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1848998010329216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1763343046.366392:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010329344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1763343046.366454:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343046.366694:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010329344 00000100:00100000:2.0:1763343046.366702:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010329344 00000100:00100000:2.0:1763343046.366752:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1763343046.366761:0:8411:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a354145b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+30:3658:x1848998010329344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1763343046.366792:0:8411:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484926784 pending 28672 free 3920240640 avail 3688718336 00000100:00100000:2.0:1763343046.366846:0:8411:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a354145b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+30:3658:x1848998010329344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343046.366854:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:3.0:1763343046.367058:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010329344:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1763343046.372207:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839069 is committed 00000001:00080000:0.0:1763343046.372226:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839068 is committed 00010000:00010000:0.0:1763343047.132783:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763343047.367072:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343047.367173:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993749248 00000100:00100000:0.0:1763343047.367188:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993749248 00000100:00100000:0.0:1763343047.367277:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9791 00000100:00100000:0.0:1763343047.367289:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+268:57392:x1848997993749248:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:0.0:1763343047.367364:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763343047.367403:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8400/0x607405d401ae9752 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x205:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca20e expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343047.367429:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae978a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca215 expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343047.367442:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae9713 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x205:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca1f9 expref: 266 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343047.367454:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a34037bcd00) 00010000:00010000:0.0:1763343047.367468:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343047.367502:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae97ad lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.367517:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae97ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.367528:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae97ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.367546:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae97b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.367552:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae97b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.367559:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae97b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00080000:1.0:1763343047.367765:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1763343047.367940:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97bb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.367948:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97bb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.367955:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97bb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000040:00080000:0.0:1763343047.368265:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1553, 64 off130392 00000004:00080000:0.0:1763343047.368277:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1241035655677ns, next at 1242035652560ns, rc = 0 00000040:00080000:0.0:1763343047.368304:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1552, 64 off130392 00000004:00080000:0.0:1763343047.368311:0:10042:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1241035690089ns, next at 1242035688752ns, rc = 0 00000040:00080000:0.0:1763343047.368321:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1553, 64 off130456 00000040:00080000:0.0:1763343047.368329:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1554, 64 off130456 00010000:00010000:0.0:1763343047.370535:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae97c2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x205:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.370564:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae97c2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.370576:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae97c2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.370591:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae97c2 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.370597:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae97c2 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.370603:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae97c2 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.370646:0:10042:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763343047.370668:0:6511:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343047.370683:0:6511:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae97c2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343047.370695:0:6511:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dce00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343047.370706:0:6511:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae97c2 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343047.370715:0:6511:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae97c2 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343047.370732:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a3541131b00) 00010000:00010000:3.0:1763343047.370735:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343047.370740:0:6511:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae97c2 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343047.370745:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae97c2 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343047.370761:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343047.370764:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343047.370766:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343047.371818:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97bb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.371832:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97bb lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.371840:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97bb lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.371845:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058ddc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343047.371851:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97bb lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.371859:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97bb lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.371876:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x205:0x0].0x0 (ffff9a3541131b00) 00010000:00010000:0.0:1763343047.371879:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763343047.371885:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97bb lrc: 2/0,0 mode: --/EX res: [0x200000405:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.371890:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97bb lrc: 0/0,0 mode: --/EX res: [0x200000405:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.378140:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae97ad lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.378160:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae97ad lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.378166:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae97ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.378173:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae97ad lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.378180:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dcc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343047.378185:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae97ad lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.378192:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae97ad lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.378210:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0x0 (ffff9a3541131100) 00010000:00010000:0.0:1763343047.378213:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343047.378219:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae97ad lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.378224:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dcc00/0x607405d401ae97ad lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:0.0:1763343047.378243:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fef638e0 reply state 000000002ef410cf transno 8589940409 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae97b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.378257:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae97b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343047.378264:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3541131900) 00010000:00010000:0.0:1763343047.378267:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343047.378270:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343047.378397:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:57392:x1848997993749248:12345-192.168.204.21@tcp:36:rm.0 Request processed in 11103us (11335us total) trans 8589940409 rc 0/0 00000100:00100000:0.0:1763343047.378408:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9791 00000001:00080000:1.0:1763343047.382177:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940409 is committed 00000004:00080000:1.0:1763343047.382197:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1021 committed 00000004:00080000:1.0:1763343047.382210:0:32339:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1020 committed 00000100:00100000:1.0:1763343047.382405:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010329472:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763343047.382488:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343047.382560:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343047.382567:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3406b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010329600:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763343047.382591:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343047.382653:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010329472 00000100:00100000:1.0:1763343047.382662:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010329472 00000100:00100000:1.0:1763343047.382843:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010329600 00000100:00100000:1.0:1763343047.382848:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010329600 00000100:00100000:1.0:1763343047.382884:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6925 00000100:00100000:1.0:1763343047.382894:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1848998010329472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763343047.382931:0:8407:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:725 count 1 00010000:00010000:1.0:1763343047.382968:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8200/0x607405d401ae97c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343047.382995:0:8407:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae97a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca22a expref: 9 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343047.383004:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343047.383007:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343047.383011:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8200/0x607405d401ae97c9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343047.383224:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6926 00000100:00100000:0.0:1763343047.383237:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3659:x1848998010329600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763343047.383251:0:28996:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:727 count 1 00010000:00010000:0.0:1763343047.383268:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae97d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343047.383279:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae9798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca21c expref: 11 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343047.383286:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343047.383288:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343047.383290:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae97d0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343047.383309:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae9798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca21c expref: 11 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343047.383324:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae9798 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca21c expref: 11 pid: 8407 timeout: 1341 lvb_type: 0 00000100:00100000:0.0:1763343047.383337:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010329856:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343047.383414:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3406abe900 going to sleep for 11 seconds 00010000:00010000:1.0:1763343047.383789:0:8407:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae97a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca22a expref: 9 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343047.383807:0:8407:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae97a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca22a expref: 9 pid: 8407 timeout: 1341 lvb_type: 0 00000100:00100000:1.0:1763343047.383820:0:8407:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1848998010329728:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343047.383868:0:8407:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35124c2e40 going to sleep for 11 seconds 00010000:00010000:3.0:1763343047.383874:0:3644:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae97b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343047.383893:0:3644:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae97b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00000100:00080000:1.0:1763343047.383901:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1763343047.383902:0:3644:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae97b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00000100:00080000:1.0:1763343047.383911:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1763343047.383913:0:3644:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343047.383921:0:3644:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae97b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343047.383929:0:3644:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae97b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343047.383947:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x5:0x0].0xcca0c426 (ffff9a3541131900) 00010000:00010000:3.0:1763343047.383950:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343047.383955:0:3644:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae97b4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:3.0:1763343047.383961:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae97b4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x5:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000100:00100000:1.0:1763343047.390281:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343047.390320:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343047.390355:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993749504 00000100:00100000:1.0:1763343047.390367:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993749504 00010000:00010000:1.0:1763343047.390436:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae97a6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca22a expref: 10 pid: 8407 timeout: 1341 lvb_type: 0 00000100:00100000:3.0:1763343047.390444:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010329856:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343047.390486:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993749376 00010000:00010000:3.0:1763343047.390492:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae97d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343047.390493:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993749376 00010000:00010000:1.0:1763343047.390520:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae9798 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca21c expref: 12 pid: 8407 timeout: 1341 lvb_type: 0 00000100:00100000:1.0:1763343047.390556:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3233 00000100:00100000:1.0:1763343047.390566:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+10:2431:x1848997993749504:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343047.390585:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343047.390590:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae97a6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca22a expref: 10 pid: 8407 timeout: 1341 lvb_type: 0 00010000:00010000:1.0:1763343047.390602:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae97a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca22a expref: 10 pid: 8407 timeout: 1341 lvb_type: 0 00010000:00010000:1.0:1763343047.390667:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1763343047.390859:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3234 00000100:00100000:3.0:1763343047.390881:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35084c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2429:x1848997993749376:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343047.390901:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343047.390909:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae9798 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca21c expref: 12 pid: 8407 timeout: 1341 lvb_type: 0 00010000:00010000:3.0:1763343047.390925:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae9798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca21c expref: 12 pid: 8407 timeout: 1341 lvb_type: 0 00010000:00010000:3.0:1763343047.390953:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dc600/0x607405d401ae9798 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca21c expref: 12 pid: 8407 timeout: 1341 lvb_type: 0 00010000:00010000:3.0:1763343047.390968:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343047.390970:0:13199:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343047.390975:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae97d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343047.390986:0:13199:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae97d0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343047.391012:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763343047.391071:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35084c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2429:x1848997993749376:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 200us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343047.391079:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3234 00010000:00010000:3.0:1763343047.391220:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae97d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343047.391229:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae97d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343047.391244:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae97d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343047.391252:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae97d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343047.391273:0:28996:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763343047.391566:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3659:x1848998010329600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8330us (8971us total) trans 17179871772 rc 0/0 00000100:00100000:3.0:1763343047.391576:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6926 00010000:00010000:3.0:1763343047.391602:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343047.391609:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae97d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343047.391617:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dda00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343047.391655:0:6512:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae97d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343047.391666:0:6512:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae97d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343047.391679:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae97d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343047.391686:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34058dda00/0x607405d401ae97d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343047.391717:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343047.391720:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343047.391721:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343047.392927:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343047.392939:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8200/0x607405d401ae97c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343047.392954:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8200/0x607405d401ae97c9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343047.392992:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343047.393075:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+10:2431:x1848997993749504:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 2505us (2806us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343047.393087:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3233 00000100:00080000:1.0:1763343047.393196:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1763343047.393203:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1763343047.393267:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b91180/2, rc 0, transno 17179871772 00000100:00100000:1.0:1763343047.393295:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010329600:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763343047.393342:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340352ce00/0x607405d401ae97a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca22a expref: 9 pid: 8407 timeout: 1341 lvb_type: 0 00000100:00100000:1.0:1763343047.393357:0:8407:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8407:1848998010329728:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343047.393375:0:8407:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8200/0x607405d401ae97c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343047.393386:0:8407:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8200/0x607405d401ae97c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343047.393393:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8200/0x607405d401ae97c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343047.393405:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8200/0x607405d401ae97c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343047.393413:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8200/0x607405d401ae97c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343047.393442:0:8407:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343047.393797:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3659:x1848998010329472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10902us (11306us total) trans 21474839070 rc 0/0 00000100:00100000:1.0:1763343047.393807:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6925 00010000:00010000:1.0:1763343047.393847:0:13198:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763343047.393856:0:13198:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8200/0x607405d401ae97c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343047.393865:0:13198:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d8200 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343047.393870:0:13198:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8200/0x607405d401ae97c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343047.393880:0:13198:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8200/0x607405d401ae97c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343047.393901:0:13198:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8200/0x607405d401ae97c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343047.393908:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8200/0x607405d401ae97c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343047.393931:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343047.393933:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343047.393936:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343047.393944:0:3659:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474839068 gen 2 00000004:00080000:3.0:1763343047.393958:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406552680, transno 21474839039 00000004:00080000:3.0:1763343047.393990:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a5880, transno 21474839040 00000004:00080000:3.0:1763343047.393994:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a4a80, transno 21474839041 00000004:00080000:3.0:1763343047.393996:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34097a4e00, transno 21474839042 00000004:00080000:3.0:1763343047.393998:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340683b800, transno 21474839043 00000004:00080000:3.0:1763343047.394001:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34062c9500, transno 21474839044 00000004:00080000:3.0:1763343047.394003:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035e9f80, transno 21474839045 00000004:00080000:3.0:1763343047.394005:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34035e9500, transno 21474839046 00000004:00080000:3.0:1763343047.394008:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c2c7100, transno 21474839048 00000004:00080000:3.0:1763343047.394010:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c2c4a80, transno 21474839049 00000004:00080000:3.0:1763343047.394013:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c2c6d80, transno 21474839050 00000004:00080000:3.0:1763343047.394015:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a340c2c6300, transno 21474839051 00000004:00080000:3.0:1763343047.394029:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34095ba300, transno 21474839055 00000004:00080000:3.0:1763343047.394032:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537910700, transno 21474839056 00000004:00080000:3.0:1763343047.394034:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537910000, transno 21474839057 00000004:00080000:3.0:1763343047.394036:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537912680, transno 21474839058 00000004:00080000:3.0:1763343047.394039:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537969880, transno 21474839060 00000004:00080000:3.0:1763343047.394041:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537968700, transno 21474839061 00000004:00080000:3.0:1763343047.394043:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537968a80, transno 21474839062 00000004:00080000:3.0:1763343047.394046:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3537969180, transno 21474839063 00000004:00080000:3.0:1763343047.394048:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052ac380, transno 21474839065 00000004:00080000:3.0:1763343047.394051:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052af100, transno 21474839066 00000004:00080000:3.0:1763343047.394053:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052ae300, transno 21474839067 00000004:00080000:3.0:1763343047.394055:0:3659:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a34052af480, transno 21474839068 00000100:00100000:3.0:1763343047.394063:0:3659:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a3406b90700 x1848998010329472/t21474839070(21474839070) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763343063 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763343047.394074:0:3659:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a3406b90700/2, rc 0, transno 21474839070 00000100:00100000:3.0:1763343047.394079:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3406b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010329472:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1763343047.395509:0:32355:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 1 in progress, 0 in flight, 24 done 00000100:00100000:1.0:1763343047.856677:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343047.856726:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343047.856762:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343047.856854:0:32346:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993749632 00000100:00100000:3.0:1763343047.856865:0:32346:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993749632 00000100:00100000:2.0:1763343047.856895:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993750144 00000100:00100000:2.0:1763343047.856910:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993750144 00000100:00100000:3.0:1763343047.856929:0:32346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 157 00000100:00100000:3.0:1763343047.856944:0:32346:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b3ae62-6386-4093-b1cf-f8b7be7393a5+9:2432:x1848997993749632:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1763343047.856994:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 941 00000100:00100000:2.0:1763343047.857010:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2432:x1848997993750144:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1763343047.857025:0:32346:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b3ae62-6386-4093-b1cf-f8b7be7393a5+9:2432:x1848997993749632:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 81us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343047.857035:0:32346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 157 00000100:00100000:2.0:1763343047.857089:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2432:x1848997993750144:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 82us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343047.857097:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 941 00000100:00100000:3.0:1763343047.857737:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343047.857775:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343047.857819:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993749888 00000100:00100000:2.0:1763343047.857827:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993749888 00000100:00100000:3.0:1763343047.857833:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993750016 00000100:00100000:3.0:1763343047.857841:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993750016 00000100:00100000:3.0:1763343047.857899:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 942 00000100:00100000:3.0:1763343047.857915:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+9:2431:x1848997993750016:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1763343047.857916:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993749760 00000100:00100000:2.0:1763343047.857924:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993749760 00000100:00100000:2.0:1763343047.857959:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1488 00000100:00100000:2.0:1763343047.857968:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2432:x1848997993749888:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1763343047.857979:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+9:2431:x1848997993750016:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 65us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343047.857989:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 942 00000100:00100000:2.0:1763343047.858028:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2432:x1848997993749888:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 59us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343047.858040:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1488 00000100:00100000:2.0:1763343047.858058:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1489 00000100:00100000:2.0:1763343047.858065:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:2431:x1848997993749760:12345-192.168.204.21@tcp:400:kworker.0 00000100:00080000:1.0:1763343047.858112:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1763343047.858115:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:2431:x1848997993749760:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 49us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343047.858124:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1489 00010000:00010000:0.0:1763343048.156121:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343049.180136:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1763343049.328837:0:35523:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 70a: flr mode fsx test ================ 20:30:47 (1763343047) 00000100:00100000:0.0:1763343049.494862:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343049.494914:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993750272 00000100:00100000:0.0:1763343049.494927:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993750272 00000100:00100000:0.0:1763343049.495011:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9792 00000100:00100000:0.0:1763343049.495021:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:57551:x1848997993750272:12345-192.168.204.21@tcp:41:stat.0 00000004:00000024:0.0:1763343049.495087:0:10042:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7839416320 avail 7376343040 00000100:00100000:0.0:1763343049.495163:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:57551:x1848997993750272:12345-192.168.204.21@tcp:41:stat.0 Request processed in 144us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343049.495171:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9792 00000100:00080000:0.0:1763343049.495213:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1763343049.545881:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343049.545976:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993750400 00000100:00100000:0.0:1763343049.545990:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993750400 00000100:00100000:0.0:1763343049.546068:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9793 00000100:00100000:0.0:1763343049.546079:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:57557:x1848997993750400:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343049.546106:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343049.546133:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae97d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca231 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.546220:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae97de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546239:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae97de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546257:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae97de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546275:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546282:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546289:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546352:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae97de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546359:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae97de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546366:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae97de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546373:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae97de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546379:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343049.546383:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae97de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546392:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae97de lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546406:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3404421100) 00010000:00010000:0.0:1763343049.546409:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343049.546415:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae97de lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546422:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae97de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546438:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546443:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546451:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546456:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058ddc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343049.546459:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546464:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546470:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85409d3b (ffff9a3541131100) 00010000:00010000:0.0:1763343049.546472:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343049.546474:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546480:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae97e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.546513:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae97d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca231 expref: 263 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.546522:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3404421100) 00010000:00010000:0.0:1763343049.546525:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343049.546528:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae97d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca231 expref: 263 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.546538:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dd800, rc 0) 00000100:00100000:0.0:1763343049.546614:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:57557:x1848997993750400:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 536us (749us total) trans 0 rc 301/301 00000100:00100000:0.0:1763343049.546709:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9793 00000100:00100000:0.0:1763343049.556390:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.557820:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993750656 00000100:00100000:2.0:1763343049.557837:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993750656 00000100:00100000:2.0:1763343049.557923:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9794 00000100:00100000:2.0:1763343049.557934:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+262:57557:x1848997993750656:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:2.0:1763343049.558012:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343049.558049:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3404b76400/0x607405d401ac9cff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffabfdd4 expref: 262 pid: 10041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.558076:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3404421100) 00010000:00010000:2.0:1763343049.558082:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343049.558167:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae97ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.558184:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae97ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.558196:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae97ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.558215:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae97f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.558223:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae97f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.558230:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae97f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000040:00080000:2.0:1763343049.559363:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].12, 2160 off44056 00000040:00080000:2.0:1763343049.559466:0:10042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000406:0x2:0x0].5, 2360 off42624 00000004:00080000:2.0:1763343049.559475:0:10042:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9a352011d840 with version 15 00000004:00080000:1.0:1763343049.559616:0:32353:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9a340c767540 version 15 rpc_version 15 00000020:00100000:1.0:1763343049.559698:0:32353:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1763343049.559712:0:32353:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9a34052ae300 x1848998010330112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4224/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1763343049.559748:0:32353:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052ae300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32353:1848998010330112:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1763343049.559852:0:32353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343049.559920:0:32353:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a351feeb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763343049.561086:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010330112 00000100:00100000:2.0:1763343049.561106:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010330112 00000100:00100000:1.0:1763343049.563296:0:13006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:1.0:1763343049.563328:0:13006:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:32353:x1848998010330112:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1763343049.565023:0:13006:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:32353:x1848998010330112:12345-0@lo:1000:osp_up1-0.0 Request processed in 1705us (5164us total) trans 4294967754 rc 0/0 00000100:00100000:1.0:1763343049.565039:0:13006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:0.0:1763343049.566271:0:32353:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052ae300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32353:1848998010330112:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1763343049.566814:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae97fa lrc: 3/0,1 mode: --/PW res: [0x200000405:0x206:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.566837:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae97fa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x206:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.566851:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae97fa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x206:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.566887:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9801 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.566895:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9801 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.566902:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9801 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.566951:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9a340352de00/0x607405d401ae9808 lrc: 3/0,1 mode: --/PW res: [0x240000406:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.566958:0:10042:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9a340352de00/0x607405d401ae9808 lrc: 3/0,1 mode: --/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.566969:0:10042:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9a340352de00/0x607405d401ae9808 lrc: 3/0,1 mode: --/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 10042 initiator: MDT0 00000100:00100000:2.0:1763343049.566997:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10042:1848998010330240:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1763343049.567074:0:10042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343049.567146:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3512746240 going to sleep for 11 seconds 00000100:00100000:1.0:1763343049.568176:0:13006:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010330240 00000100:00100000:1.0:1763343049.568193:0:13006:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010330240 00000100:00100000:1.0:1763343049.568264:0:13006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:1.0:1763343049.568277:0:13006:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10042:x1848998010330240:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1763343049.568307:0:13006:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343049.568384:0:13006:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9400/0x607405d401ae980f lrc: 2/0,0 mode: --/PW res: [0x240000406:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x607405d401ae9808 expref: -99 pid: 13006 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343049.568421:0:13006:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9400/0x607405d401ae980f lrc: 3/0,0 mode: PW/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x607405d401ae9808 expref: 7 pid: 13006 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343049.568447:0:13006:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9400/0x607405d401ae980f lrc: 3/0,0 mode: PW/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x607405d401ae9808 expref: 7 pid: 13006 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343049.568457:0:13006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x6:0x0].0x0 (ffff9a3403bdc200) 00010000:00010000:1.0:1763343049.568460:0:13006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343049.568464:0:13006:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9400, rc 0) 00000100:00100000:1.0:1763343049.568561:0:13006:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:10042:x1848998010330240:12345-0@lo:101:mdt00_004.0 Request processed in 285us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343049.568568:0:13006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:2.0:1763343049.568894:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10042:1848998010330240:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1763343049.568915:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9a340352de00/0x607405d401ae9808 lrc: 4/0,1 mode: PW/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x607405d401ae980f expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.568927:0:10042:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9a340352de00/0x607405d401ae9808 lrc: 4/0,1 mode: PW/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x607405d401ae980f expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1763343049.568955:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000fcc0ee7 reply state 000000003fe372ee transno 8589940410 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9801 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.568968:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9801 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.568975:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9a35167a9700) 00010000:00010000:2.0:1763343049.568978:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343049.568981:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763343049.568987:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9a340352de00/0x607405d401ae9808 lrc: 4/0,1 mode: PW/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x607405d401ae980f expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.568995:0:10042:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9a340352de00/0x607405d401ae9808 lrc: 3/0,0 mode: PW/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x607405d401ae980f expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763343049.569007:0:10042:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000406:0x6:0x0] 00000004:00010000:2.0:1763343049.569015:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000fcc0ee7 reply state 000000003fe372ee transno 8589940410 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae97fa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x206:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.569022:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae97fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x206:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.569028:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x206:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:2.0:1763343049.569031:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343049.569032:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1763343049.569037:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x206:0x0]: returning size 4096 00010000:00010000:2.0:1763343049.569047:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae97ec lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.569331:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae97ec lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.569337:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae97ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.569344:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae97ec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.569354:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343049.569360:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae97ec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.569368:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae97ec lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.569379:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3404421100) 00010000:00010000:2.0:1763343049.569382:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343049.569386:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae97ec lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.569393:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae97ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:2.0:1763343049.569407:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000fcc0ee7 reply state 000000003fe372ee transno 8589940410 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae97f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.569416:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae97f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.569422:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85409d3b (ffff9a35167a9400) 00010000:00010000:2.0:1763343049.569425:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343049.569427:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1763343049.569683:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:57557:x1848997993750656:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 11739us (13298us total) trans 8589940410 rc 0/0 00000100:00100000:3.0:1763343049.569698:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9794 00000100:00100000:3.0:1763343049.605952:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343049.609782:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993750784 00000100:00100000:0.0:1763343049.609802:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993750784 00000100:00100000:0.0:1763343049.609895:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9795 00000100:00100000:0.0:1763343049.609907:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+263:57560:x1848997993750784:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343049.609931:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343049.609953:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9816 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca238 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.610019:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae981d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343049.610034:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae981d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343049.610045:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae981d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:0.0:1763343049.610090:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1763343049.610094:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343049.610114:0:10042:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae981d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343049.610138:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd800/0x607405d401ae9816 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca238 expref: 265 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.610157:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058ddc00/0x607405d401ae981d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca238 expref: 264 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.610166:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3404421100) 00010000:00010000:0.0:1763343049.610170:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763343049.610174:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058ddc00, rc 0) 00000100:00100000:0.0:1763343049.610255:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:57560:x1848997993750784:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 350us (4320us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343049.610263:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9795 00000100:00100000:2.0:1763343049.614078:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343049.614183:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993750912 00000100:00100000:3.0:1763343049.614204:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993750912 00000100:00100000:3.0:1763343049.614302:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9796 00000100:00100000:3.0:1763343049.614315:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+264:57560:x1848997993750912:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343049.614342:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343049.614369:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9824 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca23f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343049.614458:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae982b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614477:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae982b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614489:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae982b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614509:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9832 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614517:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614523:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614687:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9839 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x206:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614698:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9839 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x206:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614705:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9839 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x206:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343049.614813:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x206:0x0]: returning size 4096 00000004:00200000:3.0:1763343049.614821:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1763343049.614844:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9839 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x206:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614858:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae982b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614865:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae982b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614872:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae982b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614878:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae982b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614885:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343049.614890:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae982b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614898:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae982b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614911:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a3404421100) 00010000:00010000:3.0:1763343049.614915:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343049.614920:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae982b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614927:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae982b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614941:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614949:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9832 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614955:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9832 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614960:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de7200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:3.0:1763343049.614962:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9832 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614968:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9832 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614973:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85409d3b (ffff9a35167a9400) 00010000:00010000:3.0:1763343049.614976:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763343049.614978:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9832 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.614983:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9832 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.615010:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9824 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca23f expref: 266 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343049.615024:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6000/0x607405d401ae9839 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x206:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca23f expref: 265 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343049.615032:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x206:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:3.0:1763343049.615034:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1763343049.615036:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6000, rc 0) 00000100:00100000:3.0:1763343049.615124:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:57560:x1848997993750912:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 811us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343049.615133:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9796 00000100:00100000:2.0:1763343049.618777:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343049.619731:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993751040 00000100:00100000:1.0:1763343049.619749:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993751040 00000100:00100000:1.0:1763343049.619826:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9797 00000100:00100000:1.0:1763343049.619837:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+265:57560:x1848997993751040:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343049.619865:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343049.619895:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae9840 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca246 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343049.619973:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8800/0x607405d401ae9847 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.619992:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8800/0x607405d401ae9847 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.620006:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8800/0x607405d401ae9847 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:1.0:1763343049.620315:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x6:0x0]: returning size 4096 00000004:00200000:1.0:1763343049.620321:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1763343049.620367:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae9840 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca246 expref: 267 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343049.620393:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8800/0x607405d401ae9847 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca246 expref: 266 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343049.620402:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9a35167a9700) 00010000:00010000:1.0:1763343049.620406:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1763343049.620410:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d8800, rc 0) 00000100:00100000:1.0:1763343049.620500:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:57560:x1848997993751040:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 663us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343049.620508:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9797 00000100:00100000:0.0:1763343049.622902:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343049.623019:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993751168 00000100:00100000:1.0:1763343049.623031:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993751168 00000100:00100000:1.0:1763343049.623117:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9798 00000100:00100000:1.0:1763343049.623130:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:57560:x1848997993751168:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343049.623152:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343049.623176:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d8a00/0x607405d401ae984e lrc: 2/0,0 mode: --/CR res: [0x240000406:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca24d expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343049.623240:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9c00/0x607405d401ae9855 lrc: 3/1,0 mode: --/PR res: [0x240000406:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.623256:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9400/0x607405d401ae980f lrc: 2/0,0 mode: PW/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x607405d401ae9808 expref: 6 pid: 13006 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343049.623264:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9c00/0x607405d401ae9855 lrc: 4/1,0 mode: --/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT1 00010000:00010000:1.0:1763343049.623297:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9400/0x607405d401ae980f lrc: 3/0,0 mode: PW/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x607405d401ae9808 expref: 6 pid: 13006 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343049.623317:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34052aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10042:1848998010330368:0@lo:104: 00000100:00100000:1.0:1763343049.623365:0:10042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343049.623428:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a351feeb600 going to sleep for 11 seconds 00000100:00100000:2.0:1763343049.623447:0:6507:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010330368 00000100:00100000:2.0:1763343049.623460:0:6507:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010330368 00000100:00080000:0.0:1763343049.623515:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1763343049.623558:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1763343049.623573:0:6506:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10042:x1848998010330368:12345-0@lo:104: 00010000:00010000:3.0:1763343049.623592:0:6506:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9a340352de00/0x607405d401ae9808 lrc: 3/0,0 mode: PW/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x607405d401ae980f expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343049.623733:0:6506:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1763343049.623740:0:6506:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:10042:x1848998010330368:12345-0@lo:104: Request processed in 172us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343049.623748:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00010000:0.0:1763343049.625005:0:6512:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763343049.625019:0:6512:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9a340352de00/0x607405d401ae9808 lrc: 3/0,0 mode: PW/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x607405d401ae980f expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.625030:0:6512:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19af290) 00010000:00010000:0.0:1763343049.625037:0:6512:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9a340352de00/0x607405d401ae9808 lrc: 4/0,0 mode: PW/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x607405d401ae980f expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1763343049.625048:0:6512:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9a340352de00/0x607405d401ae9808 lrc: 4/0,0 mode: PW/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x607405d401ae980f expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.625100:0:6512:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9a340352de00/0x607405d401ae9808 lrc: 2/0,0 mode: --/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x607405d401ae980f expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.625106:0:6512:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1763343049.625140:0:6512:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9a340352de00/0x607405d401ae9808 lrc: 1/0,0 mode: --/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x607405d401ae980f expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.625147:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9a340352de00/0x607405d401ae9808 lrc: 0/0,0 mode: --/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x607405d401ae980f expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.625173:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343049.625175:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763343049.625177:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343049.625478:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763343049.625503:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010330496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1763343049.625575:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343049.625716:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010330496 00000100:00100000:0.0:1763343049.625724:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010330496 00010000:00010000:0.0:1763343049.625764:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9400/0x607405d401ae980f lrc: 4/0,0 mode: PW/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x607405d401ae9808 expref: 7 pid: 13006 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343049.625799:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3235 00000100:00100000:0.0:1763343049.625809:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3658:x1848998010330496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1763343049.625826:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1763343049.626179:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34052aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:10042:1848998010330368:0@lo:104: 00010000:00010000:1.0:1763343049.626210:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9c00/0x607405d401ae9855 lrc: 3/1,0 mode: --/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT1 00000001:00080000:0.0:1763343049.629312:0:7442:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967754 is committed 00010000:00010000:1.0:1763343049.632256:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9400/0x607405d401ae980f lrc: 0/0,0 mode: --/PW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x607405d401ae9808 expref: 6 pid: 13006 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343049.632279:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x6:0x0].0x0 (ffff9a3403bdc200) 00010000:00010000:1.0:1763343049.632284:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9c00/0x607405d401ae9855 lrc: 3/1,0 mode: --/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT1 00010000:00010000:1.0:1763343049.632293:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9c00/0x607405d401ae9855 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT1 00010000:00010000:1.0:1763343049.632300:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9c00/0x607405d401ae9855 lrc: 4/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT1 00010000:00010000:1.0:1763343049.632341:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343049.632374:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9c00/0x607405d401ae9855 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT1 00010000:00010000:0.0:1763343049.632385:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9c00/0x607405d401ae9855 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT1 00000100:00100000:1.0:1763343049.632436:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1848998010330496:12345-0@lo:103:ldlm_bl.0 Request processed in 6625us (6857us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343049.632449:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3235 00000100:00100000:3.0:1763343049.632484:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010330496:0@lo:103:ldlm_bl.0 00000004:00200000:0.0:1763343049.632572:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000406:0x6:0x0]: returning size 4096 00000004:00200000:0.0:1763343049.632577:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1763343049.632634:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d8a00/0x607405d401ae984e lrc: 0/0,0 mode: --/CR res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca24d expref: 16 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.632650:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9c00/0x607405d401ae9855 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca24d expref: 15 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.632667:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x6:0x0].0x0 (ffff9a3403bdc200) 00010000:00010000:0.0:1763343049.632671:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1763343049.632674:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9c00, rc 0) 00000100:00100000:0.0:1763343049.632725:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:57560:x1848997993751168:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 9600us (9835us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343049.632732:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9798 00000100:00100000:0.0:1763343049.637446:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343049.637512:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993751296 00000100:00100000:1.0:1763343049.637522:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993751296 00000100:00100000:1.0:1763343049.637585:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9799 00000100:00100000:1.0:1763343049.637594:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:57560:x1848997993751296:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343049.637616:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343049.637671:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae985c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca254 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343049.637744:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9863 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637764:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9863 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637773:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9863 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637788:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae986a lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637795:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae986a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637801:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae986a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637866:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9863 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637873:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9863 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637879:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9863 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637885:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9863 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637891:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d8000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343049.637895:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9863 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637902:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9863 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637914:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9a35167a9700) 00010000:00010000:1.0:1763343049.637917:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343049.637922:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9863 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637929:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9863 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637942:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae986a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637948:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae986a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637953:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae986a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637957:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343049.637959:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae986a lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637964:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae986a lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637969:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff9a3403bdc800) 00010000:00010000:1.0:1763343049.637971:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343049.637974:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae986a lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.637982:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae986a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.638007:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae985c lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca254 expref: 267 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343049.638016:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9a35167a9700) 00010000:00010000:1.0:1763343049.638018:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343049.638021:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae985c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca254 expref: 267 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343049.638028:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9800, rc 0) 00000100:00100000:1.0:1763343049.638085:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:57560:x1848997993751296:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 491us (649us total) trans 0 rc 301/301 00000100:00100000:1.0:1763343049.638093:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9799 00000100:00100000:2.0:1763343049.645885:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343049.646009:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993751424 00000100:00100000:3.0:1763343049.646021:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993751424 00000100:00100000:3.0:1763343049.646086:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9800 00000100:00100000:3.0:1763343049.646098:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+266:57560:x1848997993751424:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343049.646124:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343049.646150:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9871 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca25b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343049.646236:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9878 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x206:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.646251:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9878 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x206:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.646265:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9878 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x206:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343049.646352:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x206:0x0]: returning size 4096 00000004:00200000:3.0:1763343049.646358:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1763343049.646378:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9878 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x206:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.646404:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae9871 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca25b expref: 268 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343049.646422:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de7200/0x607405d401ae9878 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x206:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca25b expref: 267 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343049.646431:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x206:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:3.0:1763343049.646434:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763343049.646437:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7200, rc 0) 00000100:00100000:3.0:1763343049.646506:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:57560:x1848997993751424:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 409us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343049.646513:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9800 00000100:00100000:3.0:1763343049.653795:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343049.653931:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993751680 00000100:00100000:1.0:1763343049.653942:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993751680 00000100:00100000:1.0:1763343049.654003:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9801 00000100:00100000:1.0:1763343049.654013:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+267:57560:x1848997993751680:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343049.654036:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343049.654039:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763343049.654065:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8800/0x607405d401ae9847 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca246 expref: 267 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343049.654083:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9a35167a9700) 00010000:00010000:1.0:1763343049.654089:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343049.654102:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae987f lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca262 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343049.654199:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9886 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.654213:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9886 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.654223:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9886 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.654235:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae988d lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.654241:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae988d lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.654247:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae988d lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343049.654770:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9894 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343049.654783:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9894 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343049.654791:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9894 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:0.0:1763343049.654800:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x207:0x0]: returning size 0 00010000:00010000:0.0:1763343049.654824:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9886 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343049.654829:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9886 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343049.654835:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9886 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343049.654839:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9886 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343049.654845:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343049.654848:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9886 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343049.654854:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9886 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343049.654863:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9a35167a9700) 00010000:00010000:0.0:1763343049.654866:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343049.654869:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9886 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343049.654878:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9886 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000004:00010000:0.0:1763343049.654888:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000052d31a56 reply state 00000000d333f975 transno 8589940411 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae988d lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343049.654896:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae988d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343049.654902:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff9a3403bdc800) 00010000:00010000:0.0:1763343049.654905:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343049.654907:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343049.654931:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae987f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca262 expref: 269 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.654944:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9894 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca262 expref: 268 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.654950:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a34047db000) 00010000:00010000:0.0:1763343049.654952:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343049.654954:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dc600, rc 0) 00000100:00100000:0.0:1763343049.655025:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:57560:x1848997993751680:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1012us (1241us total) trans 8589940411 rc 0/0 00000100:00100000:0.0:1763343049.655033:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9801 00000100:00100000:0.0:1763343049.663372:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.663449:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993751936 00000100:00100000:2.0:1763343049.663461:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993751936 00000100:00100000:2.0:1763343049.663528:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9802 00000100:00100000:2.0:1763343049.663539:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:57560:x1848997993751936:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343049.663563:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343049.663583:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae98a2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca269 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.663833:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98a9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.663849:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9894 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca262 expref: 270 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.663857:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98a9 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.663891:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9894 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca262 expref: 270 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.663905:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9894 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca262 expref: 270 pid: 10042 timeout: 1343 lvb_type: 0 00000100:00100000:2.0:1763343049.663918:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34060ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010330624:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343049.664010:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3512746240 going to sleep for 11 seconds 00000100:00100000:2.0:1763343049.671114:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34060ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010330624:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343049.671153:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98a9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:0.0:1763343049.674776:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343049.674954:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993752064 00000100:00100000:1.0:1763343049.674964:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993752064 00010000:00010000:1.0:1763343049.675004:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9894 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca262 expref: 271 pid: 10042 timeout: 1343 lvb_type: 0 00000100:00100000:1.0:1763343049.675047:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3236 00000100:00100000:1.0:1763343049.675058:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:2429:x1848997993752064:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343049.675073:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343049.675080:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9894 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca262 expref: 271 pid: 10042 timeout: 1343 lvb_type: 0 00010000:00010000:1.0:1763343049.675093:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9894 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca262 expref: 271 pid: 10042 timeout: 1343 lvb_type: 0 00010000:00010000:1.0:1763343049.675117:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9894 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca262 expref: 271 pid: 10042 timeout: 1343 lvb_type: 0 00010000:00010000:1.0:1763343049.675134:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a34047db000) 00010000:00010000:1.0:1763343049.675140:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98a9 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.675149:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98a9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.675156:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98a9 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343049.675192:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343049.675249:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:2429:x1848997993752064:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 192us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343049.675257:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3236 00010000:00010000:2.0:1763343049.676101:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98a9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.676113:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98a9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343049.676137:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x207:0x0]: returning size 0 00000004:00080000:2.0:1763343049.676307:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2d7:0x0], index 0: 0 00000004:00080000:2.0:1763343049.676315:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2d9:0x0], index 1: 0 00010000:00010000:2.0:1763343049.676416:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98a9 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.676424:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98a9 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.676430:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98a9 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.676436:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343049.676440:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98a9 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.676447:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98a9 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.676458:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a34047db000) 00010000:00010000:2.0:1763343049.676462:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343049.676465:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98a9 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.676476:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98a9 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.676520:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae98a2 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca269 expref: 270 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.676530:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a34047db000) 00010000:00010000:2.0:1763343049.676532:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763343049.676536:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae98a2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca269 expref: 270 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.676550:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d800, rc 0) 00000100:00100000:2.0:1763343049.676607:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:57560:x1848997993751936:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 13071us (13259us total) trans 8589940412 rc 301/301 00000100:00100000:2.0:1763343049.676616:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9802 00000100:00100000:0.0:1763343049.688447:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.691426:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993752320 00000100:00100000:2.0:1763343049.691442:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993752320 00000100:00100000:3.0:1763343049.691559:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3355 00000100:00100000:3.0:1763343049.691570:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+269:57560:x1848997993752320:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343049.692064:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:57560:x1848997993752320:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 494us (3626us total) trans 8589940413 rc 0/0 00000100:00100000:3.0:1763343049.692073:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3355 00000100:00100000:1.0:1763343049.697244:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343049.697386:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993752576 00000100:00100000:3.0:1763343049.697398:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993752576 00000100:00100000:3.0:1763343049.697744:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3356 00000100:00100000:3.0:1763343049.697756:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+270:57560:x1848997993752576:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:3.0:1763343049.703564:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:57560:x1848997993752576:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 5800us (6319us total) trans 8589940414 rc 0/0 00000100:00100000:3.0:1763343049.703576:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3356 00000100:00100000:1.0:1763343049.798095:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.798385:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993752832 00000100:00100000:2.0:1763343049.798397:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993752832 00000100:00100000:2.0:1763343049.798461:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9803 00000100:00100000:2.0:1763343049.798472:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:57561:x1848997993752832:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:2.0:1763343049.798499:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343049.798523:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae98b7 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca270 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.799246:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98be lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799270:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98be lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799282:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98be lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799294:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae98c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799301:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae98c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799307:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae98c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799374:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae98cc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799382:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae98cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799389:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae98cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343049.799399:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x207:0x0]: returning size 0 00010000:00010000:2.0:1763343049.799480:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98be lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799488:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98be lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799495:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98be lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799503:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98be lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799509:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343049.799513:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98be lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799519:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98be lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799531:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9a35167a9700) 00010000:00010000:2.0:1763343049.799535:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343049.799539:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98be lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799545:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98be lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799557:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae98c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799562:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae98c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799568:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae98c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799572:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352d600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:2.0:1763343049.799574:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae98c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799579:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae98c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799585:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff9a3403bdc800) 00010000:00010000:2.0:1763343049.799587:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763343049.799590:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae98c5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.799595:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae98c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.802254:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d800/0x607405d401ae98b7 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca270 expref: 274 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.802286:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae98cc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca270 expref: 273 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.802296:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343049.802299:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343049.802303:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:2.0:1763343049.804089:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:57561:x1848997993752832:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 5609us (5994us total) trans 8589940415 rc 0/0 00000100:00100000:2.0:1763343049.804102:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9803 00000100:00100000:0.0:1763343049.814946:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.815073:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993752960 00000100:00100000:2.0:1763343049.815084:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993752960 00000100:00100000:2.0:1763343049.815153:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9804 00000100:00100000:2.0:1763343049.815164:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:57561:x1848997993752960:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:2.0:1763343049.815192:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343049.815218:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae98da lrc: 2/0,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca277 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.815258:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98e1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.815274:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.815286:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.815399:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae98da lrc: 0/0,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca277 expref: 275 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.815417:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98e1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca277 expref: 274 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.815426:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343049.815430:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763343049.815434:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d400, rc 0) 00000100:00100000:2.0:1763343049.815497:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:57561:x1848997993752960:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 334us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343049.815505:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9804 00000100:00100000:1.0:1763343049.824945:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343049.825562:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993753216 00000100:00100000:3.0:1763343049.825575:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993753216 00000100:00100000:3.0:1763343049.825680:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9805 00000100:00100000:3.0:1763343049.825692:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:57561:x1848997993753216:12345-192.168.204.21@tcp:36:fsx.0 00010000:00010000:3.0:1763343049.825750:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343049.825781:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae98cc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca270 expref: 274 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343049.825803:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:3.0:1763343049.825809:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343049.827944:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae98e8 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.827967:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae98e8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.827979:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae98e8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:3.0:1763343049.828036:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940416 00000004:00010000:3.0:1763343049.828077:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000037d27d96 reply state 000000009bcba8f0 transno 8589940417 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae98e8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.828090:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae98e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343049.828098:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:3.0:1763343049.828101:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343049.828106:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343049.828233:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:57561:x1848997993753216:12345-192.168.204.21@tcp:36:fsx.0 Request processed in 2539us (3295us total) trans 8589940417 rc 0/0 00000100:00100000:3.0:1763343049.828242:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9805 00000020:00080000:3.0:1763343049.828248:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343049.833015:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343049.833526:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993753344 00000100:00100000:3.0:1763343049.833539:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993753344 00000100:00100000:3.0:1763343049.833603:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9806 00000100:00100000:3.0:1763343049.833613:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:57561:x1848997993753344:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:3.0:1763343049.833685:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343049.833708:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae98ef lrc: 2/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca27e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343049.833769:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae98ef lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca27e expref: 277 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343049.833784:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae98ef lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca27e expref: 277 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343049.833805:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:3.0:1763343049.833808:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763343049.833812:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6600, rc 0) 00000100:00100000:3.0:1763343049.837754:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:57561:x1848997993753344:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 4131us (4738us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343049.837767:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9806 00000100:00100000:0.0:1763343049.846014:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343049.846385:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993753472 00000100:00100000:3.0:1763343049.846396:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993753472 00000100:00100000:3.0:1763343049.846475:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6927 00000100:00100000:3.0:1763343049.846486:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+9:57561:x1848997993753472:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:3.0:1763343049.846505:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343049.846527:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae98f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca285 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343049.846551:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343049.846579:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343049.846582:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343049.846592:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae98f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca285 expref: 10 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343049.846611:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae98f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca285 expref: 10 pid: 8407 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1763343049.846738:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1763343049.847976:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de7c00, rc 0) 00000100:00100000:1.0:1763343049.849243:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+10:57561:x1848997993753472:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 2751us (3232us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343049.849255:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6927 00000100:00100000:1.0:1763343049.858553:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.860400:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993753600 00000100:00100000:2.0:1763343049.860414:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993753600 00000100:00100000:2.0:1763343049.860496:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6928 00000100:00100000:2.0:1763343049.860510:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34052ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:57561:x1848997993753600:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:2.0:1763343049.860528:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343049.860550:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae98fd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca28c expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343049.860575:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343049.860594:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343049.860596:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343049.860605:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae98fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca28c expref: 12 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.860819:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d800/0x607405d401ae98fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca28c expref: 12 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.861043:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d800, rc 0) 00000100:00100000:2.0:1763343049.861121:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34052ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:57561:x1848997993753600:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 617us (2579us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343049.861128:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6928 00000100:00080000:0.0:1763343049.861333:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1763343049.864201:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.866968:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343049.868028:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993753728 00000100:00100000:0.0:1763343049.868040:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993753728 00002000:00010000:0.0:1763343049.868093:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (0->18446744073709551615) 00002000:00100000:0.0:1763343049.868098:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060ace00 with x1848997993753728 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343049.868112:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34060ace00. 00000100:00100000:1.0:1763343049.868164:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993753856 00000100:00100000:1.0:1763343049.868169:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993753856 00002000:00010000:1.0:1763343049.868186:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/729 (0->18446744073709551615) 00002000:00100000:1.0:1763343049.868190:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3501218e00 with x1848997993753856 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343049.868196:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3501218e00. 00000100:00100000:1.0:1763343049.868226:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1674 00000100:00100000:1.0:1763343049.868237:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+10:2432:x1848997993753728:12345-192.168.204.21@tcp:10:fsx.0 00000100:00100000:3.0:1763343049.868269:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1675 00000100:00100000:3.0:1763343049.868282:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2432:x1848997993753856:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:3.0:1763343049.868447:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343049.868448:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343049.868455:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb mtime from disk: 0 -> 1763343049 00002000:00010000:1.0:1763343049.868456:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 0 -> 1763343049 00002000:00010000:3.0:1763343049.868461:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343049.868462:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343049.868469:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 0 -> 1763343049 00002000:00010000:3.0:1763343049.868470:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb ctime from disk: 0 -> 1763343049 00002000:00010000:1.0:1763343049.868472:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1763343049.868475:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343049.869351:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2432:x1848997993753728:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 1110us (5155us total) trans 21474839071 rc 0/0 00000100:00100000:1.0:1763343049.869360:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1674 00002000:00010000:1.0:1763343049.869364:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (0->18446744073709551615) 00002000:00100000:1.0:1763343049.869367:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060ace00 with x1848997993753728 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343049.869373:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34060ace00. 00000100:00100000:3.0:1763343049.870683:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2432:x1848997993753856:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 2394us (3714us total) trans 17179871773 rc 0/0 00000100:00100000:3.0:1763343049.870701:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1675 00002000:00010000:3.0:1763343049.870707:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/729 (0->18446744073709551615) 00002000:00100000:3.0:1763343049.870711:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3501218e00 with x1848997993753856 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343049.870719:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3501218e00. 00000100:00100000:3.0:1763343049.875663:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343049.875898:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993754112 00000100:00100000:0.0:1763343049.875909:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993754112 00000100:00100000:0.0:1763343049.876033:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9807 00000100:00100000:0.0:1763343049.876044:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+277:57561:x1848997993754112:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:0.0:1763343049.876065:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343049.876090:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae9904 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca293 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.876519:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae990b lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.876536:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae990b lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.876548:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae990b lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.876561:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9912 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.876568:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9912 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.876574:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9912 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00080000:0.0:1763343049.877035:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2d8:0x0], index 0: 0 00010000:00010000:0.0:1763343049.877870:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae9919 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x209:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.877885:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae9919 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x209:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.877896:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae9919 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x209:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.877935:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae990b lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.877942:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae990b lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.877947:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae990b lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.877954:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae990b lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.877960:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343049.877964:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae990b lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.877971:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae990b lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.877983:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9a35167a9700) 00010000:00010000:0.0:1763343049.877986:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343049.877990:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae990b lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.877999:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae990b lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000004:00010000:0.0:1763343049.878011:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b15ce867 reply state 00000000f8219ae1 transno 8589940418 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9912 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.878021:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9912 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.878026:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xe8098f29 (ffff9a34047dbc00) 00010000:00010000:0.0:1763343049.878029:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343049.878031:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343049.878064:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae9904 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca293 expref: 280 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.878078:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dda00/0x607405d401ae9919 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x209:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca293 expref: 279 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.878085:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x209:0x0].0x0 (ffff9a34047dbd00) 00010000:00010000:0.0:1763343049.878087:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343049.878090:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dda00, rc 0) 00000100:00100000:0.0:1763343049.878167:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+280:57561:x1848997993754112:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 2124us (2522us total) trans 8589940418 rc 0/0 00000100:00100000:0.0:1763343049.878176:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9807 00000100:00100000:2.0:1763343049.885442:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343049.885885:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993754368 00000100:00100000:0.0:1763343049.885896:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993754368 00000100:00100000:0.0:1763343049.886201:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9808 00000100:00100000:0.0:1763343049.886213:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:57561:x1848997993754368:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:0.0:1763343049.886235:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343049.886239:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763343049.886268:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9a34050d9c00/0x607405d401ae9855 lrc: 0/0,0 mode: --/PR res: [0x240000406:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca24d expref: 15 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.886288:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x6:0x0].0x0 (ffff9a3403bdc200) 00010000:00010000:0.0:1763343049.886300:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343049.886317:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dce00/0x607405d401ae9927 lrc: 2/0,0 mode: --/CW res: [0x240000406:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca29a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.886457:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dc000/0x607405d401ae992e lrc: 3/0,1 mode: --/CW res: [0x240000406:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.886470:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dc000/0x607405d401ae992e lrc: 3/0,1 mode: CW/CW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343049.886479:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dc000/0x607405d401ae992e lrc: 3/0,1 mode: CW/CW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343049.886547:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dd800/0x607405d401ae9935 lrc: 3/0,1 mode: --/PW res: [0x240000406:0x6:0x0].0x9645bb7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.886555:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dd800/0x607405d401ae9935 lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343049.886562:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dd800/0x607405d401ae9935 lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00000004:00080000:0.0:1763343049.887981:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x28:0x0], index 0: 0 00010000:00010000:0.0:1763343049.889394:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dcc00/0x607405d401ae993c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.889418:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dcc00/0x607405d401ae993c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343049.889433:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dcc00/0x607405d401ae993c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343049.889489:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dc000/0x607405d401ae992e lrc: 4/0,1 mode: CW/CW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343049.889497:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dc000/0x607405d401ae992e lrc: 4/0,1 mode: CW/CW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343049.889503:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dc000/0x607405d401ae992e lrc: 3/0,0 mode: CW/CW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343049.889509:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dc000/0x607405d401ae992e lrc: 4/0,0 mode: CW/CW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343049.889515:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343049.889519:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dc000/0x607405d401ae992e lrc: 4/0,0 mode: CW/CW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343049.889526:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dc000/0x607405d401ae992e lrc: 5/0,0 mode: CW/CW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343049.889539:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x6:0x0].0x0 (ffff9a34047db800) 00010000:00010000:0.0:1763343049.889542:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343049.889547:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dc000/0x607405d401ae992e lrc: 3/0,0 mode: --/CW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343049.889553:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dc000/0x607405d401ae992e lrc: 0/0,0 mode: --/CW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT1 00000004:00010000:0.0:1763343049.889570:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000daa45a0 reply state 000000008a39e720 transno 4294967755 ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dd800/0x607405d401ae9935 lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343049.889581:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dd800/0x607405d401ae9935 lrc: 3/0,1 mode: TXN/TXN res: [0x240000406:0x6:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT1 00010000:00010000:0.0:1763343049.889587:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x6:0x0].0x9645bb7c (ffff9a34047dbf00) 00010000:00010000:0.0:1763343049.889589:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343049.889592:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763343049.889668:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dce00/0x607405d401ae9927 lrc: 0/0,0 mode: --/CW res: [0x240000406:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca29a expref: 17 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.889689:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9a34058dcc00/0x607405d401ae993c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca29a expref: 16 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343049.889697:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff9a34047db900) 00010000:00010000:0.0:1763343049.889699:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343049.889701:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34058dcc00, rc 0) 00000100:00100000:0.0:1763343049.889794:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:57561:x1848997993754368:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 3581us (4360us total) trans 4294967755 rc 0/0 00000100:00100000:0.0:1763343049.889803:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9808 00000100:00100000:2.0:1763343049.901319:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343049.901397:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993754624 00000100:00100000:0.0:1763343049.901407:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993754624 00000100:00100000:0.0:1763343049.901462:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9809 00000100:00100000:0.0:1763343049.901471:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+280:57561:x1848997993754624:12345-192.168.204.21@tcp:36:fsx.0 00010000:00010000:0.0:1763343049.901736:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae994a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.901753:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae994a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.901765:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae994a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:0.0:1763343049.901803:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940419 00000004:00010000:0.0:1763343049.901820:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006a68bd2f reply state 00000000d45f2abe transno 8589940420 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae994a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.901832:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae994a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343049.901839:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:0.0:1763343049.901842:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343049.901846:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343049.901920:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:57561:x1848997993754624:12345-192.168.204.21@tcp:36:fsx.0 Request processed in 450us (609us total) trans 8589940420 rc 0/0 00000100:00100000:0.0:1763343049.901927:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9809 00000020:00080000:0.0:1763343049.901932:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343049.905261:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343049.905303:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343049.905385:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993754752 00000100:00100000:1.0:1763343049.905395:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993754752 00002000:00010000:1.0:1763343049.905436:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (0->18446744073709551615) 00002000:00100000:1.0:1763343049.905441:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340c253100 with x1848997993754752 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343049.905453:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340c253100. 00000100:00100000:1.0:1763343049.905489:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993754880 00000100:00100000:1.0:1763343049.905492:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993754880 00002000:00010000:1.0:1763343049.905505:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/729 (0->18446744073709551615) 00002000:00100000:1.0:1763343049.905508:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340c252300 with x1848997993754880 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343049.905514:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340c252300. 00000100:00100000:1.0:1763343049.905539:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1676 00000100:00100000:1.0:1763343049.905550:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+11:2430:x1848997993754752:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:1.0:1763343049.905719:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343049.905724:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:1.0:1763343049.905727:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343049.905729:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:1.0:1763343049.905731:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343049.905783:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2430:x1848997993754752:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 235us (531us total) trans 21474839072 rc 0/0 00000100:00100000:1.0:1763343049.905790:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1676 00002000:00010000:1.0:1763343049.905794:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (0->18446744073709551615) 00002000:00100000:1.0:1763343049.905796:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340c253100 with x1848997993754752 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343049.905800:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340c253100. 00000100:00100000:1.0:1763343049.905815:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1677 00000100:00100000:1.0:1763343049.905821:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993754880:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:1.0:1763343049.905895:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343049.905898:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:1.0:1763343049.905899:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343049.905901:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:1.0:1763343049.905903:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343049.905923:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993754880:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 102us (619us total) trans 17179871774 rc 0/0 00000100:00100000:1.0:1763343049.905929:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1677 00002000:00010000:1.0:1763343049.905932:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/729 (0->18446744073709551615) 00002000:00100000:1.0:1763343049.905934:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340c252300 with x1848997993754880 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343049.905938:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340c252300. 00000100:00100000:1.0:1763343049.910862:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.912200:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993755136 00000100:00100000:2.0:1763343049.912215:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993755136 00000100:00100000:2.0:1763343049.912924:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9810 00000100:00100000:2.0:1763343049.912940:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:57561:x1848997993755136:12345-192.168.204.21@tcp:36:fsx.0 00010000:00010000:2.0:1763343049.913173:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9951 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.913192:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9951 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.913205:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9951 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000001:00080000:2.0:1763343049.913247:0:10042:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940421 00000004:00010000:2.0:1763343049.913270:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000039d6de23 reply state 0000000036f07614 transno 8589940422 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9951 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.913287:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9951 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.913295:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343049.913299:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343049.913302:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343049.914094:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+286:57561:x1848997993755136:12345-192.168.204.21@tcp:36:fsx.0 Request processed in 1154us (3239us total) trans 8589940422 rc 0/0 00000100:00100000:2.0:1763343049.914104:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9810 00000020:00080000:2.0:1763343049.914111:0:10042:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343049.916607:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343049.916814:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993755264 00000100:00100000:3.0:1763343049.916825:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993755264 00002000:00010000:3.0:1763343049.916868:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (100000->18446744073709551615) 00002000:00100000:3.0:1763343049.916873:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406b90e00 with x1848997993755264 ext(100000->18446744073709551615) 00002000:00010000:3.0:1763343049.916885:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406b90e00. 00000100:00100000:3.0:1763343049.917354:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1678 00000100:00100000:3.0:1763343049.917368:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3406b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+12:2432:x1848997993755264:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:3.0:1763343049.917593:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 0 -> 100000 00002000:00010000:3.0:1763343049.917597:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:3.0:1763343049.917599:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343049.917601:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:3.0:1763343049.917604:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1763343049.917716:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3406b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2432:x1848997993755264:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 349us (1116us total) trans 21474839073 rc 0/0 00000100:00100000:3.0:1763343049.917724:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1678 00002000:00010000:3.0:1763343049.917728:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (100000->18446744073709551615) 00002000:00100000:3.0:1763343049.917731:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3406b90e00 with x1848997993755264 ext(100000->18446744073709551615) 00002000:00010000:3.0:1763343049.917738:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3406b90e00. 00000100:00100000:3.0:1763343049.920511:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.920813:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993755392 00000100:00100000:2.0:1763343049.920825:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993755392 00000100:00100000:2.0:1763343049.921360:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9811 00000100:00100000:2.0:1763343049.921372:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+286:57561:x1848997993755392:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:2.0:1763343049.921395:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343049.921417:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9958 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca2a1 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.921509:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae995f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.921524:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae995f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.921535:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae995f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343049.921562:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x207:0x0]: returning size 100000 00000004:00200000:2.0:1763343049.921566:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343049.921584:0:10042:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae995f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.921608:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9958 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2a1 expref: 288 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.921648:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae995f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2a1 expref: 287 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.921668:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343049.921671:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343049.921675:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:2.0:1763343049.921737:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+287:57561:x1848997993755392:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 367us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343049.921744:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9811 00000100:00100000:1.0:1763343049.924906:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.925070:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993755648 00000100:00100000:2.0:1763343049.925080:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993755648 00000100:00100000:2.0:1763343049.925814:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9812 00000100:00100000:2.0:1763343049.925827:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+287:57561:x1848997993755648:12345-192.168.204.21@tcp:36:fsx.0 00010000:00010000:2.0:1763343049.925883:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343049.925908:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d000/0x607405d401ae995f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2a1 expref: 287 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.925927:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343049.925932:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343049.926099:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9966 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.926114:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9966 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.926128:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9966 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000001:00080000:2.0:1763343049.926168:0:10042:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940423 00000004:00010000:2.0:1763343049.926188:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000091a75342 reply state 000000002f878d26 transno 8589940424 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9966 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.926200:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9966 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.926205:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343049.926209:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343049.926211:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343049.926487:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+289:57561:x1848997993755648:12345-192.168.204.21@tcp:36:fsx.0 Request processed in 662us (1591us total) trans 8589940424 rc 0/0 00000100:00100000:2.0:1763343049.926496:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9812 00000020:00080000:2.0:1763343049.926502:0:10042:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343049.930052:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343049.930093:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.930153:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993755776 00000100:00100000:2.0:1763343049.930163:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993755776 00002000:00010000:2.0:1763343049.930206:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (0->18446744073709551615) 00002000:00100000:2.0:1763343049.930211:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34034f2a00 with x1848997993755776 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343049.930223:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34034f2a00. 00000100:00100000:2.0:1763343049.930410:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993755904 00000100:00100000:2.0:1763343049.930414:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993755904 00002000:00010000:2.0:1763343049.930427:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/729 (0->18446744073709551615) 00002000:00100000:2.0:1763343049.930431:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34034f0a80 with x1848997993755904 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343049.930437:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34034f0a80. 00000100:00100000:0.0:1763343049.930543:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1679 00000100:00100000:0.0:1763343049.930556:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993755776:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:0.0:1763343049.930943:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 100000 -> 0 00002000:00010000:0.0:1763343049.930947:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343049.930950:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343049.930952:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343049.930954:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343049.931099:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1680 00000100:00100000:2.0:1763343049.931109:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993755904:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:2.0:1763343049.931186:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343049.931189:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343049.931191:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343049.931193:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343049.931195:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343049.931483:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2429:x1848997993755776:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 929us (1440us total) trans 21474839074 rc 0/0 00000100:00100000:0.0:1763343049.931492:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1679 00002000:00010000:0.0:1763343049.931497:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (0->18446744073709551615) 00002000:00100000:0.0:1763343049.931500:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34034f2a00 with x1848997993755776 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343049.931507:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34034f2a00. 00000100:00100000:2.0:1763343049.931606:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993755904:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 499us (1512us total) trans 17179871775 rc 0/0 00000100:00100000:2.0:1763343049.931615:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1680 00002000:00010000:2.0:1763343049.931694:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/729 (0->18446744073709551615) 00002000:00100000:2.0:1763343049.931698:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34034f0a80 with x1848997993755904 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343049.931703:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34034f0a80. 00000100:00100000:3.0:1763343049.935329:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.935554:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993756160 00000100:00100000:2.0:1763343049.935565:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993756160 00000100:00100000:2.0:1763343049.935859:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9813 00000100:00100000:2.0:1763343049.935871:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+289:57561:x1848997993756160:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:2.0:1763343049.935895:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343049.935898:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763343049.935925:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6600/0x607405d401ae98ef lrc: 0/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca27e expref: 289 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.935943:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343049.935949:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343049.935962:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae996d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca2a8 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.936009:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9974 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.936024:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9974 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.936034:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9974 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00080000:2.0:1763343049.936156:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2d9:0x0], index 0: 0 00000004:00080000:2.0:1763343049.936162:0:10042:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2da:0x0], index 1: 0 00010000:00010000:2.0:1763343049.936250:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9974 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2a8 expref: 291 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.936259:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343049.936262:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343049.936285:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae996d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2a8 expref: 291 pid: 10042 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763343049.936298:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9974 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2a8 expref: 290 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.936318:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343049.936321:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763343049.936323:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34068abc00, rc 0) 00000100:00100000:2.0:1763343049.936377:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+290:57561:x1848997993756160:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 508us (1058us total) trans 8589940425 rc 0/0 00000100:00100000:2.0:1763343049.936385:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9813 00000100:00100000:1.0:1763343049.940508:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.941388:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993756288 00000100:00100000:2.0:1763343049.941398:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993756288 00000100:00100000:2.0:1763343049.941456:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6929 00000100:00100000:2.0:1763343049.941464:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:57561:x1848997993756288:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:2.0:1763343049.941482:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343049.941504:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34068aa000/0x607405d401ae997b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca2af expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343049.941526:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343049.941547:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343049.941549:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343049.941558:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34068aa000/0x607405d401ae997b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2af expref: 15 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.941573:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a34068aa000/0x607405d401ae997b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2af expref: 15 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.941585:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34068aa000, rc 0) 00000100:00100000:2.0:1763343049.941978:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:57561:x1848997993756288:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 513us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343049.941985:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6929 00000100:00100000:1.0:1763343049.945514:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.945859:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993756416 00000100:00100000:2.0:1763343049.945869:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993756416 00000100:00100000:2.0:1763343049.945924:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1681 00000100:00100000:2.0:1763343049.945932:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2432:x1848997993756416:12345-192.168.204.21@tcp:22:fsx.0 00002000:00010000:2.0:1763343049.946154:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1763343049.946157:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343049.946160:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343049.946162:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343049.946164:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:2.0:1763343049.946223:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993756416:12345-192.168.204.21@tcp:22:fsx.0 Request processed in 290us (716us total) trans 21474839075 rc 0/0 00000100:00100000:2.0:1763343049.946231:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1681 00000100:00100000:3.0:1763343049.946717:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343049.946840:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993756544 00000100:00100000:0.0:1763343049.946846:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993756544 00000100:00100000:0.0:1763343049.946880:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1682 00000100:00100000:0.0:1763343049.946887:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2431:x1848997993756544:12345-192.168.204.21@tcp:22:fsx.0 00002000:00010000:0.0:1763343049.947024:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1763343049.947027:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763343049.947029:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343049.947031:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763343049.947033:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb blocks from disk: 0 -> 6144 00000100:00100000:0.0:1763343049.947197:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2431:x1848997993756544:12345-192.168.204.21@tcp:22:fsx.0 Request processed in 308us (479us total) trans 21474839076 rc 0/0 00000100:00100000:0.0:1763343049.947205:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1682 00000100:00100000:1.0:1763343049.948806:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763343049.949035:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a350121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1848998010330880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1763343049.949087:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343049.949164:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3538756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1848998010330752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1763343049.949189:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343049.949272:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010330880 00000100:00100000:2.0:1763343049.949280:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010330880 00000100:00080000:0.0:1763343049.949569:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1763343049.949770:0:8411:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010330752 00000100:00100000:2.0:1763343049.949774:0:8411:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010330752 00000100:00080000:0.0:1763343049.949919:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1763343049.949958:0:8851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:1.0:1763343049.949966:0:8851:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1848998010330880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1763343049.949990:0:8851:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484898112 pending 0 free 3916046336 avail 3684524032 00000100:00100000:1.0:1763343049.950042:0:8851:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1848998010330880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343049.950048:0:8851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:1.0:1763343049.950067:0:8851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:1.0:1763343049.950073:0:8851:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1848998010330752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1763343049.950086:0:8851:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484898112 pending 0 free 3919175680 avail 3687653376 00000100:00100000:1.0:1763343049.950116:0:8851:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1848998010330752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343049.950122:0:8851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:1.0:1763343049.950162:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3538756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1848998010330752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1763343049.950285:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a350121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1848998010330880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1763343049.951887:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.952096:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993756800 00000100:00100000:2.0:1763343049.952104:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993756800 00000100:00100000:2.0:1763343049.952148:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9814 00000100:00100000:2.0:1763343049.952155:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+290:57561:x1848997993756800:12345-192.168.204.21@tcp:36:fsx.0 00010000:00010000:2.0:1763343049.952204:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343049.952230:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9974 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2a8 expref: 290 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.952248:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343049.952253:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343049.952519:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae9982 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.952533:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae9982 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.952541:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae9982 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000001:00080000:2.0:1763343049.952578:0:10042:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940426 00000004:00010000:2.0:1763343049.952594:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a549780e reply state 0000000076b69fc6 transno 8589940427 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae9982 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.952603:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae9982 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.952613:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343049.952616:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343049.952705:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343049.952795:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+292:57561:x1848997993756800:12345-192.168.204.21@tcp:36:fsx.0 Request processed in 640us (913us total) trans 8589940427 rc 0/0 00000100:00100000:2.0:1763343049.952802:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9814 00000020:00080000:2.0:1763343049.952806:0:10042:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343049.955339:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.955534:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993756928 00000100:00100000:2.0:1763343049.955543:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993756928 00000100:00100000:2.0:1763343049.955673:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9815 00000100:00100000:2.0:1763343049.955682:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+292:57561:x1848997993756928:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:2.0:1763343049.955703:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343049.955724:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9989 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca2b6 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.955774:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9989 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2b6 expref: 293 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.955788:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9989 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2b6 expref: 293 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.955805:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343049.955808:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343049.955811:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d600, rc 0) 00000100:00100000:2.0:1763343049.955866:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+293:57561:x1848997993756928:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 185us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343049.955873:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9815 00000100:00100000:3.0:1763343049.958766:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.959026:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993757056 00000100:00100000:2.0:1763343049.959036:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993757056 00000100:00100000:2.0:1763343049.959098:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6930 00000100:00100000:2.0:1763343049.959108:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:57561:x1848997993757056:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:2.0:1763343049.959126:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343049.959146:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9990 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca2bd expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343049.959169:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343049.959188:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343049.959190:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343049.959198:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9990 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2bd expref: 16 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.959212:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9990 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2bd expref: 16 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343049.959223:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:2.0:1763343049.959288:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:57561:x1848997993757056:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 181us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343049.959295:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6930 00000100:00100000:3.0:1763343049.962231:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.962949:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993757184 00000100:00100000:2.0:1763343049.962960:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993757184 00002000:00010000:2.0:1763343049.963001:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (0->18446744073709551615) 00002000:00100000:2.0:1763343049.963005:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538754e00 with x1848997993757184 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343049.963017:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3538754e00. 00000100:00100000:2.0:1763343049.963515:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1683 00000100:00100000:2.0:1763343049.963528:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993757184:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:2.0:1763343049.963772:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 1048576 -> 0 00002000:00010000:2.0:1763343049.963776:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343049.963779:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343049.963781:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343049.963784:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 2048 -> 0 00000100:00100000:2.0:1763343049.963849:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993757184:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 324us (1630us total) trans 21474839077 rc 0/0 00000100:00100000:2.0:1763343049.963856:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1683 00002000:00010000:2.0:1763343049.963860:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (0->18446744073709551615) 00002000:00100000:2.0:1763343049.963863:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538754e00 with x1848997993757184 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343049.963869:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3538754e00. 00000100:00100000:1.0:1763343049.965079:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343049.965341:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343049.965712:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.965727:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993757312 00000100:00100000:2.0:1763343049.965735:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993757312 00002000:00010000:2.0:1763343049.965768:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/729 (0->18446744073709551615) 00002000:00100000:2.0:1763343049.965771:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34034f2300 with x1848997993757312 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343049.965780:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34034f2300. 00000100:00100000:0.0:1763343049.965818:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993757568 00000100:00100000:0.0:1763343049.965822:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993757568 00002000:00010000:0.0:1763343049.965834:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/730 (0->18446744073709551615) 00002000:00100000:0.0:1763343049.965837:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34034f0380 with x1848997993757568 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343049.965842:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34034f0380. 00000100:00100000:0.0:1763343049.965872:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1684 00000100:00100000:0.0:1763343049.965879:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993757312:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:0.0:1763343049.965997:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343049.966001:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343049.966003:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343049.966006:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343049.966008:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343049.966046:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993757312:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 167us (972us total) trans 17179871776 rc 0/0 00000100:00100000:0.0:1763343049.966053:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1684 00002000:00010000:0.0:1763343049.966056:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/729 (0->18446744073709551615) 00002000:00100000:0.0:1763343049.966059:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34034f2300 with x1848997993757312 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343049.966062:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34034f2300. 00000100:00100000:0.0:1763343049.966076:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1685 00000100:00100000:0.0:1763343049.966082:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2430:x1848997993757568:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:0.0:1763343049.966145:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343049.966148:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb mtime from disk: 0 -> 1763343049 00002000:00010000:0.0:1763343049.966150:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343049.966152:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb ctime from disk: 0 -> 1763343049 00002000:00010000:0.0:1763343049.966155:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343049.966171:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2430:x1848997993757568:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 89us (830us total) trans 17179871777 rc 0/0 00000100:00100000:0.0:1763343049.966177:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1685 00002000:00010000:0.0:1763343049.966179:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/730 (0->18446744073709551615) 00002000:00100000:0.0:1763343049.966181:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34034f0380 with x1848997993757568 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343049.966185:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34034f0380. 00000100:00100000:3.0:1763343049.966431:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993757440 00000100:00100000:3.0:1763343049.966436:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993757440 00002000:00010000:3.0:1763343049.966451:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/729 (0->18446744073709551615) 00002000:00100000:3.0:1763343049.966454:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34034f0000 with x1848997993757440 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343049.966460:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34034f0000. 00000100:00100000:3.0:1763343049.966483:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1686 00000100:00100000:3.0:1763343049.966489:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34034f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:2429:x1848997993757440:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:3.0:1763343049.966615:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb size from disk: 4194304 -> 0 00002000:00010000:3.0:1763343049.966636:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb mtime from disk: 0 -> 1763343049 00002000:00010000:3.0:1763343049.966638:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343049.966640:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb ctime from disk: 0 -> 1763343049 00002000:00010000:3.0:1763343049.966643:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb blocks from disk: 6144 -> 0 00000100:00100000:3.0:1763343049.966689:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34034f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993757440:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 199us (976us total) trans 21474839078 rc 0/0 00000100:00100000:3.0:1763343049.966696:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1686 00002000:00010000:3.0:1763343049.966699:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/729 (0->18446744073709551615) 00002000:00100000:3.0:1763343049.966701:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34034f0000 with x1848997993757440 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343049.966705:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34034f0000. 00000100:00100000:1.0:1763343049.971021:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343049.971198:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343049.971961:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993757696 00000100:00100000:0.0:1763343049.971974:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993757696 00000100:00100000:0.0:1763343049.972046:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993757824 00000100:00100000:0.0:1763343049.972049:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993757824 00000100:00100000:0.0:1763343049.972216:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1687 00000100:00100000:0.0:1763343049.972227:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993757696:12345-192.168.204.21@tcp:22:fsx.0 00002000:00010000:0.0:1763343049.972378:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343049.972382:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343049.972385:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343049.972387:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343049.972390:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343049.972448:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503521c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993757696:12345-192.168.204.21@tcp:22:fsx.0 Request processed in 222us (1437us total) trans 21474839079 rc 0/0 00000100:00100000:0.0:1763343049.972456:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1687 00000100:00100000:0.0:1763343049.972473:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1688 00000100:00100000:0.0:1763343049.972479:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2429:x1848997993757824:12345-192.168.204.21@tcp:22:fsx.0 00002000:00010000:0.0:1763343049.972523:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343049.972525:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343049.972527:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343049.972529:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343049.972531:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343049.972548:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2429:x1848997993757824:12345-192.168.204.21@tcp:22:fsx.0 Request processed in 70us (1350us total) trans 21474839080 rc 0/0 00000100:00100000:0.0:1763343049.972553:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1688 00000100:00100000:3.0:1763343049.975742:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343049.975974:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993758080 00000100:00100000:2.0:1763343049.975984:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993758080 00000100:00100000:2.0:1763343049.976541:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9816 00000100:00100000:2.0:1763343049.976551:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+293:57561:x1848997993758080:12345-192.168.204.21@tcp:36:fsx.0 00010000:00010000:2.0:1763343049.976804:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9997 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.976825:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9997 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.976836:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9997 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000001:00080000:2.0:1763343049.976875:0:10042:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940428 00000004:00010000:2.0:1763343049.976891:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000085f0d561 reply state 0000000075ac32ca transno 8589940429 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9997 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.976902:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9997 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343049.976910:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343049.976913:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343049.976916:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343049.976998:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+296:57561:x1848997993758080:12345-192.168.204.21@tcp:36:fsx.0 Request processed in 448us (1264us total) trans 8589940429 rc 0/0 00000100:00100000:2.0:1763343049.977005:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9816 00000020:00080000:2.0:1763343049.977010:0:10042:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343049.984186:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343049.984898:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343049.985140:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343049.985233:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343049.985250:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993758336 00000100:00100000:1.0:1763343049.985260:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993758336 00002000:00010000:1.0:1763343049.985302:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/729 (0->18446744073709551615) 00002000:00100000:1.0:1763343049.985306:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538755500 with x1848997993758336 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343049.985318:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3538755500. 00000100:00100000:1.0:1763343049.985342:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993758592 00000100:00100000:1.0:1763343049.985346:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993758592 00002000:00010000:1.0:1763343049.985356:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/730 (0->18446744073709551615) 00002000:00100000:1.0:1763343049.985359:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538756680 with x1848997993758592 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343049.985365:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3538756680. 00000100:00100000:1.0:1763343049.985375:0:24024:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993758208 00000100:00100000:1.0:1763343049.985378:0:24024:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993758208 00002000:00010000:1.0:1763343049.985387:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (0->18446744073709551615) 00002000:00100000:1.0:1763343049.985390:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478f800 with x1848997993758208 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343049.985395:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340478f800. 00000100:00100000:1.0:1763343049.985413:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1689 00000100:00100000:1.0:1763343049.985421:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993758336:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:1.0:1763343049.985558:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343049.985562:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:1.0:1763343049.985565:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343049.985567:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:1.0:1763343049.985569:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343049.985638:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993758336:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 201us (1444us total) trans 17179871778 rc 0/0 00000100:00100000:1.0:1763343049.985660:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1689 00002000:00010000:1.0:1763343049.985665:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/729 (0->18446744073709551615) 00002000:00100000:1.0:1763343049.985667:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538755500 with x1848997993758336 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343049.985672:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3538755500. 00000100:00100000:1.0:1763343049.985689:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1690 00000100:00100000:1.0:1763343049.985696:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3538756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2430:x1848997993758592:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:1.0:1763343049.985740:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343049.985743:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:1.0:1763343049.985745:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343049.985747:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:1.0:1763343049.985749:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343049.985769:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3538756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+20:2430:x1848997993758592:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 73us (873us total) trans 17179871779 rc 0/0 00000100:00100000:1.0:1763343049.985775:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1690 00002000:00010000:1.0:1763343049.985778:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/730 (0->18446744073709551615) 00002000:00100000:1.0:1763343049.985781:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3538756680 with x1848997993758592 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343049.985784:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3538756680. 00000100:00100000:1.0:1763343049.985796:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1691 00000100:00100000:1.0:1763343049.985802:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2430:x1848997993758208:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:1.0:1763343049.985859:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343049.985863:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:1.0:1763343049.985865:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763343049.985867:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:1.0:1763343049.985870:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1763343049.985889:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993758208:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 87us (749us total) trans 21474839081 rc 0/0 00000100:00100000:1.0:1763343049.985896:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1691 00002000:00010000:1.0:1763343049.985899:0:24024:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (0->18446744073709551615) 00002000:00100000:1.0:1763343049.985902:0:24024:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478f800 with x1848997993758208 ext(0->18446744073709551615) 00002000:00010000:1.0:1763343049.985905:0:24024:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340478f800. 00000100:00100000:2.0:1763343049.986430:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993758464 00000100:00100000:2.0:1763343049.986437:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993758464 00002000:00010000:2.0:1763343049.986459:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/729 (0->18446744073709551615) 00002000:00100000:2.0:1763343049.986462:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478e680 with x1848997993758464 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343049.986469:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340478e680. 00000100:00100000:2.0:1763343049.987032:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1692 00000100:00100000:2.0:1763343049.987042:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2430:x1848997993758464:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:2.0:1763343049.987139:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343049.987142:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343049.987145:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343049.987147:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343049.987149:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343049.987191:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993758464:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 151us (1957us total) trans 21474839082 rc 0/0 00000100:00100000:2.0:1763343049.987200:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1692 00002000:00010000:2.0:1763343049.987203:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/729 (0->18446744073709551615) 00002000:00100000:2.0:1763343049.987206:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478e680 with x1848997993758464 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343049.987210:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340478e680. 00000100:00100000:3.0:1763343049.992927:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343049.993548:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.007849:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993758848 00000100:00100000:2.0:1763343050.007864:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993758848 00000100:00100000:2.0:1763343050.007934:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993758720 00000100:00100000:2.0:1763343050.007938:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993758720 00000100:00100000:2.0:1763343050.007983:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1693 00000100:00100000:2.0:1763343050.007994:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993758848:12345-192.168.204.21@tcp:22:fsx.0 00002000:00010000:2.0:1763343050.008238:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1763343050.008243:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.008245:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343050.008247:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.008250:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb blocks from disk: 0 -> 6144 00000100:00100000:2.0:1763343050.008305:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2430:x1848997993758848:12345-192.168.204.21@tcp:22:fsx.0 Request processed in 313us (15387us total) trans 21474839083 rc 0/0 00000100:00100000:2.0:1763343050.008313:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1693 00000100:00100000:2.0:1763343050.008329:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1694 00000100:00100000:2.0:1763343050.008335:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2429:x1848997993758720:12345-192.168.204.21@tcp:22:fsx.0 00002000:00010000:2.0:1763343050.008409:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1763343050.008412:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.008414:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343050.008416:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.008418:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:2.0:1763343050.008437:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2429:x1848997993758720:12345-192.168.204.21@tcp:22:fsx.0 Request processed in 102us (14891us total) trans 21474839084 rc 0/0 00000100:00100000:2.0:1763343050.008443:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1694 00000100:00100000:3.0:1763343050.012335:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.012422:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993759104 00000100:00100000:2.0:1763343050.012432:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993759104 00000100:00100000:2.0:1763343050.012500:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9817 00000100:00100000:2.0:1763343050.012510:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+296:57561:x1848997993759104:12345-192.168.204.21@tcp:36:fsx.0 00010000:00010000:2.0:1763343050.012780:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae999e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.012799:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae999e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.012811:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae999e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000001:00080000:2.0:1763343050.012859:0:10042:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940430 00000004:00010000:2.0:1763343050.012880:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000022c3fbd7 reply state 00000000df975cec transno 8589940431 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae999e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.012892:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae999e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.012900:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343050.012904:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343050.012907:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343050.013001:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+299:57561:x1848997993759104:12345-192.168.204.21@tcp:36:fsx.0 Request processed in 491us (675us total) trans 8589940431 rc 0/0 00000100:00100000:2.0:1763343050.013009:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9817 00000020:00080000:2.0:1763343050.013015:0:10042:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343050.016915:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.017019:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993759232 00000100:00100000:0.0:1763343050.017030:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993759232 00002000:00010000:0.0:1763343050.017070:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (0->18446744073709551615) 00002000:00100000:0.0:1763343050.017075:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478df80 with x1848997993759232 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343050.017087:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340478df80. 00000100:00100000:0.0:1763343050.017125:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1695 00000100:00100000:0.0:1763343050.017134:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2431:x1848997993759232:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:0.0:1763343050.017347:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 1048576 -> 0 00002000:00010000:0.0:1763343050.017351:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343050.017354:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343050.017357:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343050.017360:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 2048 -> 0 00000100:00100000:0.0:1763343050.017421:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2431:x1848997993759232:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 288us (515us total) trans 21474839085 rc 0/0 00000100:00100000:0.0:1763343050.017429:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1695 00002000:00010000:0.0:1763343050.017433:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (0->18446744073709551615) 00002000:00100000:0.0:1763343050.017436:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478df80 with x1848997993759232 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343050.017440:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340478df80. 00000100:00100000:3.0:1763343050.018717:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.018752:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.018780:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.018867:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993759488 00000100:00100000:2.0:1763343050.018875:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993759488 00002000:00010000:2.0:1763343050.018912:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/729 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.018916:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478fb80 with x1848997993759488 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.018926:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340478fb80. 00000100:00100000:2.0:1763343050.018953:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993759360 00000100:00100000:2.0:1763343050.018957:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993759360 00002000:00010000:2.0:1763343050.018969:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/729 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.018972:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478d180 with x1848997993759360 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.018978:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340478d180. 00000100:00100000:2.0:1763343050.018990:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993759616 00000100:00100000:2.0:1763343050.018993:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993759616 00002000:00010000:2.0:1763343050.019004:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/730 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.019007:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478e300 with x1848997993759616 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.019012:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340478e300. 00000100:00100000:2.0:1763343050.019025:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1696 00000100:00100000:2.0:1763343050.019033:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2432:x1848997993759488:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:2.0:1763343050.019216:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb size from disk: 4194304 -> 0 00002000:00010000:2.0:1763343050.019219:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.019222:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343050.019224:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.019227:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb blocks from disk: 6144 -> 0 00000100:00100000:2.0:1763343050.019270:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2432:x1848997993759488:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 237us (558us total) trans 21474839086 rc 0/0 00000100:00100000:2.0:1763343050.019278:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1696 00002000:00010000:2.0:1763343050.019282:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/729 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.019284:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478fb80 with x1848997993759488 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.019288:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340478fb80. 00000100:00100000:2.0:1763343050.019306:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1697 00000100:00100000:2.0:1763343050.019313:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2432:x1848997993759360:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:2.0:1763343050.019375:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343050.019378:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.019381:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343050.019383:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.019385:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343050.019406:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2432:x1848997993759360:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 94us (653us total) trans 17179871780 rc 0/0 00000100:00100000:2.0:1763343050.019412:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1697 00002000:00010000:2.0:1763343050.019415:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/729 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.019417:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478d180 with x1848997993759360 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.019421:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340478d180. 00000100:00100000:2.0:1763343050.019434:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1698 00000100:00100000:2.0:1763343050.019441:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+21:2432:x1848997993759616:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:2.0:1763343050.019485:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343050.019488:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.019490:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343050.019492:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.019494:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343050.019513:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+22:2432:x1848997993759616:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 73us (733us total) trans 17179871781 rc 0/0 00000100:00100000:2.0:1763343050.019519:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1698 00002000:00010000:2.0:1763343050.019522:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/730 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.019524:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478e300 with x1848997993759616 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.019529:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340478e300. 00000100:00100000:3.0:1763343050.024035:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.024148:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993759744 00000100:00100000:0.0:1763343050.024159:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993759744 00000100:00100000:0.0:1763343050.024229:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1699 00000100:00100000:0.0:1763343050.024239:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2429:x1848997993759744:12345-192.168.204.21@tcp:22:fsx.0 00002000:00010000:0.0:1763343050.024463:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343050.024467:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343050.024469:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343050.024471:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343050.024474:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:0.0:1763343050.024552:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2429:x1848997993759744:12345-192.168.204.21@tcp:22:fsx.0 Request processed in 314us (527us total) trans 21474839087 rc 0/0 00000100:00100000:0.0:1763343050.024560:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1699 00000100:00100000:3.0:1763343050.027353:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.027467:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993759872 00000100:00100000:2.0:1763343050.027478:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993759872 00000100:00100000:2.0:1763343050.027554:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1700 00000100:00100000:2.0:1763343050.027565:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2430:x1848997993759872:12345-192.168.204.21@tcp:22:fsx.0 00002000:00010000:2.0:1763343050.027838:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343050.027843:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.027845:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343050.027848:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.027850:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb blocks from disk: 0 -> 6144 00000100:00100000:2.0:1763343050.027914:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2430:x1848997993759872:12345-192.168.204.21@tcp:22:fsx.0 Request processed in 349us (569us total) trans 21474839088 rc 0/0 00000100:00100000:2.0:1763343050.027922:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1700 00000100:00100000:1.0:1763343050.031183:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.032480:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993760128 00000100:00100000:0.0:1763343050.032495:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993760128 00000100:00100000:0.0:1763343050.032560:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9818 00000100:00100000:0.0:1763343050.032570:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+299:57561:x1848997993760128:12345-192.168.204.21@tcp:36:fsx.0 00010000:00010000:0.0:1763343050.032831:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae99a5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.032852:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae99a5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.032864:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae99a5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:0.0:1763343050.032910:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940432 00000004:00010000:0.0:1763343050.032928:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007472f663 reply state 00000000ffa3e014 transno 8589940433 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae99a5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.032940:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae99a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.032948:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:0.0:1763343050.032952:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343050.032955:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343050.033043:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+302:57561:x1848997993760128:12345-192.168.204.21@tcp:36:fsx.0 Request processed in 473us (1870us total) trans 8589940433 rc 0/0 00000100:00100000:0.0:1763343050.033051:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9818 00000020:00080000:0.0:1763343050.033056:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343050.036095:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.036131:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.036160:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.036188:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.036269:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993760384 00000100:00100000:2.0:1763343050.036279:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993760384 00002000:00010000:2.0:1763343050.036321:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/729 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.036326:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478f480 with x1848997993760384 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.036339:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340478f480. 00000100:00100000:2.0:1763343050.036373:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993760640 00000100:00100000:2.0:1763343050.036377:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993760640 00002000:00010000:2.0:1763343050.036393:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/730 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.036396:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478d500 with x1848997993760640 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.036401:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340478d500. 00000100:00100000:2.0:1763343050.036414:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993760256 00000100:00100000:2.0:1763343050.036417:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993760256 00002000:00010000:2.0:1763343050.036428:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.036431:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3405b7c380 with x1848997993760256 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.036437:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3405b7c380. 00000100:00100000:2.0:1763343050.036447:0:28426:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993760512 00000100:00100000:2.0:1763343050.036449:0:28426:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993760512 00002000:00010000:2.0:1763343050.036457:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/729 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.036460:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3405b7ed80 with x1848997993760512 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.036465:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3405b7ed80. 00000100:00100000:2.0:1763343050.036481:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1701 00000100:00100000:2.0:1763343050.036490:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993760384:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:2.0:1763343050.036680:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343050.036683:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.036686:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343050.036688:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.036691:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2d9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343050.036739:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993760384:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 250us (653us total) trans 17179871782 rc 0/0 00000100:00100000:2.0:1763343050.036746:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1701 00002000:00010000:2.0:1763343050.036749:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/729 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.036752:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478f480 with x1848997993760384 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.036756:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340478f480. 00000100:00100000:2.0:1763343050.036772:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1702 00000100:00100000:2.0:1763343050.036778:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340478d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+23:2430:x1848997993760640:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:2.0:1763343050.036839:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343050.036842:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.036844:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343050.036847:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.036849:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343050.036869:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340478d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993760640:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 91us (737us total) trans 17179871783 rc 0/0 00000100:00100000:2.0:1763343050.036875:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1702 00002000:00010000:2.0:1763343050.036878:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/730 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.036881:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340478d500 with x1848997993760640 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.036885:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340478d500. 00000100:00100000:2.0:1763343050.036899:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1703 00000100:00100000:2.0:1763343050.036906:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2430:x1848997993760256:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:2.0:1763343050.036968:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343050.036971:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.036974:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343050.036976:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.036978:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1763343050.037001:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993760256:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 95us (840us total) trans 21474839089 rc 0/0 00000100:00100000:2.0:1763343050.037007:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1703 00002000:00010000:2.0:1763343050.037010:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.037013:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3405b7c380 with x1848997993760256 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.037017:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3405b7c380. 00000100:00100000:2.0:1763343050.037030:0:28426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1704 00000100:00100000:2.0:1763343050.037037:0:28426:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2430:x1848997993760512:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:2.0:1763343050.037082:0:28426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343050.037085:0:28426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.037088:0:28426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343050.037090:0:28426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:2.0:1763343050.037093:0:28426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1763343050.037111:0:28426:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2430:x1848997993760512:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 75us (922us total) trans 21474839090 rc 0/0 00000100:00100000:2.0:1763343050.037118:0:28426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1704 00002000:00010000:2.0:1763343050.037121:0:28426:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/729 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.037123:0:28426:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3405b7ed80 with x1848997993760512 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.037128:0:28426:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3405b7ed80. 00000100:00100000:1.0:1763343050.045210:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.045300:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993760768 00000100:00100000:3.0:1763343050.045313:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993760768 00000100:00100000:3.0:1763343050.045368:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6931 00000100:00100000:3.0:1763343050.045377:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+31:2432:x1848997993760768:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:3.0:1763343050.045394:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343050.045414:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6600/0x607405d401ae99ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca2c4 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763343050.045437:0:28996:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1763343050.045456:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343050.045459:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343050.045467:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6600/0x607405d401ae99ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2c4 expref: 32 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343050.045482:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6600/0x607405d401ae99ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2c4 expref: 32 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763343050.045495:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3405de6600, rc 0) 00000100:00100000:3.0:1763343050.045557:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2432:x1848997993760768:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 181us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343050.045564:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6931 00000100:00100000:3.0:1763343050.048424:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.048532:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993760896 00000100:00100000:2.0:1763343050.048543:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993760896 00000100:00100000:2.0:1763343050.048609:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9819 00000100:00100000:2.0:1763343050.048661:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+302:57561:x1848997993760896:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:2.0:1763343050.048687:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343050.048711:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae99b3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca2cb expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.048810:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99ba lrc: 3/1,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.048827:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99ba lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.048838:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99ba lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343050.048867:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x207:0x0]: returning size 0 00000004:00200000:2.0:1763343050.048871:0:10042:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343050.048890:0:10042:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99ba lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.048920:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae99b3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2cb expref: 304 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.048939:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99ba lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2cb expref: 303 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.048949:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343050.048952:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343050.048956:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3537b6cc00, rc 0) 00000100:00100000:2.0:1763343050.049018:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+303:57561:x1848997993760896:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 400us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.049027:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9819 00000100:00100000:1.0:1763343050.055074:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.056581:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993761152 00000100:00100000:0.0:1763343050.056597:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993761152 00000100:00100000:2.0:1763343050.057522:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9820 00000100:00100000:2.0:1763343050.057543:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+303:57561:x1848997993761152:12345-192.168.204.21@tcp:36:fsx.0 00010000:00010000:2.0:1763343050.057607:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343050.057667:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99ba lrc: 0/0,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2cb expref: 303 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.057688:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343050.057694:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343050.057868:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae99c1 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.057882:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae99c1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.057891:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae99c1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000001:00080000:2.0:1763343050.057932:0:10042:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940434 00000004:00010000:2.0:1763343050.057951:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b26d9fb0 reply state 000000005f119618 transno 8589940435 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae99c1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.057961:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae99c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.057966:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343050.057968:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343050.057971:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343050.058069:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+305:57561:x1848997993761152:12345-192.168.204.21@tcp:36:fsx.0 Request processed in 534us (3003us total) trans 8589940435 rc 0/0 00000100:00100000:2.0:1763343050.058076:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9820 00000020:00080000:2.0:1763343050.058081:0:10042:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343050.062113:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.062491:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993761280 00000100:00100000:0.0:1763343050.062503:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993761280 00002000:00010000:0.0:1763343050.062546:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (181679->18446744073709551615) 00002000:00100000:0.0:1763343050.062551:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503523480 with x1848997993761280 ext(181679->18446744073709551615) 00002000:00010000:0.0:1763343050.062564:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503523480. 00000100:00100000:0.0:1763343050.062600:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1705 00000100:00100000:0.0:1763343050.062610:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+32:2429:x1848997993761280:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:0.0:1763343050.063776:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 0 -> 181679 00002000:00010000:0.0:1763343050.063784:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343050.063786:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343050.063789:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343050.063791:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 2048 -> 360 00000100:00100000:0.0:1763343050.063861:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503523480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+33:2429:x1848997993761280:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 1250us (1756us total) trans 21474839091 rc 0/0 00000100:00100000:0.0:1763343050.063871:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1705 00002000:00010000:0.0:1763343050.063875:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (181679->18446744073709551615) 00002000:00100000:0.0:1763343050.063878:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503523480 with x1848997993761280 ext(181679->18446744073709551615) 00002000:00010000:0.0:1763343050.063883:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503523480. 00000100:00100000:3.0:1763343050.065966:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.065994:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.066084:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993761408 00000100:00100000:0.0:1763343050.066094:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993761408 00002000:00010000:0.0:1763343050.066130:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/729 (0->18446744073709551615) 00002000:00100000:0.0:1763343050.066134:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3405b7e680 with x1848997993761408 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343050.066145:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3405b7e680. 00000100:00100000:0.0:1763343050.066172:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993761536 00000100:00100000:0.0:1763343050.066175:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993761536 00002000:00010000:0.0:1763343050.066186:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/730 (0->18446744073709551615) 00002000:00100000:0.0:1763343050.066188:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3405b7ea00 with x1848997993761536 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343050.066194:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3405b7ea00. 00000100:00100000:0.0:1763343050.066804:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1706 00000100:00100000:0.0:1763343050.066818:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+33:2429:x1848997993761408:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:0.0:1763343050.066964:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343050.066967:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343050.066970:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343050.066972:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343050.066975:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1763343050.067039:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2429:x1848997993761408:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 224us (1082us total) trans 21474839092 rc 0/0 00000100:00100000:0.0:1763343050.067047:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1706 00002000:00010000:0.0:1763343050.067051:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/729 (0->18446744073709551615) 00002000:00100000:0.0:1763343050.067054:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3405b7e680 with x1848997993761408 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343050.067059:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3405b7e680. 00000100:00100000:0.0:1763343050.067076:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1707 00000100:00100000:0.0:1763343050.067083:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+24:2430:x1848997993761536:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:0.0:1763343050.067145:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343050.067148:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb mtime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343050.067150:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343050.067152:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb ctime from disk: 1763343049 -> 1763343049 00002000:00010000:0.0:1763343050.067154:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343050.067173:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2430:x1848997993761536:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 91us (1179us total) trans 17179871784 rc 0/0 00000100:00100000:0.0:1763343050.067179:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1707 00002000:00010000:0.0:1763343050.067182:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/730 (0->18446744073709551615) 00002000:00100000:0.0:1763343050.067184:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3405b7ea00 with x1848997993761536 ext(0->18446744073709551615) 00002000:00010000:0.0:1763343050.067188:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a3405b7ea00. 00000100:00100000:1.0:1763343050.072068:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.072282:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993761664 00000100:00100000:0.0:1763343050.072293:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993761664 00000100:00100000:0.0:1763343050.073017:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9821 00000100:00100000:0.0:1763343050.073030:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+305:57561:x1848997993761664:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:0.0:1763343050.073057:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343050.073081:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae99c8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca2d2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.073177:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae99cf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.073191:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae99cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.073203:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae99cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343050.073230:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x207:0x0]: returning size 181679 00000004:00200000:0.0:1763343050.073234:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343050.073253:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae99cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.073279:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc000/0x607405d401ae99c8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2d2 expref: 307 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.073297:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae99cf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2d2 expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.073308:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:0.0:1763343050.073312:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343050.073315:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176200, rc 0) 00000100:00100000:0.0:1763343050.073386:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+306:57561:x1848997993761664:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 358us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343050.073393:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9821 00000100:00100000:1.0:1763343050.078902:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.079434:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993761792 00000100:00100000:3.0:1763343050.079445:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993761792 00002000:00100000:3.0:1763343050.079497:0:24021:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x2d7:0x0] (69632->73727) req@ffff9a3503521880 x1848997993761792/t0(0) o3->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 488/0 e 0 to 0 dl 1763343061 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1763343050.079507:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503521880 with x1848997993761792 ext(69632->73727) 00002000:00010000:3.0:1763343050.079513:0:24021:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503521880 00000100:00100000:3.0:1763343050.079949:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1708 00000100:00100000:3.0:1763343050.079959:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2430:x1848997993761792:12345-192.168.204.21@tcp:3:kworker.0 00000100:00100000:3.0:1763343050.080525:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2430:x1848997993761792:12345-192.168.204.21@tcp:3:kworker.0 Request processed in 564us (1629us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763343050.080534:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1708 00002000:00100000:3.0:1763343050.080543:0:24021:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x2d7:0x0] (69632->73727) req@ffff9a3503521880 x1848997993761792/t0(0) o3->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 488/4536 e 0 to 0 dl 1763343061 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1763343050.080553:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503521880 with x1848997993761792 ext(69632->73727) 00002000:00010000:3.0:1763343050.080558:0:24021:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503521880 00000100:00100000:3.0:1763343050.085855:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.086048:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993761920 00000100:00100000:0.0:1763343050.086060:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993761920 00002000:00100000:0.0:1763343050.086114:0:24021:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x2d7:0x0] (73728->77823) req@ffff9a3405b7df80 x1848997993761920/t0(0) o3->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 488/0 e 0 to 0 dl 1763343061 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1763343050.086127:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3405b7df80 with x1848997993761920 ext(73728->77823) 00002000:00010000:0.0:1763343050.086132:0:24021:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3405b7df80 00000100:00100000:0.0:1763343050.086165:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1709 00000100:00100000:0.0:1763343050.086175:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2430:x1848997993761920:12345-192.168.204.21@tcp:3:kworker.0 00000100:00100000:0.0:1763343050.086382:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2430:x1848997993761920:12345-192.168.204.21@tcp:3:kworker.0 Request processed in 208us (538us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763343050.086390:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1709 00002000:00100000:0.0:1763343050.086396:0:24021:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x2d7:0x0] (73728->77823) req@ffff9a3405b7df80 x1848997993761920/t0(0) o3->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 488/4536 e 0 to 0 dl 1763343061 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1763343050.086404:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3405b7df80 with x1848997993761920 ext(73728->77823) 00002000:00010000:0.0:1763343050.086407:0:24021:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3405b7df80 00000100:00100000:1.0:1763343050.090926:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.091018:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993762048 00000100:00100000:0.0:1763343050.091029:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993762048 00002000:00100000:0.0:1763343050.091077:0:8415:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x2d7:0x0] (49152->114687) req@ffff9a3503521180 x1848997993762048/t0(0) o3->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 504/0 e 0 to 0 dl 1763343061 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1763343050.091088:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503521180 with x1848997993762048 ext(49152->114687) 00002000:00010000:0.0:1763343050.091094:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503521180 00000100:00100000:0.0:1763343050.091166:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1710 00000100:00100000:0.0:1763343050.091176:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2429:x1848997993762048:12345-192.168.204.21@tcp:3:kworker.0 00000100:00100000:1.0:1763343050.097003:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503521180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2429:x1848997993762048:12345-192.168.204.21@tcp:3:kworker.0 Request processed in 5816us (6075us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1763343050.097018:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1710 00002000:00100000:1.0:1763343050.097032:0:8415:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x2d7:0x0] (49152->114687) req@ffff9a3503521180 x1848997993762048/t0(0) o3->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 504/440 e 0 to 0 dl 1763343061 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1763343050.097043:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503521180 with x1848997993762048 ext(49152->114687) 00002000:00010000:1.0:1763343050.097050:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503521180 00000100:00100000:1.0:1763343050.100333:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.100929:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993762176 00000100:00100000:2.0:1763343050.100940:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993762176 00002000:00100000:2.0:1763343050.100994:0:8415:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x2d7:0x0] (114688->151551) req@ffff9a3503522300 x1848997993762176/t0(0) o3->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 488/0 e 0 to 0 dl 1763343061 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1763343050.101007:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503522300 with x1848997993762176 ext(114688->151551) 00002000:00010000:2.0:1763343050.101013:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503522300 00000100:00100000:2.0:1763343050.101045:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1711 00000100:00100000:2.0:1763343050.101053:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2430:x1848997993762176:12345-192.168.204.21@tcp:3:kworker.0 00000100:00100000:2.0:1763343050.105087:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503522300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2430:x1848997993762176:12345-192.168.204.21@tcp:3:kworker.0 Request processed in 3555us (4286us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1763343050.105107:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1711 00002000:00100000:2.0:1763343050.105121:0:8415:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x2d7:0x0] (114688->151551) req@ffff9a3503522300 x1848997993762176/t0(0) o3->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 488/440 e 0 to 0 dl 1763343061 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1763343050.105139:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503522300 with x1848997993762176 ext(114688->151551) 00002000:00010000:2.0:1763343050.105145:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503522300 00000100:00100000:1.0:1763343050.111204:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.111340:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993762304 00000100:00100000:2.0:1763343050.111351:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993762304 00002000:00100000:2.0:1763343050.111396:0:8415:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x2d7:0x0] (151552->184319) req@ffff9a3503523b80 x1848997993762304/t0(0) o3->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 488/0 e 0 to 0 dl 1763343061 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1763343050.111408:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503523b80 with x1848997993762304 ext(151552->184319) 00002000:00010000:2.0:1763343050.111414:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503523b80 00000100:00100000:2.0:1763343050.111446:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1712 00000100:00100000:2.0:1763343050.111456:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2429:x1848997993762304:12345-192.168.204.21@tcp:3:kworker.0 00000100:00100000:2.0:1763343050.114592:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2429:x1848997993762304:12345-192.168.204.21@tcp:3:kworker.0 Request processed in 3126us (3388us total) trans 0 rc 32768/32768 00000100:00100000:2.0:1763343050.114606:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1712 00002000:00100000:2.0:1763343050.114672:0:8415:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x2d7:0x0] (151552->184319) req@ffff9a3503523b80 x1848997993762304/t0(0) o3->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 488/440 e 0 to 0 dl 1763343061 ref 1 fl Complete:/600/0 rc 32768/32768 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1763343050.114684:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503523b80 with x1848997993762304 ext(151552->184319) 00002000:00010000:2.0:1763343050.114690:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503523b80 00000100:00100000:1.0:1763343050.119479:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.119701:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993762560 00000100:00100000:2.0:1763343050.119712:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993762560 00000100:00100000:2.0:1763343050.119768:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9822 00000100:00100000:2.0:1763343050.119778:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+306:57561:x1848997993762560:12345-192.168.204.21@tcp:36:fsx.0 00010000:00010000:2.0:1763343050.119837:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343050.119866:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae99cf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2d2 expref: 306 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.119889:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343050.119894:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763343050.120074:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99d6 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.120091:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99d6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.120100:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99d6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000001:00080000:2.0:1763343050.120145:0:10042:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940436 00000004:00010000:2.0:1763343050.120168:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bb5f0882 reply state 00000000aa7cc3dc transno 8589940437 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99d6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.120179:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.120185:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343050.120188:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1763343050.120191:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343050.120298:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+308:57561:x1848997993762560:12345-192.168.204.21@tcp:36:fsx.0 Request processed in 519us (827us total) trans 8589940437 rc 0/0 00000100:00100000:2.0:1763343050.120306:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9822 00000020:00080000:2.0:1763343050.120312:0:10042:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343050.124196:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.125586:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993762688 00000100:00100000:2.0:1763343050.125603:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993762688 00002000:00010000:2.0:1763343050.125684:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (234051->18446744073709551615) 00002000:00100000:2.0:1763343050.125689:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503523800 with x1848997993762688 ext(234051->18446744073709551615) 00002000:00010000:2.0:1763343050.125705:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503523800. 00000100:00100000:2.0:1763343050.125746:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1713 00000100:00100000:2.0:1763343050.125757:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+34:2429:x1848997993762688:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:2.0:1763343050.125979:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 181679 -> 234051 00002000:00010000:2.0:1763343050.125983:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343049 -> 1763343050 00002000:00010000:2.0:1763343050.125986:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343050.125988:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343049 -> 1763343050 00002000:00010000:2.0:1763343050.125990:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 360 -> 360 00000100:00100000:2.0:1763343050.126056:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+35:2429:x1848997993762688:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 300us (1870us total) trans 21474839093 rc 0/0 00000100:00100000:2.0:1763343050.126065:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1713 00002000:00010000:2.0:1763343050.126069:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (234051->18446744073709551615) 00002000:00100000:2.0:1763343050.126072:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503523800 with x1848997993762688 ext(234051->18446744073709551615) 00002000:00010000:2.0:1763343050.126077:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503523800. 00000100:00100000:1.0:1763343050.128861:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.129097:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993762816 00000100:00100000:3.0:1763343050.129109:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993762816 00002000:00010000:3.0:1763343050.129150:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/729 (0->18446744073709551615) 00002000:00100000:3.0:1763343050.129154:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503520700 with x1848997993762816 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343050.129167:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503520700. 00000100:00100000:3.0:1763343050.129206:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1714 00000100:00100000:3.0:1763343050.129217:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3503520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+35:2430:x1848997993762816:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:3.0:1763343050.129376:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343050.129380:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb mtime from disk: 1763343049 -> 1763343050 00002000:00010000:3.0:1763343050.129383:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343050.129385:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb ctime from disk: 1763343049 -> 1763343050 00002000:00010000:3.0:1763343050.129387:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1763343050.131522:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3503520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+36:2430:x1848997993762816:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 2293us (2656us total) trans 21474839094 rc 0/0 00000100:00100000:3.0:1763343050.131537:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1714 00002000:00010000:3.0:1763343050.131543:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/729 (0->18446744073709551615) 00002000:00100000:3.0:1763343050.131547:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3503520700 with x1848997993762816 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343050.131557:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3503520700. 00000100:00100000:0.0:1763343050.132087:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.132251:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993762944 00000100:00100000:2.0:1763343050.132276:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993762944 00002000:00010000:2.0:1763343050.132320:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/730 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.132324:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060abb80 with x1848997993762944 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.132332:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34060abb80. 00000100:00100000:2.0:1763343050.132369:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1715 00000100:00100000:2.0:1763343050.132379:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+25:2430:x1848997993762944:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:2.0:1763343050.132541:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343050.132545:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb mtime from disk: 1763343049 -> 1763343050 00002000:00010000:2.0:1763343050.132548:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343050.132551:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb ctime from disk: 1763343049 -> 1763343050 00002000:00010000:2.0:1763343050.132553:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343050.132617:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2430:x1848997993762944:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 239us (533us total) trans 17179871785 rc 0/0 00000100:00100000:2.0:1763343050.132659:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1715 00002000:00010000:2.0:1763343050.132663:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/730 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.132666:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060abb80 with x1848997993762944 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.132670:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34060abb80. 00000100:00100000:0.0:1763343050.136115:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.136500:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993763072 00000100:00100000:3.0:1763343050.136513:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993763072 00000100:00100000:3.0:1763343050.136959:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9823 00000100:00100000:3.0:1763343050.136971:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+308:57561:x1848997993763072:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:3.0:1763343050.136997:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343050.137019:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae99dd lrc: 2/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca2d9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.137117:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae99e4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343050.137131:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae99e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343050.137142:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae99e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:3.0:1763343050.137170:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x207:0x0]: returning size 234051 00000004:00200000:3.0:1763343050.137174:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1763343050.137193:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae99e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343050.137219:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6200/0x607405d401ae99dd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2d9 expref: 310 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.137234:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae99e4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2d9 expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.137243:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:3.0:1763343050.137246:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763343050.137251:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35379c1800, rc 0) 00000100:00100000:3.0:1763343050.138191:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+309:57561:x1848997993763072:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 1217us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343050.138201:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9823 00000100:00100000:1.0:1763343050.143481:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.143577:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993763200 00000100:00100000:3.0:1763343050.143591:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993763200 00002000:00100000:3.0:1763343050.143744:0:8415:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x2d7:0x0] (184320->204799) req@ffff9a340ccc3b80 x1848997993763200/t0(0) o3->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 488/0 e 0 to 0 dl 1763343061 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763343050.143754:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340ccc3b80 with x1848997993763200 ext(184320->204799) 00002000:00010000:3.0:1763343050.143760:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340ccc3b80 00000100:00100000:3.0:1763343050.143928:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1716 00000100:00100000:3.0:1763343050.143938:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+36:2431:x1848997993763200:12345-192.168.204.21@tcp:3:fsx.0 00000100:00100000:2.0:1763343050.146981:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+36:2431:x1848997993763200:12345-192.168.204.21@tcp:3:fsx.0 Request processed in 3031us (3498us total) trans 0 rc 20480/20480 00000100:00100000:2.0:1763343050.146996:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1716 00002000:00100000:2.0:1763343050.147010:0:8415:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x2d7:0x0] (184320->204799) req@ffff9a340ccc3b80 x1848997993763200/t0(0) o3->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 488/440 e 0 to 0 dl 1763343061 ref 1 fl Complete:/600/0 rc 20480/20480 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343050.147021:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340ccc3b80 with x1848997993763200 ext(184320->204799) 00002000:00010000:2.0:1763343050.147028:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340ccc3b80 00000100:00100000:1.0:1763343050.151956:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.152095:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993763328 00000100:00100000:2.0:1763343050.152107:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993763328 00002000:00100000:2.0:1763343050.152159:0:8415:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x2d7:0x0] (0->237567) req@ffff9a340ccc0700 x1848997993763328/t0(0) o3->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 504/0 e 0 to 0 dl 1763343061 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343050.152170:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340ccc0700 with x1848997993763328 ext(0->237567) 00002000:00010000:2.0:1763343050.152176:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340ccc0700 00000100:00100000:2.0:1763343050.152331:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1717 00000100:00100000:2.0:1763343050.152341:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+36:2430:x1848997993763328:12345-192.168.204.21@tcp:3:fsx.0 00000100:00100000:2.0:1763343050.157586:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+36:2430:x1848997993763328:12345-192.168.204.21@tcp:3:fsx.0 Request processed in 5232us (5625us total) trans 0 rc 81920/81920 00000100:00100000:2.0:1763343050.157599:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1717 00002000:00100000:2.0:1763343050.157614:0:8415:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x2d7:0x0] (0->237567) req@ffff9a340ccc0700 x1848997993763328/t0(0) o3->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 504/440 e 0 to 0 dl 1763343061 ref 1 fl Complete:/600/0 rc 81920/81920 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343050.157668:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340ccc0700 with x1848997993763328 ext(0->237567) 00002000:00010000:2.0:1763343050.157674:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340ccc0700 00000100:00100000:0.0:1763343050.162231:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.163575:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993763456 00000100:00100000:2.0:1763343050.163591:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993763456 00000100:00100000:2.0:1763343050.163812:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1718 00000100:00100000:2.0:1763343050.163824:0:8415:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+36:2429:x1848997993763456:12345-192.168.204.21@tcp:22:fsx.0 00002000:00010000:2.0:1763343050.163990:0:8415:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 234051 -> 234051 00002000:00010000:2.0:1763343050.163993:0:8415:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343050 -> 1763343050 00002000:00010000:2.0:1763343050.163995:0:8415:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343050.163997:0:8415:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343050 -> 1763343050 00002000:00010000:2.0:1763343050.164000:0:8415:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 360 -> 360 00000100:00100000:2.0:1763343050.164241:0:8415:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+37:2429:x1848997993763456:12345-192.168.204.21@tcp:22:fsx.0 Request processed in 418us (2018us total) trans 21474839095 rc 0/0 00000100:00100000:2.0:1763343050.164249:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1718 00000100:00100000:1.0:1763343050.167975:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.168069:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993763712 00000100:00100000:3.0:1763343050.168080:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993763712 00000100:00100000:3.0:1763343050.168145:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9824 00000100:00100000:3.0:1763343050.168155:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+309:57561:x1848997993763712:12345-192.168.204.21@tcp:36:fsx.0 00010000:00010000:3.0:1763343050.168215:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343050.168242:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae99e4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2d9 expref: 309 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.168262:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:3.0:1763343050.168321:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343050.168504:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae99eb lrc: 3/0,1 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343050.168520:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae99eb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343050.168529:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae99eb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:3.0:1763343050.168575:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940438 00000004:00010000:3.0:1763343050.168599:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005ade24a7 reply state 00000000886451a7 transno 8589940439 ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae99eb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343050.168615:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae99eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343050.168741:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:3.0:1763343050.168744:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343050.168747:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763343050.168902:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+311:57561:x1848997993763712:12345-192.168.204.21@tcp:36:fsx.0 Request processed in 746us (936us total) trans 8589940439 rc 0/0 00000100:00100000:2.0:1763343050.168919:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9824 00000020:00080000:2.0:1763343050.168925:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343050.183917:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.186059:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.186114:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.186186:0:24021:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993763840 00000100:00100000:3.0:1763343050.186206:0:24021:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993763840 00000100:00100000:2.0:1763343050.186207:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993764096 00000100:00100000:2.0:1763343050.186210:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993764096 00002000:00010000:3.0:1763343050.186245:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (18392->18446744073709551615) 00002000:00010000:2.0:1763343050.186245:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/730 (0->18446744073709551615) 00002000:00100000:3.0:1763343050.186250:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340ccc0a80 with x1848997993763840 ext(18392->18446744073709551615) 00002000:00100000:2.0:1763343050.186250:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060ab480 with x1848997993764096 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343050.186261:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340ccc0a80. 00002000:00010000:2.0:1763343050.186261:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34060ab480. 00000100:00100000:2.0:1763343050.186292:0:8415:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993763968 00000100:00100000:2.0:1763343050.186297:0:8415:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993763968 00002000:00010000:2.0:1763343050.186310:0:8415:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/729 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.186313:0:8415:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060a8000 with x1848997993763968 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.186318:0:8415:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34060a8000. 00000100:00100000:3.0:1763343050.186366:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1719 00000100:00100000:3.0:1763343050.186377:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+26:2432:x1848997993764096:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:3.0:1763343050.186519:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343050.186522:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb mtime from disk: 1763343050 -> 1763343050 00002000:00010000:3.0:1763343050.186525:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343050.186527:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb ctime from disk: 1763343050 -> 1763343050 00002000:00010000:3.0:1763343050.186530:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343050.186548:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1720 00000100:00100000:0.0:1763343050.186556:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+38:2432:x1848997993763840:12345-192.168.204.21@tcp:10:fsx.0 00000100:00100000:3.0:1763343050.186583:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2432:x1848997993764096:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 209us (532us total) trans 17179871786 rc 0/0 00000100:00100000:3.0:1763343050.186591:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1719 00002000:00010000:3.0:1763343050.186594:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/730 (0->18446744073709551615) 00002000:00100000:3.0:1763343050.186597:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060ab480 with x1848997993764096 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343050.186601:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a34060ab480. 00000100:00100000:3.0:1763343050.186616:0:24021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1721 00000100:00100000:3.0:1763343050.186654:0:24021:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+38:2432:x1848997993763968:12345-192.168.204.21@tcp:10:fsx.0 00002000:00010000:3.0:1763343050.186716:0:24021:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343050.186719:0:24021:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb mtime from disk: 1763343050 -> 1763343050 00002000:00010000:3.0:1763343050.186721:0:24021:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763343050.186723:0:24021:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb ctime from disk: 1763343050 -> 1763343050 00002000:00010000:3.0:1763343050.186724:0:24021:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1763343050.186744:0:24021:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2432:x1848997993763968:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 102us (630us total) trans 21474839096 rc 0/0 00000100:00100000:3.0:1763343050.186750:0:24021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1721 00002000:00010000:3.0:1763343050.186752:0:24021:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/729 (0->18446744073709551615) 00002000:00100000:3.0:1763343050.186755:0:24021:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a34060a8000 with x1848997993763968 ext(0->18446744073709551615) 00002000:00010000:3.0:1763343050.186758:0:24021:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a34060a8000. 00002000:00010000:0.0:1763343050.186902:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 234051 -> 18392 00002000:00010000:0.0:1763343050.186906:0:28424:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343050 -> 1763343050 00002000:00010000:0.0:1763343050.186908:0:28424:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763343050.186910:0:28424:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343050 -> 1763343050 00002000:00010000:0.0:1763343050.186912:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 360 -> 40 00000100:00100000:0.0:1763343050.186940:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2432:x1848997993763840:12345-192.168.204.21@tcp:10:fsx.0 Request processed in 385us (3033us total) trans 21474839097 rc 0/0 00000100:00100000:0.0:1763343050.186947:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1720 00002000:00010000:0.0:1763343050.186949:0:28424:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/727 (18392->18446744073709551615) 00002000:00100000:0.0:1763343050.186952:0:28424:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340ccc0a80 with x1848997993763840 ext(18392->18446744073709551615) 00002000:00010000:0.0:1763343050.186956:0:28424:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340ccc0a80. 00000100:00100000:0.0:1763343050.196383:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.196486:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993764224 00000100:00100000:2.0:1763343050.196598:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993764224 00000100:00100000:2.0:1763343050.196701:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9825 00000100:00100000:2.0:1763343050.196711:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+311:57561:x1848997993764224:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:2.0:1763343050.196735:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343050.196757:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae99f2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca2e0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.196853:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae99f9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343050.196868:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae99f9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343050.196879:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae99f9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343050.196906:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x207:0x0]: returning size 18392 00000004:00200000:2.0:1763343050.196910:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1763343050.196929:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae99f9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343050.196953:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae99f2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2e0 expref: 313 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.196970:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae99f9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2e0 expref: 312 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.196982:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343050.196985:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343050.196988:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a84a00, rc 0) 00000100:00100000:2.0:1763343050.197054:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+312:57561:x1848997993764224:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 344us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.197062:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9825 00010000:00010000:1.0:1763343050.203802:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763343050.210950:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.211051:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993764352 00000100:00100000:2.0:1763343050.211061:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993764352 00002000:00100000:2.0:1763343050.211113:0:28425:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x2d7:0x0] (45056->107843) req@ffff9a3405b7c700 x1848997993764352/t0(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 488/0 e 0 to 0 dl 1763343061 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343050.211124:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3405b7c700 with x1848997993764352 ext(45056->107843) 00002000:00010000:2.0:1763343050.211130:0:28425:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3405b7c700 00000100:00100000:2.0:1763343050.211167:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1722 00000100:00100000:2.0:1763343050.211177:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+39:2430:x1848997993764352:12345-192.168.204.21@tcp:4:fsx.0 00000100:00100000:2.0:1763343050.222933:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+41:2430:x1848997993764352:12345-192.168.204.21@tcp:4:fsx.0 Request processed in 11737us (11975us total) trans 21474839098 rc 0/0 00000100:00100000:2.0:1763343050.222967:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1722 00002000:00100000:2.0:1763343050.222988:0:28425:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x2d7:0x0] (45056->107843) req@ffff9a3405b7c700 x1848997993764352/t21474839098(0) o4->c40ca0f7-2874-427c-a29a-a0b7b64d34e4@192.168.204.21@tcp:546/0 lens 488/448 e 0 to 0 dl 1763343061 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763343050.223001:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a3405b7c700 with x1848997993764352 ext(45056->107843) 00002000:00010000:2.0:1763343050.223011:0:28425:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a3405b7c700 00000100:00100000:3.0:1763343050.227584:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.228429:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993764480 00000100:00100000:2.0:1763343050.228442:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993764480 00000100:00100000:1.0:1763343050.230106:0:24024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1723 00000100:00100000:1.0:1763343050.230129:0:24024:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+41:2429:x1848997993764480:12345-192.168.204.21@tcp:22:fsx.0 00002000:00010000:1.0:1763343050.230477:0:24024:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 18392 -> 107844 00002000:00010000:1.0:1763343050.230482:0:24024:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343050 -> 1763343050 00002000:00010000:1.0:1763343050.230484:0:24024:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 0 -> 1763343050 00002000:00010000:1.0:1763343050.230487:0:24024:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343050 -> 1763343050 00002000:00010000:1.0:1763343050.230489:0:24024:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 40 -> 168 00000100:00100000:1.0:1763343050.230575:0:24024:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+42:2429:x1848997993764480:12345-192.168.204.21@tcp:22:fsx.0 Request processed in 456us (3002us total) trans 21474839099 rc 0/0 00000100:00100000:1.0:1763343050.230584:0:24024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1723 00000100:00100000:1.0:1763343050.238730:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.238851:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993764736 00000100:00100000:3.0:1763343050.238863:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993764736 00000100:00100000:3.0:1763343050.238930:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3357 00000100:00100000:3.0:1763343050.238940:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+312:57561:x1848997993764736:12345-192.168.204.21@tcp:35:fsx.0 00000100:00100000:3.0:1763343050.239231:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+313:57561:x1848997993764736:12345-192.168.204.21@tcp:35:fsx.0 Request processed in 291us (509us total) trans 8589940440 rc 0/0 00000100:00100000:3.0:1763343050.239424:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3357 00000100:00100000:2.0:1763343050.275822:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.275914:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993764992 00000100:00100000:0.0:1763343050.275926:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993764992 00000100:00100000:0.0:1763343050.275993:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9826 00000100:00100000:0.0:1763343050.276004:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3501219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+313:57562:x1848997993764992:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343050.276030:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343050.276054:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a00 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca2e7 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.276127:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae9a07 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276145:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae9a07 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276156:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae9a07 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276167:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae9a0e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276174:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae9a0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276180:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae9a0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276297:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a15 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276308:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a15 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276314:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a15 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:0.0:1763343050.276325:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x207:0x0]: returning size 107844 00010000:00010000:0.0:1763343050.276421:0:10042:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae9a07 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276429:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae9a07 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276435:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae9a07 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276440:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae9a07 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276446:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343050.276451:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae9a07 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276458:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae9a07 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276469:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9a35167a9700) 00010000:00010000:0.0:1763343050.276473:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343050.276478:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae9a07 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276484:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae9a07 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276511:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae9a0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276517:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae9a0e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276523:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae9a0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276527:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343050.276530:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae9a0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276535:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae9a0e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276541:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff9a3403bdc800) 00010000:00010000:0.0:1763343050.276544:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763343050.276547:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae9a0e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276552:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176400/0x607405d401ae9a0e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.276591:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a00 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2e7 expref: 316 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.276604:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a15 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2e7 expref: 315 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.276612:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:0.0:1763343050.276614:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763343050.276617:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:0.0:1763343050.276752:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3501219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+315:57562:x1848997993764992:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 749us (940us total) trans 8589940441 rc 0/0 00000100:00100000:0.0:1763343050.276762:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9826 00000100:00100000:2.0:1763343050.282249:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.285085:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.285156:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993765376 00000100:00100000:3.0:1763343050.285167:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993765376 00000100:00100000:3.0:1763343050.285345:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9827 00000100:00100000:3.0:1763343050.285356:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+315:57562:x1848997993765376:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:3.0:1763343050.285379:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763343050.285399:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae9a23 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca2ee expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343050.285788:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993765120 00000100:00100000:0.0:1763343050.285795:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993765120 00000100:00100000:0.0:1763343050.285844:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 415 00000100:00100000:0.0:1763343050.285853:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+317:2432:x1848997993765120:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343050.285865:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343050.285886:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a15 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2e7 expref: 317 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.285901:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:0.0:1763343050.285906:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343050.285958:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+316:2432:x1848997993765120:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 106us (3718us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343050.285965:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 415 00010000:00010000:2.0:1763343050.288341:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9a2a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343050.288361:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9a2a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343050.288373:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9a2a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:2.0:1763343050.288385:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x20a:0x0]: returning size 0 00010000:00010000:2.0:1763343050.288446:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae9a23 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2ee expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.288468:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9a2a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2ee expref: 316 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.288477:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34037bc200) 00010000:00010000:2.0:1763343050.288480:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763343050.288484:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3406702600, rc 0) 00000100:00100000:2.0:1763343050.288544:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+316:57562:x1848997993765376:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 3190us (3470us total) trans 8589940442 rc 0/0 00000100:00100000:2.0:1763343050.288551:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9827 00000100:00100000:2.0:1763343050.307459:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.307913:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993765632 00000100:00100000:0.0:1763343050.307924:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993765632 00000100:00100000:0.0:1763343050.307999:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9828 00000100:00100000:0.0:1763343050.308011:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+316:57562:x1848997993765632:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343050.308039:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343050.308066:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a38 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca2f5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.308187:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a3f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.308203:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9a2a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2ee expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.308214:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a3f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.308250:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9a2a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2ee expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.308264:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9a2a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2ee expref: 317 pid: 6525 timeout: 1343 lvb_type: 0 00000100:00100000:0.0:1763343050.308278:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010331008:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343050.308402:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340498f180 going to sleep for 11 seconds 00000100:00100000:2.0:1763343050.319607:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.319738:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993765760 00000100:00100000:1.0:1763343050.319774:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993765760 00010000:00010000:1.0:1763343050.319816:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9a2a lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2ee expref: 318 pid: 6525 timeout: 1343 lvb_type: 0 00000100:00100000:1.0:1763343050.319863:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3237 00000100:00100000:1.0:1763343050.319872:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+318:2429:x1848997993765760:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343050.319888:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343050.319895:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9a2a lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2ee expref: 318 pid: 6525 timeout: 1343 lvb_type: 0 00010000:00010000:1.0:1763343050.319909:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9a2a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2ee expref: 318 pid: 6525 timeout: 1343 lvb_type: 0 00010000:00010000:1.0:1763343050.319934:0:27834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34037bc200) 00010000:00010000:1.0:1763343050.319941:0:27834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a3f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.319951:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a3f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.319958:0:27834:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a3f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.319977:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343050.320036:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+318:2429:x1848997993765760:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 164us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.320043:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3237 00010000:00010000:0.0:1763343050.320269:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9a2a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2ee expref: 317 pid: 6525 timeout: 1343 lvb_type: 0 00000100:00100000:0.0:1763343050.320291:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010331008:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343050.320312:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a3f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.320320:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a3f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.320325:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a3f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343050.320347:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x20a:0x0]: returning size 0 00000004:00080000:0.0:1763343050.320519:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2db:0x0], index 1: 0 00000004:00080000:0.0:1763343050.320526:0:6525:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2da:0x0], index 0: 0 00010000:00010000:0.0:1763343050.320686:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a3f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.320694:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a3f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.320700:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a3f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.320706:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343050.320710:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a3f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.320716:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a3f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.320727:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34037bc200) 00010000:00010000:0.0:1763343050.320730:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763343050.320734:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a3f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.320740:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a3f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.320786:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a38 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x20a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2f5 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.320796:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34037bc200) 00010000:00010000:0.0:1763343050.320798:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763343050.320802:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a38 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x20a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2f5 expref: 317 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.320818:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:0.0:1763343050.320869:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+316:57562:x1848997993765632:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 12860us (13422us total) trans 8589940443 rc 301/301 00000100:00100000:0.0:1763343050.320877:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9828 00000100:00100000:2.0:1763343050.330135:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.330229:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993766016 00000100:00100000:1.0:1763343050.330239:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993766016 00000100:00100000:1.0:1763343050.330290:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3358 00000100:00100000:1.0:1763343050.330298:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+316:57562:x1848997993766016:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343050.330579:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+317:57562:x1848997993766016:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 280us (455us total) trans 8589940444 rc 0/0 00000100:00100000:1.0:1763343050.330587:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3358 00000100:00100000:3.0:1763343050.341990:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.342105:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993766144 00000100:00100000:0.0:1763343050.342116:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993766144 00000100:00100000:0.0:1763343050.342181:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9829 00000100:00100000:0.0:1763343050.342191:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+317:57562:x1848997993766144:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343050.342215:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343050.342239:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a4d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca2fc expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.342315:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a54 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.342329:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a54 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.342343:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a54 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:0.0:1763343050.342384:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x20a:0x0]: returning size 0 00000004:00200000:0.0:1763343050.342389:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1763343050.342409:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a54 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.342435:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a4d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2fc expref: 319 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.342454:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a54 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2fc expref: 318 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.342463:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34047db800) 00010000:00010000:0.0:1763343050.342466:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763343050.342469:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177e00, rc 0) 00000100:00100000:0.0:1763343050.342538:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+318:57562:x1848997993766144:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 348us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343050.342545:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9829 00000100:00100000:2.0:1763343050.346053:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.346144:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993766272 00000100:00100000:1.0:1763343050.346155:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993766272 00000100:00100000:1.0:1763343050.346216:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6932 00000100:00100000:1.0:1763343050.346226:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2429:x1848997993766272:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343050.346246:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343050.346267:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8600/0x607405d401ae9a5b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca303 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343050.346293:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343050.346313:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.346316:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.346963:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8600/0x607405d401ae9a5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca303 expref: 28 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343050.346993:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8600/0x607405d401ae9a5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca303 expref: 28 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343050.347006:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d8600, rc 0) 00000100:00100000:1.0:1763343050.347068:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2429:x1848997993766272:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 842us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.347076:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6932 00000100:00100000:3.0:1763343050.356269:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.356373:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993766400 00000100:00100000:1.0:1763343050.356384:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993766400 00000100:00100000:1.0:1763343050.356444:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6933 00000100:00100000:1.0:1763343050.356453:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+42:2430:x1848997993766400:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343050.356470:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343050.356490:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9a62 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca30a expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343050.356513:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1763343050.356535:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.356538:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.356546:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9a62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca30a expref: 43 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343050.356569:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9a62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca30a expref: 43 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343050.356582:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9e00, rc 0) 00000100:00100000:1.0:1763343050.356670:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+43:2430:x1848997993766400:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 216us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.356678:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6933 00000100:00100000:3.0:1763343050.364315:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.364495:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993766656 00000100:00100000:2.0:1763343050.364509:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993766656 00000100:00100000:2.0:1763343050.364578:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9830 00000100:00100000:2.0:1763343050.364588:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+318:57562:x1848997993766656:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343050.364609:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343050.364672:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9a69 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca311 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.364786:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae9a70 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.364806:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae9a70 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x4/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.364818:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae9a70 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x4/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:2.0:1763343050.364830:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x207:0x0]: returning size 107844 00010000:00010000:2.0:1763343050.364938:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9a69 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x1/0x0 rrc: 17 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca311 expref: 321 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.364954:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae9a70 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x4/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca311 expref: 320 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.364963:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343050.364967:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763343050.364970:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3403a85200, rc 0) 00000100:00100000:2.0:1763343050.365035:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+320:57562:x1848997993766656:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 448us (729us total) trans 8589940445 rc 0/0 00000100:00100000:2.0:1763343050.365043:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9830 00000100:00100000:2.0:1763343050.370344:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.370386:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.370428:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.371151:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993766784 00000100:00100000:3.0:1763343050.371163:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993766784 00000100:00100000:1.0:1763343050.371222:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993767040 00000100:00100000:1.0:1763343050.371226:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993767040 00000100:00100000:3.0:1763343050.371678:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993766912 00000100:00100000:3.0:1763343050.371684:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993766912 00000100:00100000:0.0:1763343050.371689:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6934 00000100:00100000:0.0:1763343050.371703:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2432:x1848997993766784:12345-192.168.204.21@tcp:1:lfs.0 00000100:00100000:3.0:1763343050.371721:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6935 00000100:00100000:3.0:1763343050.371731:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2432:x1848997993767040:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:3.0:1763343050.371759:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae9a85 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.371759:0:15756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a7e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.371780:0:15756:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae98f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca285 expref: 44 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.371793:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343050.371795:0:15756:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343050.371799:0:15756:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a7e lrc: 4/1,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.371834:0:15756:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae98f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca285 expref: 44 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.371847:0:15756:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae98f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca285 expref: 44 pid: 8407 timeout: 1344 lvb_type: 0 00000100:00100000:0.0:1763343050.371862:0:15756:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010331136:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343050.371953:0:15756:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340498f900 going to sleep for 11 seconds 00000100:00100000:0.0:1763343050.372001:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6936 00000100:00100000:0.0:1763343050.372009:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2432:x1848997993766912:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:0.0:1763343050.372028:0:27835:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9a8c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.372047:0:27835:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a34068aa000/0x607405d401ae997b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2af expref: 44 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.372053:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343050.372054:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763343050.372057:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9a8c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.372083:0:27835:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a34068aa000/0x607405d401ae997b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2af expref: 44 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.372091:0:27835:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a34068aa000/0x607405d401ae997b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2af expref: 44 pid: 8407 timeout: 1344 lvb_type: 0 00000100:00100000:0.0:1763343050.372100:0:27835:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010331264:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343050.372129:0:27835:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340498fb40 going to sleep for 11 seconds 00010000:00010000:3.0:1763343050.372300:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9990 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2bd expref: 28 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.372307:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343050.372309:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763343050.372312:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae9a85 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.372332:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9990 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2bd expref: 28 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.372340:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9990 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2bd expref: 28 pid: 8407 timeout: 1344 lvb_type: 0 00000100:00100000:3.0:1763343050.372356:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3405b7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010331392:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343050.372380:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343050.382378:0:15756:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15756:1848998010331136:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343050.382406:0:15756:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a7e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343050.386505:0:27835:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:27835:1848998010331264:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343050.386535:0:27835:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9a8c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343050.386549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.386589:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.386649:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.386661:0:27834:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993767296 00000100:00100000:1.0:1763343050.386667:0:27834:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993767296 00000100:00100000:3.0:1763343050.386670:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993767168 00000100:00100000:3.0:1763343050.386673:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993767168 00010000:00010000:3.0:1763343050.386701:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a34068aa000/0x607405d401ae997b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2af expref: 45 pid: 8407 timeout: 1344 lvb_type: 0 00010000:00010000:1.0:1763343050.386701:0:27834:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9990 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2bd expref: 29 pid: 8407 timeout: 1344 lvb_type: 0 00000100:00100000:3.0:1763343050.386728:0:6510:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993767424 00000100:00100000:3.0:1763343050.386731:0:6510:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993767424 00000100:00100000:1.0:1763343050.386733:0:27834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3238 00000100:00100000:1.0:1763343050.386741:0:27834:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+46:2430:x1848997993767168:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343050.386745:0:6510:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae98f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca285 expref: 46 pid: 8407 timeout: 1344 lvb_type: 0 00010000:00010000:1.0:1763343050.386755:0:27834:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1763343050.386756:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3239 00000100:00100000:3.0:1763343050.386761:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2430:x1848997993767296:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343050.386769:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343050.386784:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9990 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2bd expref: 29 pid: 8407 timeout: 1344 lvb_type: 0 00010000:00010000:3.0:1763343050.386794:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9990 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2bd expref: 29 pid: 8407 timeout: 1344 lvb_type: 0 00010000:00010000:3.0:1763343050.386818:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343050.386822:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343050.386826:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae9a85 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.386835:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae9a85 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.386852:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343050.386870:0:27834:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a34068aa000/0x607405d401ae997b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2af expref: 46 pid: 8407 timeout: 1344 lvb_type: 0 00010000:00010000:1.0:1763343050.386879:0:27834:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a34068aa000/0x607405d401ae997b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2af expref: 46 pid: 8407 timeout: 1344 lvb_type: 0 00010000:00010000:1.0:1763343050.386892:0:27834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34068aa000/0x607405d401ae997b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2af expref: 46 pid: 8407 timeout: 1344 lvb_type: 0 00000100:00100000:3.0:1763343050.386898:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2430:x1848997993767296:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 136us (350us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343050.386904:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1763343050.386906:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3239 00010000:00010000:1.0:1763343050.386906:0:27834:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.386909:0:27834:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9a8c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.386916:0:27834:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9a8c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343050.386922:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3240 00000100:00100000:3.0:1763343050.386928:0:6510:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35084c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+45:2430:x1848997993767424:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343050.386933:0:27834:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763343050.386936:0:6510:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343050.386947:0:6510:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae98f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca285 expref: 45 pid: 8407 timeout: 1344 lvb_type: 0 00000100:00100000:1.0:1763343050.386952:0:27834:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+45:2430:x1848997993767168:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 212us (363us total) trans 0 rc 0/0 00010000:00010000:3.0:1763343050.386957:0:6510:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae98f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca285 expref: 45 pid: 8407 timeout: 1344 lvb_type: 0 00000100:00100000:1.0:1763343050.386959:0:27834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3238 00010000:00010000:3.0:1763343050.386969:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de7c00/0x607405d401ae98f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca285 expref: 44 pid: 8407 timeout: 1344 lvb_type: 0 00010000:00010000:3.0:1763343050.386977:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.386978:0:27835:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9a8c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.386979:0:6510:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763343050.386982:0:6510:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a7e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.386986:0:27835:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9a8c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.386995:0:6510:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a7e lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.387004:0:27835:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9a8c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.387012:0:6510:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763343050.387012:0:27835:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9a8c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.387024:0:27835:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9a8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343050.387029:0:6510:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35084c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+43:2430:x1848997993767424:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 101us (388us total) trans 0 rc 0/0 00010000:00010000:1.0:1763343050.387031:0:27835:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176400 already unused, calling callback (ffffffffc0d8ab40) 00000100:00100000:3.0:1763343050.387035:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3240 00010000:00010000:1.0:1763343050.387036:0:27835:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9a8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.387044:0:27835:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9a8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.387054:0:27835:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9a8c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.387060:0:27835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9a8c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.387085:0:15756:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a7e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.387093:0:15756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a7e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343050.387105:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+42:2432:x1848997993766912:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 15097us (16677us total) trans 0 rc 0/0 00010000:00010000:3.0:1763343050.387106:0:15756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a7e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343050.387113:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6936 00010000:00010000:3.0:1763343050.387114:0:15756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a7e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.387120:0:15756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.387127:0:15756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343050.387129:0:15756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.387141:0:15756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.387152:0:15756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a7e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.387158:0:15756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9a7e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15756 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763343050.387193:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+41:2432:x1848997993766784:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 15495us (16872us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343050.387200:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6934 00010000:00010000:2.0:1763343050.389130:0:28996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9990 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2bd expref: 28 pid: 8407 timeout: 1344 lvb_type: 0 00000100:00100000:2.0:1763343050.389153:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3405b7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010331392:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343050.389177:0:28996:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae9a85 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.389188:0:28996:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae9a85 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.389194:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae9a85 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.389221:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae9a85 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.389228:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae9a85 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.389237:0:28996:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae9a85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.389245:0:28996:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35379c1800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343050.389249:0:28996:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae9a85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.389262:0:28996:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae9a85 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.389279:0:28996:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae9a85 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.389286:0:28996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a35379c1800/0x607405d401ae9a85 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343050.389388:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2432:x1848997993767040:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 17658us (19001us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.389398:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6935 00000100:00100000:2.0:1763343050.394233:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.394275:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.394311:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.395125:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993767552 00000100:00100000:1.0:1763343050.395137:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993767552 00000100:00100000:1.0:1763343050.395197:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993767680 00000100:00100000:1.0:1763343050.395200:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993767680 00000100:00100000:1.0:1763343050.395222:0:27835:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993767808 00000100:00100000:1.0:1763343050.395224:0:27835:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993767808 00000100:00100000:1.0:1763343050.395247:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6937 00000100:00100000:1.0:1763343050.395256:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+42:2430:x1848997993767552:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343050.395277:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343050.395299:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9200/0x607405d401ae9a93 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca318 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343050.395337:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d7:0x0] initial LVB size: 107844, mtime: 0x691a7aca, atime: 0x691a7aca, ctime: 0x691a7aca, blocks: 0xa8 00010000:00010000:1.0:1763343050.395359:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.395362:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.395373:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9200/0x607405d401ae9a93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca318 expref: 43 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343050.395391:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9200/0x607405d401ae9a93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca318 expref: 43 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343050.395406:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9200, rc 0) 00000100:00100000:1.0:1763343050.395462:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+43:2430:x1848997993767552:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 207us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.395470:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6937 00000100:00100000:1.0:1763343050.395489:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6938 00000100:00100000:1.0:1763343050.395495:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+42:2429:x1848997993767680:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343050.395502:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343050.395511:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9c00/0x607405d401ae9a9a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca31f expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343050.395523:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x691a7aca, atime: 0x0, ctime: 0x691a7aca, blocks: 0x1800 00010000:00010000:1.0:1763343050.395531:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.395533:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.395538:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9c00/0x607405d401ae9a9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca31f expref: 43 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343050.395549:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9c00/0x607405d401ae9a9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca31f expref: 43 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343050.395557:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9c00, rc 0) 00000100:00100000:1.0:1763343050.395578:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+43:2429:x1848997993767680:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 82us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.395584:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6938 00000100:00100000:1.0:1763343050.395597:0:27835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6939 00000100:00100000:1.0:1763343050.395603:0:27835:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+27:2430:x1848997993767808:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343050.395610:0:27835:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343050.395651:0:27835:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8e00/0x607405d401ae9aa1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca326 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763343050.395667:0:27835:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2da:0x0] initial LVB size: 0, mtime: 0x691a7aca, atime: 0x0, ctime: 0x691a7aca, blocks: 0x0 00010000:00010000:1.0:1763343050.395677:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.395678:0:27835:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.395683:0:27835:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8e00/0x607405d401ae9aa1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca326 expref: 28 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343050.395694:0:27835:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8e00/0x607405d401ae9aa1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca326 expref: 28 pid: 27835 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763343050.395702:0:27835:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d8e00, rc 0) 00000100:00100000:1.0:1763343050.395721:0:27835:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2430:x1848997993767808:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 119us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.395728:0:27835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6939 00000100:00100000:0.0:1763343050.485499:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.487154:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993767936 00000100:00100000:2.0:1763343050.487175:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993767936 00000100:00100000:2.0:1763343050.487276:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6940 00000100:00100000:2.0:1763343050.487289:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+43:2430:x1848997993767936:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:2.0:1763343050.487470:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+43:2430:x1848997993767936:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 183us (1985us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.487479:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6940 00000100:00100000:3.0:1763343050.494724:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.495399:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993768064 00000100:00100000:0.0:1763343050.495414:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993768064 00000100:00100000:0.0:1763343050.495505:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9831 00000100:00100000:0.0:1763343050.495517:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+320:57562:x1848997993768064:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343050.495761:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343050.495794:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9aa8 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca32d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.495843:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae9aaf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.495860:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae9aaf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.495875:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae9aaf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.496034:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9aa8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca32d expref: 322 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.496058:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae9aaf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca32d expref: 321 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.496067:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34047db800) 00010000:00010000:0.0:1763343050.496070:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763343050.496075:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177800, rc 0) 00000100:00100000:0.0:1763343050.502571:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+321:57562:x1848997993768064:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 7032us (7838us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343050.502590:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9831 00000100:00100000:1.0:1763343050.514889:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.515086:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993768320 00000100:00100000:0.0:1763343050.515101:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993768320 00000100:00100000:0.0:1763343050.515187:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9832 00000100:00100000:0.0:1763343050.515199:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+321:57562:x1848997993768320:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343050.515284:0:6525:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343050.515320:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9a54 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2fc expref: 321 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.515346:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34047db800) 00010000:00010000:0.0:1763343050.515352:0:6525:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343050.515585:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9ab6 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.515607:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9ab6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343050.515617:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9ab6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000001:00080000:1.0:1763343050.516860:0:6525:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940446 00000004:00010000:1.0:1763343050.516917:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000286bb5e6 reply state 00000000be30f0ad transno 8589940447 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9ab6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.516937:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9ab6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.516946:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34047db800) 00010000:00010000:1.0:1763343050.516949:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1763343050.516953:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763343050.517106:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+323:57562:x1848997993768320:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 1904us (2235us total) trans 8589940447 rc 0/0 00000100:00100000:1.0:1763343050.517116:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9832 00000020:00080000:1.0:1763343050.517123:0:6525:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763343050.523323:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.523736:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993768448 00000100:00100000:2.0:1763343050.523750:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993768448 00000100:00100000:2.0:1763343050.524311:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9833 00000100:00100000:2.0:1763343050.524327:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+323:57562:x1848997993768448:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343050.525508:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343050.525551:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae9abd lrc: 2/0,0 mode: --/CR res: [0x200000405:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca334 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.525669:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae9abd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca334 expref: 324 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.525688:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae9abd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca334 expref: 324 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.525712:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34047db800) 00010000:00010000:2.0:1763343050.525716:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763343050.525720:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a35379c1800, rc 0) 00000100:00100000:2.0:1763343050.525812:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+324:57562:x1848997993768448:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 1488us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.525822:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9833 00000100:00100000:3.0:1763343050.531334:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.534554:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993768576 00000100:00100000:0.0:1763343050.534577:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993768576 00000100:00100000:2.0:1763343050.534959:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6941 00000100:00100000:2.0:1763343050.534977:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:57562:x1848997993768576:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343050.535004:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343050.535033:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9ac4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca33b expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.535075:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8600/0x607405d401ae9a5b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca303 expref: 29 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343050.535085:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343050.535087:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343050.535094:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9ac4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca33b expref: 29 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.535138:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8600/0x607405d401ae9a5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca303 expref: 29 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343050.535155:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8600/0x607405d401ae9a5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca303 expref: 29 pid: 8407 timeout: 1344 lvb_type: 1 00000100:00100000:2.0:1763343050.535170:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537969c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010331520:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343050.535295:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3512746840 going to sleep for 11 seconds 00000100:00100000:3.0:1763343050.541214:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.541785:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537969c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:28996:1848998010331520:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343050.541832:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9ac4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca33b expref: 29 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.541857:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340352d000, rc 0) 00000100:00100000:1.0:1763343050.541990:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993768704 00000100:00100000:1.0:1763343050.542000:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993768704 00010000:00010000:1.0:1763343050.542043:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8600/0x607405d401ae9a5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca303 expref: 30 pid: 8407 timeout: 1344 lvb_type: 1 00000100:00100000:1.0:1763343050.542087:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3241 00000100:00100000:1.0:1763343050.542097:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2429:x1848997993768704:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343050.542116:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343050.542122:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8600/0x607405d401ae9a5b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca303 expref: 30 pid: 8407 timeout: 1344 lvb_type: 1 00010000:00010000:1.0:1763343050.542142:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8600/0x607405d401ae9a5b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca303 expref: 30 pid: 8407 timeout: 1344 lvb_type: 1 00010000:00010000:1.0:1763343050.542170:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8600/0x607405d401ae9a5b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca303 expref: 30 pid: 8407 timeout: 1344 lvb_type: 1 00010000:00010000:1.0:1763343050.542187:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.542189:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.542196:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9ac4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca33b expref: 29 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.542208:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9ac4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca33b expref: 29 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.542252:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9ac4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca33b expref: 29 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343050.542283:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1848998010331648:192.168.204.21@tcp:105: 00000100:00100000:1.0:1763343050.542404:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a351feeb540 going to sleep for 11 seconds 00000100:00100000:2.0:1763343050.542828:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:57562:x1848997993768576:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 7854us (11508us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.542839:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6941 00000100:00100000:1.0:1763343050.546077:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1848998010331648:192.168.204.21@tcp:105: 00010000:00010000:1.0:1763343050.546121:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343050.546197:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2429:x1848997993768704:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 4099us (4999us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.546211:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3241 00000100:00100000:1.0:1763343050.550216:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.550434:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993768832 00000100:00100000:2.0:1763343050.550449:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993768832 00000100:00100000:2.0:1763343050.550526:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6942 00000100:00100000:2.0:1763343050.550539:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+43:57562:x1848997993768832:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:2.0:1763343050.550567:0:28996:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343050.550594:0:28996:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae9acb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca342 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.550696:0:28996:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9a62 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca30a expref: 44 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343050.550707:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343050.550709:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343050.550714:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae9acb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca342 expref: 44 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.550759:0:28996:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9a62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca30a expref: 44 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343050.550775:0:28996:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9a62 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca30a expref: 44 pid: 8407 timeout: 1344 lvb_type: 1 00000100:00100000:2.0:1763343050.550792:0:28996:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3537969c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010331776:192.168.204.21@tcp:104: 00000100:00100000:2.0:1763343050.550907:0:28996:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3512746840 going to sleep for 11 seconds 00000100:00100000:2.0:1763343050.559358:0:28996:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3537969c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:28996:1848998010331776:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343050.559422:0:28996:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae9acb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca342 expref: 44 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.559452:0:28996:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93800, rc 0) 00000100:00100000:2.0:1763343050.559553:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:57562:x1848997993768832:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 9015us (9351us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.559565:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6942 00000100:00100000:3.0:1763343050.562432:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.563153:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993768960 00000100:00100000:1.0:1763343050.563168:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993768960 00010000:00010000:1.0:1763343050.563225:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9a62 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca30a expref: 44 pid: 8407 timeout: 1344 lvb_type: 1 00000100:00100000:1.0:1763343050.563289:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3242 00000100:00100000:1.0:1763343050.563301:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2430:x1848997993768960:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343050.563324:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343050.563330:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9a62 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca30a expref: 44 pid: 8407 timeout: 1344 lvb_type: 1 00010000:00010000:1.0:1763343050.563348:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9a62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca30a expref: 44 pid: 8407 timeout: 1344 lvb_type: 1 00010000:00010000:1.0:1763343050.563378:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9a62 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca30a expref: 44 pid: 8407 timeout: 1344 lvb_type: 1 00010000:00010000:1.0:1763343050.563400:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.563403:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.563411:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae9acb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca342 expref: 43 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.563423:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae9acb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca342 expref: 43 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.563473:0:6509:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93800/0x607405d401ae9acb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca342 expref: 43 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343050.563497:0:6509:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1848998010331904:192.168.204.21@tcp:105: 00000100:00100000:1.0:1763343050.563606:0:6509:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a351feeb540 going to sleep for 11 seconds 00000100:00100000:1.0:1763343050.574079:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.574135:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.574205:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993769088 00000100:00100000:2.0:1763343050.574222:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993769088 00002000:00010000:2.0:1763343050.574281:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/731 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.574287:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340ccc1880 with x1848997993769088 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.574303:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340ccc1880. 00000100:00100000:2.0:1763343050.574327:0:28425:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993769216 00000100:00100000:2.0:1763343050.574331:0:28425:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993769216 00000100:00100000:1.0:1763343050.574336:0:6509:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6509:1848998010331904:192.168.204.21@tcp:105: 00002000:00010000:2.0:1763343050.574343:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/730 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.574345:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340ccc0e00 with x1848997993769216 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.574351:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340ccc0e00. 00010000:00010000:1.0:1763343050.574365:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343050.574375:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1724 00000100:00100000:2.0:1763343050.574385:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+28:2429:x1848997993769088:12345-192.168.204.21@tcp:10:lfs.0 00000100:00100000:1.0:1763343050.574429:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2430:x1848997993768960:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 11130us (12016us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.574438:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3242 00002000:00010000:2.0:1763343050.574677:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2db:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343050.574681:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2db:0x0] updating lvb mtime from disk: 0 -> 1763343050 00002000:00010000:2.0:1763343050.574684:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2db:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343050.574687:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2db:0x0] updating lvb ctime from disk: 0 -> 1763343050 00002000:00010000:2.0:1763343050.574690:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2db:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343050.574720:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2429:x1848997993769088:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 336us (664us total) trans 17179871787 rc 0/0 00000100:00100000:2.0:1763343050.574728:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1724 00002000:00010000:2.0:1763343050.574732:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/731 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.574734:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340ccc1880 with x1848997993769088 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.574739:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a340ccc1880. 00000100:00100000:2.0:1763343050.574753:0:28425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1725 00000100:00100000:2.0:1763343050.574760:0:28425:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+43:2429:x1848997993769216:12345-192.168.204.21@tcp:10:lfs.0 00002000:00010000:2.0:1763343050.574868:0:28425:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763343050.574871:0:28425:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2da:0x0] updating lvb mtime from disk: 0 -> 1763343050 00002000:00010000:2.0:1763343050.574874:0:28425:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2da:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763343050.574876:0:28425:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2da:0x0] updating lvb ctime from disk: 0 -> 1763343050 00002000:00010000:2.0:1763343050.574878:0:28425:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2da:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343050.574902:0:28425:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2429:x1848997993769216:12345-192.168.204.21@tcp:10:lfs.0 Request processed in 142us (766us total) trans 21474839100 rc 0/0 00000100:00100000:2.0:1763343050.574908:0:28425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1725 00002000:00010000:2.0:1763343050.574912:0:28425:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/730 (0->18446744073709551615) 00002000:00100000:2.0:1763343050.574914:0:28425:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a340ccc0e00 with x1848997993769216 ext(0->18446744073709551615) 00002000:00010000:2.0:1763343050.574919:0:28425:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a340ccc0e00. 00000100:00100000:0.0:1763343050.581092:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.584919:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993769344 00000100:00100000:2.0:1763343050.584942:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993769344 00000100:00100000:2.0:1763343050.585038:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6943 00000100:00100000:2.0:1763343050.585049:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2431:x1848997993769344:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:2.0:1763343050.585229:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2431:x1848997993769344:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 180us (4153us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.585238:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6943 00000100:00100000:1.0:1763343050.596387:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.596760:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993769472 00000100:00100000:2.0:1763343050.596775:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993769472 00000100:00100000:2.0:1763343050.596862:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6944 00000100:00100000:2.0:1763343050.596883:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2431:x1848997993769472:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:2.0:1763343050.597058:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2431:x1848997993769472:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 185us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.597067:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6944 00000100:00100000:3.0:1763343050.602119:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.602281:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993769600 00000100:00100000:1.0:1763343050.602301:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993769600 00000100:00100000:1.0:1763343050.602408:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1726 00000100:00100000:1.0:1763343050.602421:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2430:x1848997993769600:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:1.0:1763343050.602476:0:28424:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ad2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.602494:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.602497:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.602504:0:28424:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ad2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.602521:0:28424:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ad2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.607961:0:28424:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ad2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.607990:0:28424:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ad2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.608000:0:28424:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.608008:0:28424:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343050.608014:0:28424:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.608024:0:28424:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ad2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.608049:0:28424:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ad2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.608058:0:28424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ad2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343050.608172:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2430:x1848997993769600:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 5746us (6064us total) trans 0 rc 53248/53248 00000100:00100000:1.0:1763343050.608186:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1726 00000100:00100000:3.0:1763343050.611172:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.611270:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993769728 00000100:00100000:1.0:1763343050.611284:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993769728 00000100:00100000:1.0:1763343050.611490:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1727 00000100:00100000:1.0:1763343050.611503:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3405b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2432:x1848997993769728:12345-192.168.204.21@tcp:4:lfs.0 00010000:00010000:1.0:1763343050.611552:0:28424:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8800/0x607405d401ae9ad9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.611576:0:28424:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9ac4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca33b expref: 29 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.611585:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343050.611588:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763343050.611592:0:28424:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8800/0x607405d401ae9ad9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.611782:0:28424:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9ac4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca33b expref: 29 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.611800:0:28424:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9ac4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca33b expref: 29 pid: 28996 timeout: 1344 lvb_type: 0 00000100:00100000:1.0:1763343050.611820:0:28424:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:28424:1848998010332032:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343050.611928:0:28424:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a351feeb540 going to sleep for 11 seconds 00000100:00100000:1.0:1763343050.618880:0:28424:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:28424:1848998010332032:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343050.618929:0:28424:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8800/0x607405d401ae9ad9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343050.619257:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.623821:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993769856 00000100:00100000:1.0:1763343050.623845:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993769856 00010000:00010000:1.0:1763343050.624220:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9ac4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca33b expref: 30 pid: 28996 timeout: 1344 lvb_type: 0 00000100:00100000:1.0:1763343050.624292:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3243 00000100:00100000:1.0:1763343050.624306:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537969c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+30:2430:x1848997993769856:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343050.624332:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343050.624363:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9ac4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca33b expref: 30 pid: 28996 timeout: 1344 lvb_type: 0 00010000:00010000:1.0:1763343050.624377:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9ac4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca33b expref: 30 pid: 28996 timeout: 1344 lvb_type: 0 00010000:00010000:1.0:1763343050.624407:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340352d000/0x607405d401ae9ac4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca33b expref: 30 pid: 28996 timeout: 1344 lvb_type: 0 00010000:00010000:1.0:1763343050.624429:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.624431:0:6509:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.624438:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8800/0x607405d401ae9ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.624450:0:6509:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8800/0x607405d401ae9ad9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 3 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.625042:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343050.625141:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537969c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+29:2430:x1848997993769856:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 834us (5882us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.625151:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3243 00010000:00010000:0.0:1763343050.625228:0:28424:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8800/0x607405d401ae9ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.625240:0:28424:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8800/0x607405d401ae9ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1763343050.632435:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871788 is committed 00000001:00080000:1.0:1763343050.632504:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871772 is committed 00002000:00010000:0.0:1763343050.632692:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2db:0x0] updating lvb size from disk: 0 -> 98304 00002000:00010000:0.0:1763343050.632698:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2db:0x0] updating lvb blocks from disk: 0 -> 104 00010000:00010000:0.0:1763343050.632717:0:28424:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8800/0x607405d401ae9ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.632731:0:28424:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8800/0x607405d401ae9ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.632740:0:28424:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8800/0x607405d401ae9ad9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.632748:0:28424:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d8800 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343050.632754:0:28424:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8800/0x607405d401ae9ad9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.632769:0:28424:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8800/0x607405d401ae9ad9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.632794:0:28424:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8800/0x607405d401ae9ad9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.632802:0:28424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34050d8800/0x607405d401ae9ad9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343050.632942:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3405b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2432:x1848997993769728:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 21434us (21778us total) trans 17179871788 rc 0/0 00000100:00100000:0.0:1763343050.632955:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1727 00000100:00100000:2.0:1763343050.655109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.655247:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993769984 00000100:00100000:1.0:1763343050.655262:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993769984 00000100:00100000:1.0:1763343050.655345:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6945 00000100:00100000:1.0:1763343050.655358:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2429:x1848997993769984:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:1.0:1763343050.655558:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2429:x1848997993769984:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 201us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.655567:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6945 00000100:00100000:2.0:1763343050.671731:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.673018:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993770112 00000100:00100000:3.0:1763343050.673038:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993770112 00000100:00100000:3.0:1763343050.673142:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6946 00000100:00100000:3.0:1763343050.673159:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2430:x1848997993770112:12345-192.168.204.21@tcp:23:lfs.0 00000100:00100000:3.0:1763343050.673572:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2430:x1848997993770112:12345-192.168.204.21@tcp:23:lfs.0 Request processed in 418us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343050.673582:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6946 00000100:00100000:0.0:1763343050.686185:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.686409:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993770240 00000100:00100000:1.0:1763343050.686424:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993770240 00000100:00100000:1.0:1763343050.687087:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1728 00000100:00100000:1.0:1763343050.687103:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2431:x1848997993770240:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:1.0:1763343050.687159:0:28424:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ae0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.687180:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.687183:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.687189:0:28424:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ae0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.687205:0:28424:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ae0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.687350:0:28424:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ae0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.687360:0:28424:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ae0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.687369:0:28424:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ae0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.687381:0:28424:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9e00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343050.687386:0:28424:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ae0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.687397:0:28424:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ae0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.687418:0:28424:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ae0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.687425:0:28424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9ae0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343050.687534:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2431:x1848997993770240:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 435us (1365us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763343050.687543:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1728 00000100:00100000:0.0:1763343050.696688:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.697147:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993770368 00000100:00100000:1.0:1763343050.697162:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993770368 00000100:00100000:1.0:1763343050.697265:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1729 00000100:00100000:1.0:1763343050.697278:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993770368:12345-192.168.204.21@tcp:4:lfs.0 00002000:00010000:1.0:1763343050.697350:0:28424:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2db:0x0] initial LVB size: 98304, mtime: 0x691a7aca, atime: 0x0, ctime: 0x691a7aca, blocks: 0x68 00010000:00010000:1.0:1763343050.697362:0:28424:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9ae7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.697381:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.697384:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.697393:0:28424:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.697410:0:28424:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1763343050.699873:0:26028:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871789 is committed 00002000:00010000:1.0:1763343050.700027:0:28424:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2db:0x0] updating lvb size from disk: 98304 -> 110592 00002000:00010000:1.0:1763343050.700034:0:28424:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2db:0x0] updating lvb blocks from disk: 104 -> 112 00010000:00010000:1.0:1763343050.700055:0:28424:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.700070:0:28424:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9ae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.700079:0:28424:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9ae7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.700088:0:28424:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343050.700093:0:28424:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9ae7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.700102:0:28424:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9ae7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.700127:0:28424:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9ae7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.700134:0:28424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9ae7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [106496->110591] (req 106496->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343050.700276:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993770368:12345-192.168.204.21@tcp:4:lfs.0 Request processed in 2993us (3596us total) trans 17179871789 rc 0/0 00000100:00100000:1.0:1763343050.700287:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1729 00000100:00100000:3.0:1763343050.705137:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.705245:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993770496 00000100:00100000:2.0:1763343050.705259:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993770496 00000100:00100000:2.0:1763343050.705333:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9834 00000100:00100000:2.0:1763343050.705344:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340c253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+324:57562:x1848997993770496:12345-192.168.204.21@tcp:44:lfs.0 00000001:00080000:2.0:1763343050.716167:0:32339:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589940447 is committed 00000100:00100000:3.0:1763343050.716617:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340c253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+286:57562:x1848997993770496:12345-192.168.204.21@tcp:44:lfs.0 Request processed in 11264us (11483us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343050.716668:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9834 00010000:00010000:1.0:1763343050.717065:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae97f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717081:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae97f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717090:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae97f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717096:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352da00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.717102:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae97f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717111:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae97f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717131:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85409d3b (ffff9a35167a9400) 00010000:00010000:1.0:1763343050.717135:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.717140:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae97f3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717148:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352da00/0x607405d401ae97f3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717175:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae97fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x206:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717182:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae97fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x206:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717188:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae97fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x206:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717193:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352c800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.717196:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae97fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x206:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717202:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae97fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x206:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717210:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x206:0x0].0x0 (ffff9a35167a9600) 00010000:00010000:1.0:1763343050.717212:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.717215:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae97fa lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x206:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717221:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352c800/0x607405d401ae97fa lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x206:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717231:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9801 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717237:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9801 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717242:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9801 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717247:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352dc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.717250:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9801 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717255:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9801 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717266:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9a35167a9700) 00010000:00010000:1.0:1763343050.717268:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.717271:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9801 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717277:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352dc00/0x607405d401ae9801 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717295:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae988d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717301:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae988d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717307:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae988d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717312:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d8000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.717314:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae988d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717319:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae988d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717327:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff9a3403bdc800) 00010000:00010000:1.0:1763343050.717329:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.717333:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae988d lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717338:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae988d lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717355:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae98e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717362:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae98e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717368:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae98e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717373:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3405de6800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.717376:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae98e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717382:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae98e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717391:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343050.717393:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.717396:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae98e8 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717401:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3405de6800/0x607405d401ae98e8 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717413:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9912 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717419:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9912 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717424:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9912 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717428:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dc600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.717431:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9912 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717437:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9912 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717443:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xe8098f29 (ffff9a34047dbc00) 00010000:00010000:1.0:1763343050.717446:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.717449:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9912 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717454:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dc600/0x607405d401ae9912 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717470:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae994a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717477:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae994a lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717483:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae994a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717488:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dd200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.717492:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae994a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717497:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae994a lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717504:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343050.717507:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.717510:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae994a lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717515:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dd200/0x607405d401ae994a lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717527:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9951 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717533:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9951 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717538:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9951 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717543:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352de00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.717546:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9951 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717552:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9951 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717559:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343050.717561:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.717564:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9951 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717569:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352de00/0x607405d401ae9951 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717578:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9966 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717584:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9966 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717588:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9966 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717597:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340352ce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.717599:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9966 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717604:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9966 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717612:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343050.717614:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.717616:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9966 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717693:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352ce00/0x607405d401ae9966 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717706:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae9982 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717712:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae9982 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717718:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae9982 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717723:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34068ab800 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.717726:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae9982 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717732:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae9982 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717740:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343050.717743:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.717746:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae9982 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717752:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068ab800/0x607405d401ae9982 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717762:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9997 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717768:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9997 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717773:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9997 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717778:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34068abc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.717781:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9997 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717787:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9997 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717795:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343050.717797:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.717800:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9997 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717805:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34068abc00/0x607405d401ae9997 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717816:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae999e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717821:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae999e lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717828:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae999e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717832:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3537b6d200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.717835:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae999e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717840:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae999e lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717846:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343050.717848:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.717850:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae999e lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717855:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6d200/0x607405d401ae999e lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717865:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae99a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717871:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae99a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717877:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae99a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717881:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34058dce00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.717883:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae99a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717888:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae99a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717896:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343050.717898:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.717900:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae99a5 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717905:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34058dce00/0x607405d401ae99a5 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.717914:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae99c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717920:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae99c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717926:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae99c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717931:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3537b6c200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.717934:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae99c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717939:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae99c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717946:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343050.717949:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.717951:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae99c1 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717957:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6c200/0x607405d401ae99c1 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717967:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717974:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717980:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717985:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3537b6cc00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.717988:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.717994:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.718001:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343050.718004:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.718007:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99d6 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.718012:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3537b6cc00/0x607405d401ae99d6 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:1.0:1763343050.718023:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae99eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.718028:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae99eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.718035:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae99eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.718040:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a35379c0c00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.718043:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae99eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.718054:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae99eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.718061:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343050.718064:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.718067:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae99eb lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.718073:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c0c00/0x607405d401ae99eb lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.718085:0:3643:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9ab6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.718091:0:3643:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9ab6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.718097:0:3643:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9ab6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.718101:0:3643:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176200 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.718104:0:3643:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9ab6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.718109:0:3643:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9ab6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.718117:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34047db800) 00010000:00010000:1.0:1763343050.718119:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.718122:0:3643:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9ab6 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.718127:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9ab6 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00000100:00100000:0.0:1763343050.725266:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.725317:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.725394:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993770752 00000100:00100000:3.0:1763343050.725410:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993770752 00000100:00100000:3.0:1763343050.725485:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993770624 00000100:00100000:3.0:1763343050.725488:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993770624 00000100:00100000:3.0:1763343050.725537:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6947 00000100:00100000:3.0:1763343050.725551:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+44:2430:x1848997993770752:12345-192.168.204.21@tcp:16:lfs.0 00000100:00100000:2.0:1763343050.726114:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6948 00000100:00100000:2.0:1763343050.726133:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993770624:12345-192.168.204.21@tcp:16:lfs.0 00000100:00100000:2.0:1763343050.726254:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993770624:12345-192.168.204.21@tcp:16:lfs.0 Request processed in 129us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.726262:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6948 00000001:00080000:0.0:1763343050.728951:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839100 is committed 00000001:00080000:0.0:1763343050.729047:0:24707:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474839070 is committed 00000100:00100000:2.0:1763343050.729270:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993770752:12345-192.168.204.21@tcp:16:lfs.0 Request processed in 3709us (4009us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.729285:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6947 00000100:00100000:0.0:1763343050.760951:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.761089:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993770880 00000100:00100000:2.0:1763343050.761106:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993770880 00000100:00100000:2.0:1763343050.761191:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6949 00000100:00100000:2.0:1763343050.761205:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993770880:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:2.0:1763343050.761273:0:28996:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae9aee lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.761294:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343050.761297:0:28996:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343050.761304:0:28996:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae9aee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.761320:0:28996:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae9aee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.761362:0:28996:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae9aee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.761371:0:28996:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae9aee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.761380:0:28996:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae9aee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.761388:0:28996:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3408d92a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:2.0:1763343050.761393:0:28996:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae9aee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.761403:0:28996:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae9aee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.761421:0:28996:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae9aee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343050.761429:0:28996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae9aee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28996 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343050.761543:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993770880:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 340us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.761552:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6949 00000100:00100000:0.0:1763343050.767824:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.767986:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.768889:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993771008 00000100:00100000:1.0:1763343050.768904:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993771008 00000100:00100000:1.0:1763343050.768972:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993771136 00000100:00100000:1.0:1763343050.768975:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993771136 00000100:00100000:1.0:1763343050.769003:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6950 00000100:00100000:1.0:1763343050.769012:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993771008:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:1.0:1763343050.769072:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9af5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769092:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.769094:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.769100:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9af5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769117:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9af5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769150:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9af5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769158:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9af5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769166:0:8407:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9af5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769173:0:8407:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d8000 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343050.769178:0:8407:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9af5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769188:0:8407:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9af5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769205:0:8407:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9af5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769212:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a34050d8000/0x607405d401ae9af5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343050.769310:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993771008:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 298us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.769318:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6950 00000100:00100000:1.0:1763343050.769343:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6951 00000100:00100000:1.0:1763343050.769349:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993771136:12345-192.168.204.21@tcp:1:lfs.0 00010000:00010000:1.0:1763343050.769374:0:8407:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9afc lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769382:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.769383:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343050.769386:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9afc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769395:0:8407:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9afc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769413:0:8407:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9afc lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769421:0:8407:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9afc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769429:0:8407:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9afc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769435:0:8407:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9400 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:1.0:1763343050.769438:0:8407:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9afc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769445:0:8407:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9afc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769455:0:8407:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9afc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.769462:0:8407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a34050d9400/0x607405d401ae9afc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343050.771959:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2429:x1848997993771136:12345-192.168.204.21@tcp:1:lfs.0 Request processed in 2590us (3952us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.771977:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6951 00000100:00100000:0.0:1763343050.784703:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.785185:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993771392 00000100:00100000:3.0:1763343050.785202:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993771392 00000100:00100000:3.0:1763343050.785279:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9835 00000100:00100000:3.0:1763343050.785289:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:57562:x1848997993771392:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:3.0:1763343050.785406:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae9b03 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343050.785427:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae9b03 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343050.785440:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae9b03 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00010000:3.0:1763343050.785604:0:6525:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cf1ff09d reply state 00000000f282ec54 transno 8589940448 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae9b03 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343050.785670:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702000/0x607405d401ae9b03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:3.0:1763343050.785679:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34047db800) 00010000:00010000:3.0:1763343050.785684:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763343050.785689:0:6525:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763343050.785834:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:57562:x1848997993771392:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 544us (1156us total) trans 8589940448 rc 0/0 00000100:00100000:3.0:1763343050.785842:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9835 00000100:00100000:3.0:1763343050.790265:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.790310:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.790343:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993771520 00000100:00100000:2.0:1763343050.790359:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993771520 00000100:00100000:2.0:1763343050.790440:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993771648 00000100:00100000:2.0:1763343050.790444:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993771648 00000100:00100000:2.0:1763343050.790478:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6952 00000100:00100000:2.0:1763343050.790488:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34060a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993771520:12345-192.168.204.21@tcp:2:lfs.0 00000100:00100000:3.0:1763343050.790516:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6953 00000100:00100000:3.0:1763343050.790531:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a350121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+13:2430:x1848997993771648:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:3.0:1763343050.790746:0:15756:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763343050.790751:0:15756:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2da:0x0] updating lvb mtime from disk: 1763343050 -> 1763343050 00002000:00010000:3.0:1763343050.790754:0:15756:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2da:0x0] updating lvb atime from disk: 0 -> 1763343050 00002000:00010000:3.0:1763343050.790756:0:15756:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2da:0x0] updating lvb ctime from disk: 1763343050 -> 1763343050 00002000:00010000:3.0:1763343050.790759:0:15756:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2da:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1763343050.790926:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34060a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993771520:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 438us (674us total) trans 17179871790 rc 0/0 00000100:00100000:3.0:1763343050.790929:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a350121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993771648:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 401us (615us total) trans 21474839101 rc 0/0 00000100:00100000:2.0:1763343050.790942:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6952 00000100:00100000:3.0:1763343050.790949:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6953 00000100:00100000:1.0:1763343050.795310:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.795429:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993771904 00000100:00100000:0.0:1763343050.795443:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993771904 00000100:00100000:0.0:1763343050.795521:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9836 00000100:00100000:0.0:1763343050.795532:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:57562:x1848997993771904:12345-192.168.204.21@tcp:55:lfs.0 00010000:00010000:0.0:1763343050.795689:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9b0a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.795718:0:10042:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae9aaf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca32d expref: 273 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.795730:0:10042:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9b0a lrc: 4/0,1 mode: --/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.795783:0:10042:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae9aaf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca32d expref: 273 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.795801:0:10042:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae9aaf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca32d expref: 273 pid: 6525 timeout: 1344 lvb_type: 0 00000100:00100000:0.0:1763343050.795820:0:10042:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010332160:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343050.795941:0:10042:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340498f900 going to sleep for 11 seconds 00000100:00100000:0.0:1763343050.799736:0:10042:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10042:1848998010332160:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343050.799776:0:10042:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9b0a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000100:00100000:1.0:1763343050.800029:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.800116:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993772032 00000100:00100000:2.0:1763343050.800127:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993772032 00010000:00010000:2.0:1763343050.800183:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae9aaf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca32d expref: 274 pid: 6525 timeout: 1344 lvb_type: 0 00000100:00100000:2.0:1763343050.800230:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3244 00000100:00100000:2.0:1763343050.800241:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:2429:x1848997993772032:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343050.800260:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343050.800269:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae9aaf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca32d expref: 274 pid: 6525 timeout: 1344 lvb_type: 0 00010000:00010000:2.0:1763343050.800283:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae9aaf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca32d expref: 274 pid: 6525 timeout: 1344 lvb_type: 0 00010000:00010000:2.0:1763343050.800315:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177800/0x607405d401ae9aaf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca32d expref: 274 pid: 6525 timeout: 1344 lvb_type: 0 00010000:00010000:2.0:1763343050.800338:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34047db800) 00010000:00010000:2.0:1763343050.800344:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9b0a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.800362:0:6509:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9b0a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.800371:0:6509:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9b0a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10042 initiator: MDT0 00010000:00010000:2.0:1763343050.800405:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343050.800483:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:2429:x1848997993772032:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 242us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.800492:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3244 00010000:00010000:0.0:1763343050.800560:0:10042:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9b0a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.800569:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9b0a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.800685:0:10042:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9b0a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.800693:0:10042:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9b0a lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.800707:0:10042:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9b0a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.800713:0:10042:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d177e00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343050.800720:0:10042:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9b0a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.800727:0:10042:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9b0a lrc: 4/0,0 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.800737:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34047db800) 00010000:00010000:0.0:1763343050.800740:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1763343050.800744:0:10042:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9b0a lrc: 2/0,0 mode: --/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.800750:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177e00/0x607405d401ae9b0a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10042 initiator: MDT0 00000100:00100000:0.0:1763343050.800803:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:57562:x1848997993771904:12345-192.168.204.21@tcp:55:lfs.0 Request processed in 5272us (5508us total) trans 0 rc -22/-22 00000100:00100000:0.0:1763343050.800813:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9836 00000100:00100000:2.0:1763343050.807645:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.807841:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993772288 00000100:00100000:0.0:1763343050.807856:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993772288 00000100:00100000:0.0:1763343050.807942:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9837 00000100:00100000:0.0:1763343050.807953:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:57562:x1848997993772288:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1763343050.808038:0:10042:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343050.808076:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a84a00/0x607405d401ae99f9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2e0 expref: 272 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.808101:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:0.0:1763343050.808108:0:10042:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763343050.808186:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9b11 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.808203:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9b11 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.808214:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9b11 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00010000:0.0:1763343050.808377:0:10042:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005b7051e1 reply state 00000000f91df3d6 transno 8589940449 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9b11 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.808392:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176200/0x607405d401ae9b11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.808399:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:0.0:1763343050.808402:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1763343050.808404:0:10042:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763343050.808517:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:57562:x1848997993772288:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 565us (913us total) trans 8589940449 rc 0/0 00000100:00100000:0.0:1763343050.808524:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9837 00000100:00100000:3.0:1763343050.820501:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.828942:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.829311:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993772544 00000100:00100000:1.0:1763343050.829332:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993772544 00000100:00100000:1.0:1763343050.829451:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6954 00000100:00100000:1.0:1763343050.829464:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993772544:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:1.0:1763343050.829759:0:15756:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763343050.829764:0:15756:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb mtime from disk: 1763343050 -> 1763343050 00002000:00010000:1.0:1763343050.829767:0:15756:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb atime from disk: 0 -> 1763343050 00002000:00010000:1.0:1763343050.829769:0:15756:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb ctime from disk: 1763343050 -> 1763343050 00002000:00010000:1.0:1763343050.829772:0:15756:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d9:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1763343050.829849:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993772544:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 387us (9366us total) trans 21474839102 rc 0/0 00000100:00100000:1.0:1763343050.829859:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6954 00000100:00100000:3.0:1763343050.830769:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.830861:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993772416 00000100:00100000:0.0:1763343050.830873:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993772416 00000100:00100000:0.0:1763343050.830925:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993772672 00000100:00100000:0.0:1763343050.830931:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993772672 00000100:00100000:0.0:1763343050.830968:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6955 00000100:00100000:0.0:1763343050.830977:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e9cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993772416:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:0.0:1763343050.831119:0:28996:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb size from disk: 107844 -> 107844 00002000:00010000:0.0:1763343050.831124:0:28996:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb mtime from disk: 1763343050 -> 1763343050 00002000:00010000:0.0:1763343050.831126:0:28996:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb atime from disk: 1763343050 -> 1763343050 00002000:00010000:0.0:1763343050.831129:0:28996:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb ctime from disk: 1763343050 -> 1763343050 00002000:00010000:0.0:1763343050.831131:0:28996:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x2d7:0x0] updating lvb blocks from disk: 168 -> 168 00000100:00100000:0.0:1763343050.831177:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e9cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993772416:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 201us (2253us total) trans 21474839103 rc 0/0 00000100:00100000:0.0:1763343050.831185:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6955 00000100:00100000:0.0:1763343050.831369:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6956 00000100:00100000:0.0:1763343050.831377:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+14:2430:x1848997993772672:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:0.0:1763343050.831457:0:28996:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763343050.831461:0:28996:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb mtime from disk: 1763343050 -> 1763343050 00002000:00010000:0.0:1763343050.831463:0:28996:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb atime from disk: 0 -> 1763343050 00002000:00010000:0.0:1763343050.831465:0:28996:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb ctime from disk: 1763343050 -> 1763343050 00002000:00010000:0.0:1763343050.831467:0:28996:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x2da:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1763343050.831490:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993772672:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 113us (727us total) trans 17179871791 rc 0/0 00000100:00100000:0.0:1763343050.831497:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6956 00000100:00100000:2.0:1763343050.840456:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.841191:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993772928 00000100:00100000:3.0:1763343050.841208:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993772928 00000100:00100000:3.0:1763343050.841300:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3359 00000100:00100000:3.0:1763343050.841312:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:57562:x1848997993772928:12345-192.168.204.21@tcp:35:lfs.0 00000004:00010000:3.0:1763343050.841424:0:6527:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x207:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae9a70 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca311 expref: 273 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.841485:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343050.841500:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98e1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca277 expref: 273 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.841509:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9989 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2b6 expref: 273 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.841519:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343050.841564:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9989 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2b6 expref: 273 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.841580:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9989 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2b6 expref: 273 pid: 10042 timeout: 1344 lvb_type: 0 00000100:00100000:3.0:1763343050.841596:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062cb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010332288:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343050.841790:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98e1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca277 expref: 273 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763343050.841801:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98e1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca277 expref: 273 pid: 10042 timeout: 1344 lvb_type: 0 00000100:00100000:3.0:1763343050.841810:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062c8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010332416:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343050.841838:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3405f1b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343050.848488:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.848905:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062cb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010332288:192.168.204.21@tcp:104: 00000100:00100000:3.0:1763343050.848919:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062c8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010332416:192.168.204.21@tcp:104: 00010000:00010000:3.0:1763343050.848957:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00000100:00100000:2.0:1763343050.849678:0:6509:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993773056 00000100:00100000:2.0:1763343050.849691:0:6509:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993773056 00010000:00010000:2.0:1763343050.849744:0:6509:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9989 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2b6 expref: 274 pid: 10042 timeout: 1344 lvb_type: 0 00000100:00100000:2.0:1763343050.849792:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3245 00000100:00100000:2.0:1763343050.849802:0:6509:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:2430:x1848997993773056:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343050.849821:0:6509:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343050.849827:0:6509:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9989 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2b6 expref: 274 pid: 10042 timeout: 1344 lvb_type: 0 00010000:00010000:2.0:1763343050.849840:0:6509:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9989 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2b6 expref: 274 pid: 10042 timeout: 1344 lvb_type: 0 00010000:00010000:2.0:1763343050.849868:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d600/0x607405d401ae9989 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2b6 expref: 274 pid: 10042 timeout: 1344 lvb_type: 0 00010000:00010000:2.0:1763343050.849892:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343050.849898:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343050.849908:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343050.849913:0:6509:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343050.849982:0:6509:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:2430:x1848997993773056:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 181us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.849989:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3245 00000100:00100000:1.0:1763343050.850239:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.850567:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993773184 00000100:00100000:3.0:1763343050.850574:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993773184 00010000:00010000:3.0:1763343050.850598:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98e1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca277 expref: 273 pid: 10042 timeout: 1344 lvb_type: 0 00000100:00100000:3.0:1763343050.850659:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3246 00000100:00100000:3.0:1763343050.850669:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:2430:x1848997993773184:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763343050.850680:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763343050.850686:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98e1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca277 expref: 273 pid: 10042 timeout: 1344 lvb_type: 0 00010000:00010000:3.0:1763343050.850697:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98e1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca277 expref: 273 pid: 10042 timeout: 1344 lvb_type: 0 00010000:00010000:3.0:1763343050.850715:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340352d400/0x607405d401ae98e1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca277 expref: 273 pid: 10042 timeout: 1344 lvb_type: 0 00010000:00010000:3.0:1763343050.850729:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:3.0:1763343050.850733:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343050.850742:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343050.850755:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343050.852821:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343050.853496:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:2430:x1848997993773184:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 2815us (3246us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.853514:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3246 00010000:00010000:1.0:1763343050.853644:0:6527:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343050.853656:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.853875:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b1f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.853894:0:6527:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae9abd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca334 expref: 271 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.853905:0:6527:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b1f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.853973:0:6527:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae9abd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca334 expref: 271 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.853993:0:6527:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae9abd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca334 expref: 271 pid: 6525 timeout: 1344 lvb_type: 0 00000100:00100000:0.0:1763343050.854012:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010332544:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343050.854101:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340498fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1763343050.860998:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1848998010332544:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343050.861045:0:6527:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b1f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00000100:00100000:0.0:1763343050.863514:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343050.863857:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993773312 00000100:00100000:2.0:1763343050.863871:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993773312 00010000:00010000:2.0:1763343050.863939:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae9abd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca334 expref: 272 pid: 6525 timeout: 1344 lvb_type: 0 00000100:00100000:2.0:1763343050.863997:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3247 00000100:00100000:2.0:1763343050.864009:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a35084c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:2430:x1848997993773312:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343050.864030:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343050.864039:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae9abd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca334 expref: 272 pid: 6525 timeout: 1344 lvb_type: 0 00010000:00010000:2.0:1763343050.864054:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae9abd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca334 expref: 272 pid: 6525 timeout: 1344 lvb_type: 0 00010000:00010000:2.0:1763343050.864087:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a35379c1800/0x607405d401ae9abd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x20a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca334 expref: 272 pid: 6525 timeout: 1344 lvb_type: 0 00010000:00010000:2.0:1763343050.864108:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34047db800) 00010000:00010000:2.0:1763343050.864114:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b1f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343050.864126:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b1f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343050.864134:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b1f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 00010000:00010000:2.0:1763343050.864170:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343050.864253:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a35084c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+271:2430:x1848997993773312:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 244us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.864261:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3247 00010000:00010000:0.0:1763343050.865061:0:6527:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b1f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.865074:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b1f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 00000100:00100000:0.0:1763343050.865484:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010332672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763343050.865556:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343050.865603:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340498f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763343050.866492:0:13006:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010332672 00000100:00100000:1.0:1763343050.866507:0:13006:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010332672 00000100:00100000:1.0:1763343050.866605:0:13006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:1.0:1763343050.866617:0:13006:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6527:x1848998010332672:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763343050.866803:0:13006:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6527:x1848998010332672:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 188us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.866811:0:13006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00100000:1.0:1763343050.866872:0:6527:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474839070 gen 2 00000004:00080000:1.0:1763343050.866880:0:6527:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b90700, transno 21474839070 00000100:00100000:1.0:1763343050.866896:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010332672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763343050.867003:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010332800:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763343050.867044:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343050.867068:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a35012edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1763343050.867192:0:13006:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010332800 00000100:00100000:1.0:1763343050.867197:0:13006:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010332800 00000100:00100000:1.0:1763343050.867236:0:13006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:1.0:1763343050.867244:0:13006:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6527:x1848998010332800:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763343050.867327:0:13006:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6527:x1848998010332800:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 83us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.867334:0:13006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:2.0:1763343050.867473:0:6527:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871772 gen 2 00000004:00080000:2.0:1763343050.867478:0:6527:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a3406b91180, transno 17179871772 00000100:00100000:2.0:1763343050.867769:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010332800:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343050.867833:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010332928:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343050.868167:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343050.868200:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3512746cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343050.868284:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010332928 00000100:00100000:3.0:1763343050.868291:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010332928 00000100:00100000:3.0:1763343050.868339:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1763343050.868347:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6527:x1848998010332928:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763343050.868419:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6527:x1848998010332928:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 72us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343050.868425:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:2.0:1763343050.868550:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010332928:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343050.868614:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010333056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343050.868687:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343050.868702:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3512746cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343050.868758:0:13006:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010333056 00000100:00100000:3.0:1763343050.868762:0:13006:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010333056 00000100:00100000:3.0:1763343050.868795:0:13006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1763343050.868802:0:13006:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6527:x1848998010333056:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763343050.868859:0:13006:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6527:x1848998010333056:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 57us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343050.868867:0:13006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00080000:0.0:1763343050.868947:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1763343050.868955:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1763343050.869004:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010333056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343050.869041:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010333184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343050.869063:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343050.869801:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3512746cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343050.869878:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010333184 00000100:00100000:3.0:1763343050.869886:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010333184 00000100:00100000:0.0:1763343050.869990:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:0.0:1763343050.869999:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6527:x1848998010333184:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763343050.870094:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6527:x1848998010333184:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 95us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343050.870102:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:2.0:1763343050.870220:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010333184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343050.870294:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010333312:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343050.870325:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343050.870349:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3512746cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763343050.870420:0:13006:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010333312 00000100:00100000:3.0:1763343050.870425:0:13006:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010333312 00000100:00100000:3.0:1763343050.870459:0:13006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:3.0:1763343050.870467:0:13006:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6527:x1848998010333312:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763343050.870540:0:13006:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6527:x1848998010333312:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 74us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343050.870547:0:13006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:2.0:1763343050.870741:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010333312:0@lo:1000:mdt_rdpg00_001.0 00000040:00080000:2.0:1763343050.870957:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].13, 640 off44696 00000001:00080000:2.0:1763343050.870973:0:6527:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940450 00000100:00100000:2.0:1763343050.871042:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010333440:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343050.871074:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343050.871089:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3512746cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343050.871150:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010333440 00000100:00100000:0.0:1763343050.871155:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010333440 00000100:00100000:0.0:1763343050.871507:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:0.0:1763343050.871516:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6527:x1848998010333440:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763343050.871732:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6527:x1848998010333440:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 216us (656us total) trans 17179871792 rc 0/0 00000100:00100000:0.0:1763343050.871739:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:2.0:1763343050.871988:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010333440:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343050.872026:0:6527:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f39f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010333568:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343050.872064:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343050.872188:0:6527:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3512746cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343050.872223:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010333568 00000100:00100000:0.0:1763343050.872228:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010333568 00000100:00100000:3.0:1763343050.872870:0:13006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:2.0:1763343050.872975:0:13006:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6527:x1848998010333568:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763343050.873192:0:13006:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6527:x1848998010333568:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 313us (1127us total) trans 21474839104 rc 0/0 00000100:00100000:2.0:1763343050.873200:0:13006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:0.0:1763343050.873257:0:6527:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f39f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1848998010333568:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1763343050.873349:0:6527:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940451 00010000:00010000:0.0:1763343050.873388:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b1f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.873401:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b1f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.873408:0:6527:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b1f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.873415:0:6527:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343050.873421:0:6527:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b1f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.873430:0:6527:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b1f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.873450:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34047db800) 00010000:00010000:0.0:1763343050.873454:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1763343050.873461:0:6527:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b1f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.873467:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b1f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x20a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.873484:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.873491:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.873496:0:6527:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.873501:0:6527:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a3406702600 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:0.0:1763343050.873504:0:6527:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.873509:0:6527:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.873516:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:0.0:1763343050.873518:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1763343050.873521:0:6527:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.873526:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3406702600/0x607405d401ae9b18 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x207:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 00010000:00010000:0.0:1763343050.873539:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:0.0:1763343050.873541:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763343050.873549:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a3403a85200/0x607405d401ae9a70 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca311 expref: 273 pid: 10042 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343050.875256:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:57562:x1848997993772928:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 33930us (34801us total) trans 8589940452 rc 0/0 00000100:00100000:0.0:1763343050.875274:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3359 00000020:00080000:0.0:1763343050.875283:0:6527:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1763343050.879708:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343050.879850:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993773440 00000100:00100000:3.0:1763343050.879864:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993773440 00000100:00100000:1.0:1763343050.880330:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9838 00000100:00100000:1.0:1763343050.880346:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+272:57562:x1848997993773440:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343050.880377:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343050.880406:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8a00/0x607405d401ae9b26 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca349 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.880483:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8a00/0x607405d401ae9b26 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca349 expref: 273 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.880500:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8a00/0x607405d401ae9b26 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca349 expref: 273 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.880522:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343050.880526:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763343050.880530:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d8a00, rc 0) 00000100:00100000:1.0:1763343050.880661:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:57562:x1848997993773440:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 276us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.880675:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9838 00000100:00100000:1.0:1763343050.884363:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.884487:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993773696 00000100:00100000:0.0:1763343050.884501:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993773696 00000100:00100000:0.0:1763343050.884575:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3360 00000100:00100000:0.0:1763343050.884586:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+273:57562:x1848997993773696:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:0.0:1763343050.885939:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:57562:x1848997993773696:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 1345us (1581us total) trans 8589940453 rc 0/0 00000100:00100000:0.0:1763343050.885954:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3360 00000100:00100000:3.0:1763343050.889410:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.889853:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993773952 00000100:00100000:0.0:1763343050.889868:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993773952 00000100:00100000:1.0:1763343050.890018:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3361 00000100:00100000:1.0:1763343050.890030:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511fa1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+274:57562:x1848997993773952:12345-192.168.204.21@tcp:35:lfs.0 00000004:00080000:1.0:1763343050.890320:0:6527:0:(mdd_object.c:3993:mdd_close()) Object [0x200000405:0x20a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1763343050.890447:0:6527:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9b2d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343050.890469:0:6527:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9b2d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343050.890484:0:6527:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9b2d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343050.890494:0:6527:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9b2d lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343050.890501:0:6527:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9b2d lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343050.890508:0:6527:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9b2d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 00010000:00010000:1.0:1763343050.890540:0:6527:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763343050.890859:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511fa1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:57562:x1848997993773952:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 829us (1463us total) trans 8589940454 rc 0/0 00000100:00100000:1.0:1763343050.890870:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3361 00010000:00010000:3.0:1763343050.891131:0:13197:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763343050.891141:0:13197:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9b2d lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343050.891149:0:13197:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:3.0:1763343050.891154:0:13197:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9b2d lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343050.891162:0:13197:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9b2d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343050.891179:0:13197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20a:0x0].0x0 (ffff9a34047db800) 00010000:00010000:3.0:1763343050.891183:0:13197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763343050.891190:0:13197:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9b2d lrc: 1/0,0 mode: --/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343050.891196:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9a00/0x607405d401ae9b2d lrc: 0/0,0 mode: --/PW res: [0x200000405:0x20a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 00010000:00010000:3.0:1763343050.891210:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343050.891212:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763343050.891214:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763343050.919164:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.919273:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993774080 00000100:00100000:1.0:1763343050.919286:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993774080 00000100:00100000:1.0:1763343050.919361:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9839 00000100:00100000:1.0:1763343050.919372:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+275:57564:x1848997993774080:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343050.919405:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343050.919437:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae9b34 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca350 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.919526:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9b3b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919543:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9b3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919556:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9b3b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919571:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9b42 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919577:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9b42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919584:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9b42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919738:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9b49 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919748:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9b49 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919755:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9b49 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343050.919811:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x207:0x0]: returning size 107844 00000004:00200000:1.0:1763343050.919817:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343050.919842:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9b49 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919856:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9b49 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919867:0:6525:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9b3b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919874:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9b3b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919881:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9b3b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919889:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9b3b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919896:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d8000 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.919901:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9b3b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919909:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9b3b lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919924:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff9a3403bdc800) 00010000:00010000:1.0:1763343050.919928:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.919934:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9b3b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919940:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8000/0x607405d401ae9b3b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919955:0:6525:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9b42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919966:0:6525:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9b42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919972:0:6525:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9b42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919977:0:6525:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a34050d9400 already unused, calling callback (ffffffffc19a2550) 00010000:00010000:1.0:1763343050.919980:0:6525:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9b42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919986:0:6525:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9b42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.919993:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0xdd396665 (ffff9a3403bdcf00) 00010000:00010000:1.0:1763343050.919996:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763343050.919998:0:6525:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9b42 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.920005:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9b42 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.920043:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae9b34 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca350 expref: 277 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.920060:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9b49 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca350 expref: 276 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.920067:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343050.920069:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343050.920072:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9e00, rc 0) 00000100:00100000:1.0:1763343050.920163:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:57564:x1848997993774080:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 791us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.920173:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9839 00000100:00100000:2.0:1763343050.925533:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343050.926678:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993774336 00000100:00100000:0.0:1763343050.926695:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993774336 00000100:00100000:0.0:1763343050.926777:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9840 00000100:00100000:0.0:1763343050.926790:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3511f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+276:57564:x1848997993774336:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1763343050.926820:0:10042:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343050.926849:0:10042:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b50 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca357 expref: -99 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.926995:0:10042:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae9b57 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.927015:0:10042:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae9b57 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10042 initiator: MDT0 00010000:00010000:0.0:1763343050.927030:0:10042:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae9b57 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10042 initiator: MDT0 00000004:00200000:0.0:1763343050.927044:0:10042:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x207:0x0]: returning size 107844 00010000:00010000:0.0:1763343050.927189:0:10042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b50 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca357 expref: 279 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.927219:0:10042:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a340d177400/0x607405d401ae9b57 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x207:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca357 expref: 278 pid: 10042 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343050.927229:0:10042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:0.0:1763343050.927232:0:10042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763343050.927236:0:10042:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d177400, rc 0) 00000100:00100000:0.0:1763343050.927332:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3511f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+278:57564:x1848997993774336:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 545us (1815us total) trans 8589940455 rc 0/0 00000100:00100000:0.0:1763343050.927340:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9840 00000100:00100000:3.0:1763343050.932495:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343050.933326:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993774592 00000100:00100000:1.0:1763343050.933343:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993774592 00000100:00100000:1.0:1763343050.933430:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9841 00000100:00100000:1.0:1763343050.933442:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+278:57564:x1848997993774592:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:1.0:1763343050.933476:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343050.933505:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae9b65 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca35e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.933684:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9b6c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.933704:0:6525:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9b6c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343050.933717:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9b6c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343050.933733:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x207:0x0]: returning size 107844 00010000:00010000:1.0:1763343050.933880:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9800/0x607405d401ae9b65 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca35e expref: 281 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.933904:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9b6c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x207:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca35e expref: 280 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343050.933915:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343050.933920:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763343050.933924:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9400, rc 0) 00000100:00100000:1.0:1763343050.934022:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+280:57564:x1848997993774592:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 581us (1544us total) trans 8589940456 rc 0/0 00000100:00100000:1.0:1763343050.934032:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9841 00000100:00100000:0.0:1763343050.972280:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763343050.972311:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010333696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1763343050.972403:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343050.972685:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1848998010334208:0@lo:400:kworker.0 00000100:00100000:2.0:1763343050.972722:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343050.972740:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1848998010334720:0@lo:400:kworker.0 00000100:00100000:2.0:1763343050.972767:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343050.972790:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1763343050.972795:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1848998010334080:0@lo:400:kworker.0 00000100:00100000:2.0:1763343050.972818:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343050.972833:0:3660:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1848998010334592:0@lo:400:kworker.0 00000100:00100000:2.0:1763343050.972852:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763343050.972886:0:13006:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010333696 00000100:00100000:2.0:1763343050.972896:0:13006:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010333696 00000100:00100000:2.0:1763343050.972960:0:13006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:2.0:1763343050.972971:0:13006:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1848998010333696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1763343050.973016:0:13006:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446178816 avail 1299939328 00000100:00100000:2.0:1763343050.973065:0:13006:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1848998010333696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.973073:0:13006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:2.0:1763343050.973125:0:3659:0:(client.c:3081:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967754 gen 2 00000004:00080000:2.0:1763343050.973133:0:3659:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967754 committed transno 4294967754 00000020:00080000:2.0:1763343050.973141:0:3659:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a352011df00 refcount 2 committed 0 result 0 batchid 4294969294 00000020:00080000:2.0:1763343050.973145:0:3659:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a3541120400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a352011d840 00000020:00080000:2.0:1763343050.973149:0:3659:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000406:0x2:0x0].5 00000020:00080000:2.0:1763343050.973151:0:3659:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a3541120100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a3537970a00 00000020:00080000:2.0:1763343050.973154:0:3659:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x2:0x0].12 00000100:00100000:2.0:1763343050.973193:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010333696:0@lo:41:osp-pre-1-0.0 00000020:00080000:2.0:1763343050.973214:0:32367:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969294 committed batchid 4294969293 00000020:00080000:2.0:1763343050.973300:0:32367:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969293 00000100:00100000:2.0:1763343050.973315:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010334720 00000100:00100000:2.0:1763343050.973319:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010334720 00000100:00080000:2.0:1763343050.973344:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1763343050.973380:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010334080 00000100:00100000:2.0:1763343050.973383:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010334080 00000100:00100000:2.0:1763343050.973402:0:28422:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010334592 00000100:00100000:2.0:1763343050.973405:0:28422:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010334592 00000100:00100000:2.0:1763343050.973429:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00100000:2.0:1763343050.973435:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1848998010334720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343050.973479:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1848998010334720:12345-0@lo:400:kworker.0 Request processed in 44us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.973486:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00100000:2.0:1763343050.973499:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:2.0:1763343050.973505:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1848998010334080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343050.973531:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1848998010334080:12345-0@lo:400:kworker.0 Request processed in 26us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.973537:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:2.0:1763343050.973548:0:28422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:2.0:1763343050.973554:0:28422:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1848998010334592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763343050.973589:0:28422:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1848998010334592:12345-0@lo:400:kworker.0 Request processed in 35us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343050.973595:0:28422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00080000:2.0:1763343050.973609:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1763343050.973779:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07eb4ce3-eb55-46ce-8a00-00f8f23465ad:3657:1848998010333824:0@lo:400:kworker.0 00000100:00100000:0.0:1763343050.973847:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a3511f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1848998010333952:0@lo:400:kworker.0 00000100:00100000:3.0:1763343050.974116:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34062cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1848998010335104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1763343050.974465:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1848998010334080:0@lo:400:kworker.0 00000100:00100000:1.0:1763343050.974544:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343050.974597:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1848998010334336:0@lo:400:kworker.0 00000100:00100000:1.0:1763343050.974658:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343050.974683:0:3657:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1848998010334848:0@lo:400:kworker.0 00000100:00100000:1.0:1763343050.974708:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343050.974749:0:6524:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010334848 00000100:00100000:1.0:1763343050.974755:0:6524:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010334848 00000100:00100000:1.0:1763343050.974804:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:1.0:1763343050.974812:0:6524:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1848998010334848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343050.974855:0:6524:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1848998010334848:12345-0@lo:400:kworker.0 Request processed in 43us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.974862:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:1.0:1763343050.974890:0:32345:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010333824 00000100:00100000:1.0:1763343050.974893:0:32345:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010333824 00000100:00100000:1.0:1763343050.974919:0:32345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1763343050.974925:0:32345:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353e6c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb4ce3-eb55-46ce-8a00-00f8f23465ad+23:3657:x1848998010333824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343050.974953:0:32345:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353e6c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07eb4ce3-eb55-46ce-8a00-00f8f23465ad+23:3657:x1848998010333824:12345-0@lo:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.974958:0:32345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1763343050.975022:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07eb4ce3-eb55-46ce-8a00-00f8f23465ad:3657:1848998010333824:0@lo:400:kworker.0 00000100:00100000:1.0:1763343050.975033:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1848998010334848:0@lo:400:kworker.0 00000100:00100000:1.0:1763343050.975084:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010334208 00000100:00100000:1.0:1763343050.975089:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010334208 00000100:00100000:1.0:1763343050.975115:0:15756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010334336 00000100:00100000:1.0:1763343050.975118:0:15756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010334336 00000100:00100000:1.0:1763343050.975143:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:1.0:1763343050.975150:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1848998010334208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343050.975182:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1848998010334208:12345-0@lo:400:kworker.0 Request processed in 33us (2459us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.975188:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:1.0:1763343050.975198:0:15756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:1.0:1763343050.975204:0:15756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1848998010334336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343050.975235:0:15756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1848998010334336:12345-0@lo:400:kworker.0 Request processed in 31us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.975240:0:15756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:1.0:1763343050.975264:0:3657:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1848998010334336:0@lo:400:kworker.0 00000100:00100000:0.0:1763343050.976164:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343050.976223:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1848998010334464:0@lo:400:kworker.0 00000100:00100000:0.0:1763343050.976256:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343050.976273:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1848998010334976:0@lo:400:kworker.0 00000100:00100000:0.0:1763343050.976294:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343050.976362:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010334464 00000100:00100000:0.0:1763343050.976370:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010334464 00000100:00100000:0.0:1763343050.976413:0:10042:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010334976 00000100:00100000:0.0:1763343050.976416:0:10042:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010334976 00000100:00100000:0.0:1763343050.976434:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:0.0:1763343050.976441:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1848998010334464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763343050.976492:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1848998010334464:12345-0@lo:400:kworker.0 Request processed in 50us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343050.976499:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:0.0:1763343050.976533:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1848998010334464:0@lo:400:kworker.0 00000100:00100000:0.0:1763343050.976551:0:10042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:0.0:1763343050.976556:0:10042:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1848998010334976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763343050.976582:0:10042:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1848998010334976:12345-0@lo:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343050.976586:0:10042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:0.0:1763343050.976604:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1848998010334976:0@lo:400:kworker.0 00000100:00100000:1.0:1763343050.976883:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010333952 00000100:00100000:1.0:1763343050.976887:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010333952 00000100:00100000:1.0:1763343050.976927:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:1.0:1763343050.976933:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3658:x1848998010333952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1763343050.976975:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3658:x1848998010333952:12345-0@lo:400:kworker.0 Request processed in 42us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343050.976980:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:1.0:1763343050.977009:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1848998010333952:0@lo:400:kworker.0 00000100:00100000:3.0:1763343050.977189:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763343050.977234:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010335104 00000100:00100000:3.0:1763343050.977237:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010335104 00000100:00100000:3.0:1763343050.977262:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:3.0:1763343050.977268:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3659:x1848998010335104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1763343050.977296:0:6528:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445638144 avail 1299398656 00000100:00100000:3.0:1763343050.977330:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3659:x1848998010335104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343050.977336:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:3.0:1763343050.977365:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34062cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1848998010335104:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1763343050.977399:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1763343050.977405:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1763343050.977797:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1848998010334592:0@lo:400:kworker.0 00000100:00100000:2.0:1763343050.977813:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a3511f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1848998010334208:0@lo:400:kworker.0 00000100:00100000:2.0:1763343050.977827:0:3660:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1848998010334720:0@lo:400:kworker.0 00000100:00100000:2.0:1763343051.003942:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343051.004773:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993774720 00000100:00100000:1.0:1763343051.004791:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993774720 00000100:00100000:0.0:1763343051.005570:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1730 00000100:00100000:0.0:1763343051.005587:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2431:x1848997993774720:12345-192.168.204.21@tcp:3:lfs.0 00010000:00010000:0.0:1763343051.005666:0:28424:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b7a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.005688:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343051.005691:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343051.005698:0:28424:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b7a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.005713:0:28424:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b7a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1763343051.006108:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1763343051.011716:0:28424:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b7a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.011744:0:28424:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b7a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.011761:0:28424:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.011770:0:28424:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343051.011775:0:28424:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.011786:0:28424:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.011811:0:28424:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b7a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.011820:0:28424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176a00/0x607405d401ae9b7a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2d7:0x0].0x0 rrc: 3 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343051.011944:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2431:x1848997993774720:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 6356us (8011us total) trans 0 rc 107844/107844 00000100:00100000:0.0:1763343051.011958:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1730 00000100:00100000:2.0:1763343051.022552:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343051.023102:0:28424:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993774848 00000100:00100000:0.0:1763343051.023116:0:28424:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993774848 00000100:00100000:0.0:1763343051.023549:0:28424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1731 00000100:00100000:0.0:1763343051.023564:0:28424:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993774848:12345-192.168.204.21@tcp:3:lfs.0 00002000:00010000:0.0:1763343051.023670:0:28424:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2db:0x0] initial LVB size: 110592, mtime: 0x691a7aca, atime: 0x691a7aca, ctime: 0x691a7aca, blocks: 0x70 00010000:00010000:0.0:1763343051.023681:0:28424:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae9b81 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.023705:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343051.023707:0:28424:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343051.023714:0:28424:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae9b81 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.023731:0:28424:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae9b81 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1763343051.024408:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1763343051.037058:0:28424:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae9b81 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.037082:0:28424:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae9b81 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.037094:0:28424:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae9b81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.037103:0:28424:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a340d176a00 already unused, calling callback (ffffffffc0d8ab40) 00010000:00010000:0.0:1763343051.037108:0:28424:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae9b81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.037118:0:28424:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae9b81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.037142:0:28424:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae9b81 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.037150:0:28424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae9b81 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->110591] (req 0->110591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28424 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763343051.037296:0:28424:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2429:x1848997993774848:12345-192.168.204.21@tcp:3:lfs.0 Request processed in 13727us (14748us total) trans 0 rc 107844/107844 00000100:00100000:0.0:1763343051.037311:0:28424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1731 00000100:00100000:1.0:1763343051.066195:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343051.066352:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993774976 00000100:00100000:2.0:1763343051.066366:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993774976 00000100:00100000:2.0:1763343051.066486:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 416 00000100:00100000:2.0:1763343051.066503:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+280:57564:x1848997993774976:12345-192.168.204.21@tcp:103:lfs.0 00010000:00010000:2.0:1763343051.066527:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343051.066563:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9400/0x607405d401ae9b6c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x207:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca35e expref: 280 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343051.066589:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343051.066595:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343051.066738:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+279:57564:x1848997993774976:12345-192.168.204.21@tcp:103:lfs.0 Request processed in 241us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343051.066747:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 416 00000100:00080000:3.0:1763343051.067466:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1763343051.076177:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343051.080683:0:14879:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993775232 00000100:00100000:0.0:1763343051.080707:0:14879:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993775232 00000100:00100000:1.0:1763343051.080914:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3362 00000100:00100000:1.0:1763343051.080927:0:14879:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+279:57564:x1848997993775232:12345-192.168.204.21@tcp:35:lfs.0 00000100:00100000:1.0:1763343051.081275:0:14879:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+280:57564:x1848997993775232:12345-192.168.204.21@tcp:35:lfs.0 Request processed in 340us (5105us total) trans 8589940457 rc 0/0 00000100:00100000:1.0:1763343051.081285:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3362 00000100:00100000:2.0:1763343051.091909:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343051.092133:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993775488 00000100:00100000:1.0:1763343051.092147:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993775488 00000100:00100000:1.0:1763343051.092227:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9842 00000100:00100000:1.0:1763343051.092238:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+280:57561:x1848997993775488:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:1.0:1763343051.092411:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343051.092443:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8800/0x607405d401ae9b88 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca365 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343051.092604:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343051.092663:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9b49 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca350 expref: 281 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343051.092675:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 4/0,1 mode: --/CW res: [0x200000405:0x207:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343051.092722:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9b49 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca350 expref: 281 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343051.092737:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9b49 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca350 expref: 281 pid: 6525 timeout: 1344 lvb_type: 0 00000100:00100000:1.0:1763343051.092752:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010335232:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343051.092868:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a351277f600 going to sleep for 11 seconds 00000100:00100000:3.0:1763343051.107906:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343051.107993:0:13199:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993775616 00000100:00100000:0.0:1763343051.108006:0:13199:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993775616 00010000:00010000:0.0:1763343051.108060:0:13199:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9b49 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca350 expref: 282 pid: 6525 timeout: 1344 lvb_type: 0 00000100:00100000:0.0:1763343051.108115:0:13199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3248 00000100:00100000:0.0:1763343051.108125:0:13199:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:2430:x1848997993775616:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763343051.108144:0:13199:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763343051.108151:0:13199:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9b49 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca350 expref: 282 pid: 6525 timeout: 1344 lvb_type: 0 00010000:00010000:0.0:1763343051.108165:0:13199:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9b49 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca350 expref: 282 pid: 6525 timeout: 1344 lvb_type: 0 00010000:00010000:0.0:1763343051.108194:0:13199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:0.0:1763343051.108200:0:13199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x207:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343051.108212:0:13199:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x207:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343051.108221:0:13199:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x207:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 00010000:00010000:0.0:1763343051.108247:0:13199:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763343051.108325:0:13199:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:2430:x1848997993775616:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 200us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343051.108334:0:13199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3248 00010000:00010000:1.0:1763343051.108490:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9e00/0x607405d401ae9b49 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca350 expref: 281 pid: 6525 timeout: 1344 lvb_type: 0 00000100:00100000:1.0:1763343051.108509:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010335232:192.168.204.21@tcp:104: 00010000:00010000:1.0:1763343051.108532:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x207:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343051.108541:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x207:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343051.108547:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x207:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343051.108574:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x207:0x0]: returning size 107844 00010000:00010000:1.0:1763343051.108775:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8800/0x607405d401ae9b88 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca365 expref: 282 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343051.108789:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x207:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca365 expref: 281 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343051.108797:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343051.108800:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763343051.108802:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d8600, rc 0) 00000100:00100000:1.0:1763343051.108844:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+281:57561:x1848997993775488:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 16609us (18588us total) trans 8589940458 rc 0/0 00000100:00100000:1.0:1763343051.108851:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9842 00000100:00100000:3.0:1763343051.110736:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343051.110787:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993775744 00000100:00100000:1.0:1763343051.110801:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993775744 00000100:00100000:1.0:1763343051.110936:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9843 00000100:00100000:1.0:1763343051.110947:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+281:57561:x1848997993775744:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:1.0:1763343051.110975:0:6525:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763343051.110998:0:6525:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae9b9d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca36c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343051.111110:0:6525:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9ba4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343051.111126:0:6525:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x207:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca365 expref: 282 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343051.111134:0:6525:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9ba4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343051.111169:0:6525:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x207:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca365 expref: 282 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343051.111181:0:6525:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x207:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca365 expref: 282 pid: 6525 timeout: 1344 lvb_type: 0 00000100:00100000:1.0:1763343051.111195:0:6525:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010335360:192.168.204.21@tcp:104: 00000100:00100000:1.0:1763343051.111543:0:6525:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a351277fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1763343051.113107:0:6525:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1848998010335360:192.168.204.21@tcp:104: 00010000:00010000:2.0:1763343051.113139:0:6525:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9ba4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000100:00100000:3.0:1763343051.118945:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343051.121082:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993775872 00000100:00100000:2.0:1763343051.121102:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993775872 00010000:00010000:2.0:1763343051.121160:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x207:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca365 expref: 283 pid: 6525 timeout: 1344 lvb_type: 0 00000100:00100000:2.0:1763343051.122834:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3249 00000100:00100000:2.0:1763343051.122859:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:2430:x1848997993775872:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763343051.122885:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763343051.122897:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x207:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca365 expref: 283 pid: 6525 timeout: 1344 lvb_type: 0 00010000:00010000:2.0:1763343051.122915:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x207:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca365 expref: 283 pid: 6525 timeout: 1344 lvb_type: 0 00010000:00010000:2.0:1763343051.122943:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8600/0x607405d401ae9b8f lrc: 0/0,0 mode: --/CW res: [0x200000405:0x207:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca365 expref: 283 pid: 6525 timeout: 1344 lvb_type: 0 00010000:00010000:2.0:1763343051.122964:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:2.0:1763343051.122969:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9ba4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x207:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343051.122981:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343051.122989:0:6508:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9ba4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 00010000:00010000:2.0:1763343051.123026:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763343051.123099:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+282:2430:x1848997993775872:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 253us (4171us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343051.123106:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3249 00010000:00010000:1.0:1763343051.123298:0:6525:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343051.123307:0:6525:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00000004:00200000:1.0:1763343051.123375:0:6525:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x207:0x0]: returning size 107844 00000004:00200000:1.0:1763343051.123381:0:6525:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1763343051.123407:0:6525:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 00010000:00010000:1.0:1763343051.123447:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d8200/0x607405d401ae9b9d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x207:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca36c expref: 282 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343051.123465:0:6525:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a34050d9000/0x607405d401ae9ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca36c expref: 281 pid: 6525 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343051.123473:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x207:0x0].0x0 (ffff9a35167a9300) 00010000:00010000:1.0:1763343051.123476:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763343051.123479:0:6525:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a34050d9000, rc 0) 00000100:00100000:1.0:1763343051.123515:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+281:57561:x1848997993775744:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 12571us (12792us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343051.123522:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9843 00000100:00100000:3.0:1763343051.128561:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343051.128607:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343051.129249:0:8407:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993776000 00000100:00100000:0.0:1763343051.129263:0:8407:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993776000 00000100:00100000:2.0:1763343051.129351:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993776128 00000100:00100000:2.0:1763343051.129356:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993776128 00000100:00100000:2.0:1763343051.129423:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6957 00000100:00100000:2.0:1763343051.129436:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993776128:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:2.0:1763343051.129463:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343051.129486:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae9bab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca37a expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763343051.129558:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010335488:192.168.204.21@tcp:106: 00000100:00100000:2.0:1763343051.129684:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a3512746540 going to sleep for 11 seconds 00000100:00100000:0.0:1763343051.130279:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6958 00000100:00100000:0.0:1763343051.130291:0:8407:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+15:2430:x1848997993776000:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:0.0:1763343051.130316:0:8407:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343051.130334:0:8407:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae9bb2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca373 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763343051.130362:0:8407:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2db:0x0] initial LVB size: 110592, mtime: 0x691a7aca, atime: 0x691a7aca, ctime: 0x691a7aca, blocks: 0x70 00010000:00010000:0.0:1763343051.130379:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343051.130381:0:8407:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343051.130393:0:8407:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae9bb2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca373 expref: 16 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343051.130411:0:8407:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a340d176a00/0x607405d401ae9bb2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca373 expref: 16 pid: 8407 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343051.130425:0:8407:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176a00, rc 0) 00000100:00100000:0.0:1763343051.130466:0:8407:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993776000:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 178us (1921us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343051.130474:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6958 00000100:00100000:2.0:1763343051.139435:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010335488:192.168.204.21@tcp:106: 00010000:00010000:2.0:1763343051.139493:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae9bab lrc: 1/0,0 mode: --/PR res: [0x280000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca37a expref: 17 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343051.139524:0:28994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3408d93200/0x607405d401ae9bab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca37a expref: 17 pid: 28994 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763343051.139538:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d93200, rc 0) 00000100:00100000:2.0:1763343051.139936:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2430:x1848997993776128:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 10499us (11324us total) trans 0 rc 301/301 00000100:00100000:2.0:1763343051.139948:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6957 00000100:00100000:3.0:1763343051.147088:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343051.147311:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993776256 00000100:00100000:2.0:1763343051.147372:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993776256 00000100:00100000:2.0:1763343051.147454:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6959 00000100:00100000:2.0:1763343051.147465:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:57561:x1848997993776256:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:2.0:1763343051.147492:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763343051.147526:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae9bb9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca381 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763343051.147555:0:28994:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1763343051.147587:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343051.147589:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763343051.147600:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae9bb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->110591) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca381 expref: 17 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343051.147616:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a3408d92a00/0x607405d401ae9bb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->110591) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca381 expref: 17 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763343051.147889:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a3408d92a00, rc 0) 00000100:00100000:0.0:1763343051.148155:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:57561:x1848997993776256:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 687us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343051.148165:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6959 00000100:00100000:3.0:1763343051.154977:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343051.155117:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993776512 00000100:00100000:2.0:1763343051.155131:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993776512 00000100:00100000:2.0:1763343051.155383:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3363 00000100:00100000:2.0:1763343051.155397:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+281:57561:x1848997993776512:12345-192.168.204.21@tcp:35:fsx.0 00000001:00080000:2.0:1763343051.155763:0:6527:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589940459 00000100:00100000:2.0:1763343051.155892:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:57561:x1848997993776512:12345-192.168.204.21@tcp:35:fsx.0 Request processed in 497us (929us total) trans 8589940460 rc 0/0 00000100:00100000:2.0:1763343051.155900:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3363 00000020:00080000:2.0:1763343051.155906:0:6527:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763343051.161775:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1763343051.162011:0:28994:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993776640 00000100:00100000:0.0:1763343051.162025:0:28994:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993776640 00000100:00100000:0.0:1763343051.162404:0:28994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6960 00000100:00100000:0.0:1763343051.162416:0:28994:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:57561:x1848997993776640:12345-192.168.204.21@tcp:101:fsx.0 00010000:00010000:0.0:1763343051.162441:0:28994:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763343051.162467:0:28994:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9bc0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6386aff8ffaca388 expref: -99 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.162506:0:28994:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6600/0x607405d401ae99ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2c4 expref: 18 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343051.162516:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343051.162519:0:28994:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763343051.162524:0:28994:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9bc0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca388 expref: 18 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.162566:0:28994:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6600/0x607405d401ae99ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2c4 expref: 18 pid: 28996 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763343051.162580:0:28994:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6600/0x607405d401ae99ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2c4 expref: 18 pid: 28996 timeout: 1344 lvb_type: 1 00000100:00100000:0.0:1763343051.162596:0:28994:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010335616:192.168.204.21@tcp:104: 00000100:00100000:0.0:1763343051.162847:0:28994:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a340498f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763343051.167500:0:28994:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:28994:1848998010335616:192.168.204.21@tcp:104: 00010000:00010000:0.0:1763343051.167561:0:28994:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9bc0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca388 expref: 18 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763343051.167586:0:28994:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a340d176400, rc 0) 00000100:00100000:3.0:1763343051.168796:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343051.172305:0:6508:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993776768 00000100:00100000:1.0:1763343051.172327:0:6508:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993776768 00010000:00010000:1.0:1763343051.172398:0:6508:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6600/0x607405d401ae99ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2c4 expref: 19 pid: 28996 timeout: 1344 lvb_type: 1 00000100:00100000:1.0:1763343051.172471:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3250 00000100:00100000:1.0:1763343051.172481:0:6508:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34062c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2429:x1848997993776768:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763343051.172499:0:6508:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763343051.172525:0:6508:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6600/0x607405d401ae99ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2c4 expref: 19 pid: 28996 timeout: 1344 lvb_type: 1 00010000:00010000:1.0:1763343051.172541:0:6508:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6600/0x607405d401ae99ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2c4 expref: 19 pid: 28996 timeout: 1344 lvb_type: 1 00010000:00010000:1.0:1763343051.172577:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a3405de6600/0x607405d401ae99ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca2c4 expref: 19 pid: 28996 timeout: 1344 lvb_type: 1 00010000:00010000:1.0:1763343051.172596:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343051.172599:0:6508:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763343051.172607:0:6508:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca388 expref: 18 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343051.172672:0:6508:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9bc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca388 expref: 18 pid: 28994 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763343051.172723:0:6508:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a340d176400/0x607405d401ae9bc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.21@tcp remote: 0x6386aff8ffaca388 expref: 18 pid: 28994 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763343051.172739:0:6508:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a340ccc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6508:1848998010335744:192.168.204.21@tcp:105: 00000100:00100000:1.0:1763343051.172847:0:6508:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a351277fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1763343051.174574:0:28994:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+18:57561:x1848997993776640:12345-192.168.204.21@tcp:101:fsx.0 Request processed in 12148us (12800us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343051.174589:0:28994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6960 00000100:00100000:1.0:1763343051.177279:0:6508:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a340ccc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6508:1848998010335744:192.168.204.21@tcp:105: 00010000:00010000:1.0:1763343051.177315:0:6508:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763343051.177935:0:6508:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34062c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2429:x1848997993776768:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 5450us (9141us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343051.177949:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3250 00000100:00100000:3.0:1763343051.183529:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1763343051.184668:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993777024 00000100:00100000:2.0:1763343051.184686:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993777024 00000100:00080000:3.0:1763343051.184956:0:6519:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1763343051.185003:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3364 00000100:00100000:2.0:1763343051.185018:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:57561:x1848997993777024:12345-192.168.204.21@tcp:35:fsx.0 00000001:00080000:2.0:1763343051.185474:0:6527:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967756 00000100:00100000:2.0:1763343051.185657:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:57561:x1848997993777024:12345-192.168.204.21@tcp:35:fsx.0 Request processed in 608us (2110us total) trans 4294967757 rc 0/0 00000100:00100000:2.0:1763343051.185669:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3364 00000020:00080000:2.0:1763343051.185676:0:6527:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763343051.189050:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1763343051.189233:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993777280 00000100:00100000:1.0:1763343051.189247:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993777280 00000100:00100000:1.0:1763343051.189321:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3365 00000100:00100000:1.0:1763343051.189332:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a353876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+283:57561:x1848997993777280:12345-192.168.204.21@tcp:35:fsx.0 00000100:00100000:1.0:1763343051.190246:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a353876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+284:57561:x1848997993777280:12345-192.168.204.21@tcp:35:fsx.0 Request processed in 911us (1205us total) trans 8589940461 rc 0/0 00000100:00100000:1.0:1763343051.190256:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3365 00010000:00010000:3.0:1763343051.227972:0:6511:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763343051.484296:0:32358:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1245151671066ns, next at 1246151667622ns, rc = 0 00000100:00100000:1.0:1763343051.484405:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763343051.484438:0:3659:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a34095b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010335872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1763343051.484538:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763343051.484683:0:8851:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010335872 00000100:00100000:0.0:1763343051.484696:0:8851:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010335872 00000100:00100000:0.0:1763343051.484773:0:8851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1763343051.484784:0:8851:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a340ccc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1848998010335872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1763343051.484820:0:8851:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484898112 pending 0 free 3919118336 avail 3687596032 00000100:00100000:0.0:1763343051.484867:0:8851:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a340ccc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1848998010335872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1763343051.484875:0:8851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:1.0:1763343051.484984:0:3659:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a34095b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1848998010335872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1763343051.485249:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:2.0:1763343051.485320:0:32356:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1245152698015ns, next at 1246152695469ns, rc = 0 00000100:00100000:0.0:1763343051.485372:0:3658:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a353876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010336000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1763343051.485409:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763343051.485504:0:8412:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848998010336000 00000100:00100000:1.0:1763343051.485511:0:8412:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848998010336000 00000100:00100000:1.0:1763343051.485549:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:1.0:1763343051.485558:0:8412:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a34095b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1848998010336000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1763343051.485580:0:8412:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484898112 pending 0 free 3917008896 avail 3685486592 00000100:00100000:1.0:1763343051.485659:0:8412:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a34095b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1848998010336000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1763343051.485666:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:2.0:1763343051.485858:0:3658:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a353876ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1848998010336000:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1763343052.255930:0:6512:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1763343052.774724:0:35572:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed 00000100:00100000:3.0:1763343052.978663:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343052.978715:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343052.978744:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343052.978768:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343052.978793:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1763343052.978830:0:32346:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993777408 00000100:00100000:3.0:1763343052.978844:0:32346:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993777408 00000100:00100000:3.0:1763343052.978908:0:32346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 159 00000100:00100000:3.0:1763343052.978920:0:32346:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3537bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b3ae62-6386-4093-b1cf-f8b7be7393a5+9:2432:x1848997993777408:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1763343052.979008:0:32346:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3537bf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91b3ae62-6386-4093-b1cf-f8b7be7393a5+9:2432:x1848997993777408:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 90us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343052.979018:0:32346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 159 00000100:00100000:3.0:1763343052.979064:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993777664 00000100:00100000:3.0:1763343052.979069:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993777664 00000100:00100000:3.0:1763343052.979101:0:6525:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993777536 00000100:00100000:3.0:1763343052.979105:0:6525:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993777536 00000100:00100000:3.0:1763343052.979130:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1496 00000100:00100000:3.0:1763343052.979137:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2432:x1848997993777664:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1763343052.979177:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+19:2432:x1848997993777664:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 40us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343052.979184:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1496 00000100:00100000:3.0:1763343052.979195:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1497 00000100:00100000:3.0:1763343052.979200:0:6525:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+284:2432:x1848997993777536:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1763343052.979241:0:6525:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+284:2432:x1848997993777536:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 40us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1763343052.979248:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1497 00000100:00100000:2.0:1763343052.981916:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993777920 00000100:00100000:2.0:1763343052.981936:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993777920 00000100:00100000:2.0:1763343052.982001:0:28996:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848997993777792 00000100:00100000:2.0:1763343052.982006:0:28996:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848997993777792 00000100:00100000:2.0:1763343052.982040:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 945 00000100:00100000:2.0:1763343052.982052:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993777920:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1763343052.982168:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+16:2432:x1848997993777920:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 118us (3421us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343052.982177:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 945 00000100:00100000:2.0:1763343052.982200:0:28996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 946 00000100:00100000:2.0:1763343052.982208:0:28996:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a3403ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2432:x1848997993777792:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1763343052.982245:0:28996:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a3403ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c40ca0f7-2874-427c-a29a-a0b7b64d34e4+17:2432:x1848997993777792:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 39us (3452us total) trans 0 rc 0/0 00000100:00100000:2.0:1763343052.982254:0:28996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 946 00010000:00010000:1.0:1763343053.284474:0:13198:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763343054.300861:0:13197:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 68889 lines, 68889 kept, 0 dropped, 0 bad.